-- Logs begin at Thu 2022-07-14 14:50:02 UTC, end at Thu 2022-07-14 16:33:25 UTC. -- Jul 14 15:27:12.789777 dv-cinder-826510-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 15:27:12.798710 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 15:27:12.800729 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 15:27:12 2022] *** Jul 14 15:27:12.800729 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 15:27:12.800729 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 15:27:12.800729 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: nodename: dv-cinder-826510-8-iscsi Jul 14 15:27:12.800729 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: machine: x86_64 Jul 14 15:27:12.800729 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: clock source: unix Jul 14 15:27:12.800729 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: pcre jit disabled Jul 14 15:27:12.800729 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: detected number of CPU cores: 4 Jul 14 15:27:12.800729 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: current working directory: / Jul 14 15:27:12.800729 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: detected binary path: /usr/bin/uwsgi-core Jul 14 15:27:12.801450 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: your processes number limit is 47680 Jul 14 15:27:12.801450 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: your memory page size is 4096 bytes Jul 14 15:27:12.801450 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: detected max file descriptor number: 2048 Jul 14 15:27:12.801450 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: lock engine: pthread robust mutexes Jul 14 15:27:12.801450 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: thunder lock: enabled Jul 14 15:27:12.801450 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 15:27:12.801450 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 15:27:12.846118 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: Python main interpreter initialized at 0x5598b043d9c0 Jul 14 15:27:12.846118 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: python threads support enabled Jul 14 15:27:12.846118 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: your server socket listen backlog is limited to 100 connections Jul 14 15:27:12.846118 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: your mercy for graceful operations on workers is 90 seconds Jul 14 15:27:12.846481 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 15:27:12.846558 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: *** Operational MODE: preforking *** Jul 14 15:27:12.846835 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: *** uWSGI is running in multiple interpreter mode *** Jul 14 15:27:12.846835 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: spawned uWSGI master process (pid: 103440) Jul 14 15:27:12.847049 dv-cinder-826510-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 15:27:12.848530 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: spawned uWSGI worker 1 (pid: 103441, cores: 1) Jul 14 15:27:12.848530 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: spawned uWSGI worker 2 (pid: 103442, cores: 1) Jul 14 15:27:12.848530 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 15:27:13.551977 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 15:27:13.627723 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 15:27:14.736296 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:27:14.736296 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: from cryptography.utils import int_from_bytes Jul 14 15:27:14.736943 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:27:14.736943 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: from cryptography.utils import int_from_bytes Jul 14 15:27:14.774571 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:27:14.774571 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: from cryptography.utils import int_from_bytes Jul 14 15:27:14.775120 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:27:14.775120 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: from cryptography.utils import int_from_bytes Jul 14 15:27:17.451256 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:27:17.452017 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:27:17.452155 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:27:17.452527 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:27:17.452787 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:27:17.453170 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.453495 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.453812 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.454126 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.454450 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.454758 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.455075 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.455391 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.455743 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.456003 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.456313 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.456783 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826510-8-iscsi {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.456988 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.457264 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.457549 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.457860 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.458161 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.458476 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.458778 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.459273 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.459743 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.460050 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.460358 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.460693 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.461002 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.461309 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.461625 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.461928 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.462251 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.462563 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.462962 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826510-8-iscsi {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.463276 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.463582 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.463916 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.464324 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.464633 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.464940 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.465257 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.465467 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:27:17.465874 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.465963 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:27:17.466063 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.466178 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.466316 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:27:17.466513 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.466609 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:27:17.466811 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.466904 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:27:17.467129 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.467223 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.467964 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.468246 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.468350 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.468568 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.468661 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.468887 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.468978 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.469191 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.469320 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.469493 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.469586 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.470400 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.470563 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.470669 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.470778 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.470903 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.471018 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.471127 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.471235 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.471365 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.471492 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.471653 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.471786 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826510-8-iscsi {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.471909 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.472050 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.472185 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.472309 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.472431 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.472560 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.472688 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.472818 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.472941 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.473069 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.473197 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.473329 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.473452 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.473666 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.473797 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.473797 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.474027 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.474163 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.474294 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.474428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.474557 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.474685 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.474813 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.474970 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.475136 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.475289 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.475456 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.475582 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.475800 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.475931 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.476103 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.476303 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.476434 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.476564 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.476724 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.476866 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.477037 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.477162 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.477437 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826510-8-iscsi {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.477576 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.477753 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.477885 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.478066 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.478189 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.478404 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.478540 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.478664 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.478793 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.478965 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.479091 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.479271 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.479415 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.479589 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.479754 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.479944 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.480076 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.480246 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.480382 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.480514 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.480635 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.480766 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.480918 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.481052 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.481240 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.481365 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.481562 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.481686 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.481865 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.481998 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.482177 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.482301 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.482487 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.482622 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.482806 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.483539 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.483727 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.483867 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.484039 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.484217 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.484366 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.484496 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.484640 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.484764 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.484941 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.485067 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.485246 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.485382 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.485623 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.485755 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.485887 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.486010 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.486143 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.486273 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.486396 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.486516 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.486679 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.486814 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.486993 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.487119 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.487298 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.487436 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.487664 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.487811 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.487935 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.488062 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.488226 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.488352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.488583 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.488734 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.488842 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.488967 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.489120 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.489256 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.489421 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.489555 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.489734 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.489873 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.490041 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.490168 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.490344 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.490481 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.490658 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.490790 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.490954 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.491086 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.491258 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.491390 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.491571 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.491716 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.491899 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.492032 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.492202 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.492336 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.492506 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.492638 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.492806 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.492938 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.493105 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.493231 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.493403 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.493536 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.493698 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.493830 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.493997 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.494123 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.494293 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.494419 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.494605 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.494730 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.494921 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.495048 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.495169 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.495288 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.495477 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.495654 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.495817 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.495948 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.496133 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.496265 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.496442 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.496586 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.496755 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.496886 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.497067 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.497193 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.497370 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.497509 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.497681 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.497806 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.497994 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.498125 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.498305 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.498431 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.498664 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.498950 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.499154 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.499329 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.499329 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.499709 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.499709 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.500049 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.500218 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.500384 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.500564 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.500742 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.500914 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.501088 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.501231 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.501368 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.501368 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.501692 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.501821 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.501950 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.502072 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.502206 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.502337 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.502458 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.502587 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.502709 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.502830 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.502958 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.503089 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.503218 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.503341 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.503468 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.503591 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.503766 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.503880 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.503988 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.504108 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.504236 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.504405 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.504577 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.504721 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.504912 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.505107 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.505316 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.505468 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.505602 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.505725 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.505846 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.505968 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.506089 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.506218 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.506348 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.506497 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.506625 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.506801 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.506935 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.507108 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.507251 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.507414 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.507540 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.507744 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.507870 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.508034 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.508177 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.508340 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.508466 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.508637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.508769 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.508965 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.509112 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.509271 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.509370 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.509584 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.509692 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.509890 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.509985 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.510198 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.510293 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.510507 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.510614 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:27:17.510816 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.510918 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.511126 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.511222 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.511429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.511524 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.511755 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.511852 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.512055 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.512143 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.512365 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.512452 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.512665 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.512761 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.512981 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.513068 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.513305 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.513401 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.513860 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.513970 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.514723 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.514840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.515023 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.515165 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.515331 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.515507 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.515657 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.515921 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.516008 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.516339 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.516440 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.516769 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.516945 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.517086 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.517219 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.517381 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.517525 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.517660 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.517794 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.517939 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.518080 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.518220 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.518353 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.518504 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.518639 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.518772 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.518924 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.519073 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.519275 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.519401 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.519532 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.519702 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.519840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.519972 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.520100 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.520222 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.520343 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.520477 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.520634 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.520762 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.520949 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.521075 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.521261 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.521400 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.521573 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.521713 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.521895 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.522022 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.522204 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.522341 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.522523 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.522650 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.522838 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.522969 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.523147 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.523355 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.523479 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.523630 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.523767 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.523891 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.524053 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.524192 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.524356 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.524483 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.524657 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.524784 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.524961 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.525088 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.525257 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.525383 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.525556 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.525681 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.525853 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.525980 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.526150 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.526277 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.526526 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.526662 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.526794 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.526918 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.527046 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.527169 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.527336 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.527469 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.527656 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.527785 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.527959 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.528086 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.528262 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.528399 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.528583 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.528709 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.528914 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.529041 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.529225 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.529437 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.529577 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.529888 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.530031 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.530158 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.530281 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.530413 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.530596 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.530724 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.530909 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.531037 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.531214 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.531347 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.531519 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.531664 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.531855 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.531991 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.532163 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.532290 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.532472 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.532638 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.532785 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.532941 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.533117 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.533245 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.533395 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.533521 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.533698 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.533823 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.534006 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.534141 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.534302 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.534436 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.534612 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.534744 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.534929 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.535055 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.535245 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.535372 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.535557 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.535721 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.535899 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.536032 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.536208 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.536336 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.536518 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.536737 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.536864 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.536986 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.537107 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.537228 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.537406 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.537541 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.537712 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.537844 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.538025 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.538149 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.538331 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.538471 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.538643 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.538777 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.538947 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.539072 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.539254 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.539387 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.539620 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.539758 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.539883 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.540047 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.540185 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.540309 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.540440 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.540571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.540752 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.540877 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.541059 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.541186 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.541361 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.541486 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.541663 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.541795 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.541976 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.542101 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.542280 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.542415 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.542584 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.542714 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.542890 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.543015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.543190 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.543315 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.543488 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.543652 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.543818 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.543945 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.544128 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.544254 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.544431 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.544571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.544733 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.544860 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.545031 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.545156 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.545336 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.546045 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.546194 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.546318 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.546543 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.546667 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.546871 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.547010 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.547134 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.547256 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.547439 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.547565 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.547775 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.547905 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.548093 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.548219 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.548412 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.548536 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.548710 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.548819 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.549010 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.549103 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.549328 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.549414 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.549637 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.549758 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.549938 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.550038 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.550237 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.550326 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.550537 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.550626 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.550875 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.550964 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.551182 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.551277 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.551484 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.551590 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.551825 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.551935 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.552139 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.552310 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.552443 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.552534 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.552753 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.552840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.553058 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.553155 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.553367 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.553455 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.553682 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.553768 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.553992 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.554086 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.554293 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.554393 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.554598 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.554684 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.554905 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.554999 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.555211 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.555297 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.555514 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.555621 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.555841 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.555930 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.556147 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.556232 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.556454 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.556553 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.556757 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.556844 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.557056 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.557143 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.557361 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.557446 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.557670 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.557758 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.557982 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.558242 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.558329 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.558572 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.558672 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.558879 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.558964 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.559187 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.559290 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.559499 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.559611 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.559836 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.559923 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.560145 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.560229 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.560456 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.560551 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.560761 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.560847 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.561119 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.561755 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.561917 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.562047 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.562251 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.562338 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.562598 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.562684 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.562908 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.563054 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.563212 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.563299 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.563513 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.563628 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.563840 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.563937 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.564146 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.564240 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.564443 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.564532 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.564806 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.564919 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.565041 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.565130 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.565339 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.565433 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.565647 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.565743 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.565945 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.566038 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.566253 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.566346 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.566548 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.566635 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.566862 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.566961 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.567172 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.567274 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.567468 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.567569 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.567798 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.567910 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.568095 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.568193 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.568417 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.568515 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.568719 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.568864 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.569026 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.569134 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.569351 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.569442 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.569672 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.569783 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.569970 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.570080 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.570269 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.570367 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.570578 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.570665 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.570873 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.570972 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.571171 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.571261 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.571468 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.571555 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.571798 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.571918 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.572097 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.572186 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.572392 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.572481 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.572698 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.572795 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.573000 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.573090 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.573308 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.573403 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.573609 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.573880 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.573968 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.574193 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.574280 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.574490 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.574596 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.574798 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.574886 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.575100 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.575188 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.575396 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.575485 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.575716 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.575822 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.576020 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.576109 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.576320 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.576433 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.576614 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.576809 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.576958 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.577126 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.577258 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.577436 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.577675 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.577762 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.577978 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.578066 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.578279 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.578376 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.578576 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.578665 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.578878 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.578977 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.579183 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.579281 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.579480 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.579566 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.579809 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.579908 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.580116 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.580212 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.580417 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.580563 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.580715 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.580811 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.581016 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.581108 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.581309 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.581405 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.581607 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.581696 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.581910 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.582013 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.582222 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.582309 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.582528 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.582615 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.582823 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.582912 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.583124 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.583218 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.583421 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.583517 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.583744 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.583840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.584044 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.584131 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.584344 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.584447 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.584641 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.584769 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.584936 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.585067 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.585230 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.585373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.585527 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.585695 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.585823 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.586001 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.586136 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.586305 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.586438 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.586609 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.586736 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.586918 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.587030 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.587225 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.587357 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.587527 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.587672 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.587866 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.587968 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.588177 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.588312 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.588486 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.588613 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.588795 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.588921 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.589099 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.589231 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.589407 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.589537 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.589712 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.589844 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.590024 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.590150 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.590333 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.590448 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.590635 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.590755 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.590936 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.591059 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.591243 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.591363 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.591550 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.591671 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.591877 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.591977 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.592184 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.592273 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.592514 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.592775 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.592864 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.593120 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.593230 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.593422 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.593520 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.593727 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.593817 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.594036 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.594124 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.594345 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.594441 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.594649 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.594739 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.594972 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.595071 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.595271 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.595359 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.595575 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.595698 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.595902 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.595989 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.596205 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.596294 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.596521 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.596676 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.596816 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.596961 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.597121 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.597265 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.597411 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.597541 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.597700 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.597818 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.598005 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.598124 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.598308 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.598437 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.598610 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.598745 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.598932 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.599053 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.599237 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.599359 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.599536 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.599693 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.599868 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.599998 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.600170 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.600301 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.600476 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.600603 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.600777 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.600906 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.601210 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.601297 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.601517 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.601612 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.601826 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.601914 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.602131 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.602239 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.602426 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.602514 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.602728 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.602814 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.603041 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.603129 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.603353 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.603441 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.603672 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.603764 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.604031 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.604117 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.604345 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.604443 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.604665 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.604753 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.604969 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.605062 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.605270 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.605360 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.605568 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.605668 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.605872 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.605968 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.606188 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.606275 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.606485 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.606579 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.606786 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.606882 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.607085 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.607179 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.607389 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.607474 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.607710 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.607814 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.608552 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.608648 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.608862 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.608947 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.609256 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.609351 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.609557 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.609643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.609893 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.609988 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.610201 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.610375 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.610546 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.610637 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.610861 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.610958 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.611172 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.611328 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.611483 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.611572 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.611820 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.611912 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.612134 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.612224 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.612447 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.612542 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.612762 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.612858 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.613077 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.613175 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.613382 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.613475 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.613687 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.613774 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.613983 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.614070 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.614291 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.614376 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.614597 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.614693 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.614903 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.614990 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.615219 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.615306 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.615522 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.615664 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.615935 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.616024 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.616244 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.616333 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.616557 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.616652 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.616859 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.616953 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.617163 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.617296 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.617462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.617612 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.617767 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.617928 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.618066 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.618238 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.618365 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.618555 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.618680 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.618869 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.618963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.619188 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.619284 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.619505 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.619637 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.619837 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.619930 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.620163 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.620251 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.620462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.620601 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.620780 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.620870 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.621079 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.621166 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.621394 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.621532 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.621702 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.621808 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.622017 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.622113 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.622330 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.622428 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.622629 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.622723 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.622934 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.623020 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.623238 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.623327 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.623570 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.624374 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.624507 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.624594 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.624750 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.624903 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.625402 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.625508 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.625675 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.625763 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.625987 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.626077 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.626311 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.626398 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.626636 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.626813 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.626944 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.627033 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.627269 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.627357 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.627608 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.627761 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.627929 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.628018 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.628241 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.628333 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.628615 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.628730 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.628862 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.628951 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.629185 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.629412 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.629511 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.629596 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.629751 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.629853 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.630146 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.630250 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.630331 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.630421 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.630632 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.630721 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.630929 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.631018 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.631225 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.631315 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.631521 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.631629 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.631877 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.632026 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.632176 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.632352 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.632491 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.632667 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.632793 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.632992 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.633089 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.633320 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.633415 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.633627 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.633716 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.633934 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.634023 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.634245 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.634333 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.634551 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.634638 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.634856 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.634946 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.635187 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.635325 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.635494 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.635582 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.635823 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.635922 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.636134 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.636231 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.636443 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.636539 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.636749 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.636838 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.637054 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.637142 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.637361 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.637457 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.637670 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.637757 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.637977 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.638064 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.638288 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.638391 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.638842 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.638937 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.639183 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.639359 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.639503 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.639668 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.639933 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.640033 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.640167 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.640438 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.640530 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.640765 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.640853 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.641071 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.641159 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.641377 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.641483 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.641689 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.641789 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.642000 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.642090 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.642309 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.642412 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.642617 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.642713 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.642924 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.643012 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.643230 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.643330 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.643724 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.643840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.643924 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.644011 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.644196 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.644301 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.644518 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.644605 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.644828 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.644915 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.645139 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.645228 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.645446 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.645533 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.645748 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.645841 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.646053 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.646150 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.646354 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.646442 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.646663 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.646760 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.646966 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.647054 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.647269 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.647368 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.647572 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.647745 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.647906 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.648001 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.648214 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.648302 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.648523 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.648621 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.648828 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.648916 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.649130 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.649224 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.649431 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.649528 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.649731 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.649818 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.650037 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.650125 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.650343 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.650432 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.650661 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.650749 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.650978 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.651064 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.651288 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.651376 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.651641 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.651735 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.651924 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.652011 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.652234 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.652324 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.652556 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.652746 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.652875 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.653055 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.653194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.653388 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.653511 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.653711 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.653827 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.654030 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.654147 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.654340 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.654464 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.654652 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.654927 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.655186 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.655274 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.655353 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.655432 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.655777 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.655887 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.656087 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.656329 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.656417 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.656662 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.656750 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.656980 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.657070 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.657283 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.657378 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.657582 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.657671 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.657895 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.657984 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.658196 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.658282 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.658506 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.658721 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.658818 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.659067 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.659157 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.659382 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.659473 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.659726 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.659831 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.660049 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.660145 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.660367 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.660547 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.660649 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.660832 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.660971 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.661223 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.661312 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.661544 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.661646 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.661854 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.661942 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.662158 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.662247 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.662458 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.662554 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.662754 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.662842 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.663059 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.663148 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.663361 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.663452 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.663689 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.663782 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.663995 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.664084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.664294 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.664385 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.664617 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.664704 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.664917 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.665007 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.665217 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.665307 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.665515 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.665653 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.665820 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.665918 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.666118 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.666215 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.666415 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.666549 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.666794 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.667196 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.667284 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.667449 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.667525 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.667635 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.667718 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.667815 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.667905 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.667985 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.668181 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.668302 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.668485 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.668785 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.668884 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.669085 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.669174 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.669434 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.669533 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.669752 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.669841 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.670052 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.670139 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.670350 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.670934 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.671193 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.671281 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.671585 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.671689 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.671974 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.672077 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.672285 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.672420 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.672595 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.672675 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.672941 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.673031 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.673252 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.673369 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.673596 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.673818 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.673951 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.674157 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.674274 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.674482 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.674614 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.674800 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.674959 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.675134 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.675364 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.675521 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.675757 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.675897 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.676153 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.676301 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.676434 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.676577 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.676706 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.676853 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.676982 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.677114 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.677241 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.677375 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.677504 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.677636 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.677809 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.677959 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.678095 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.678230 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.678426 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.678573 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.678706 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.678852 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.678988 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.679122 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.679283 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.679439 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.679575 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.679735 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.679934 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.680070 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.680243 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.680383 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.680612 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.680762 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.680897 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.681031 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.681177 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.681318 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.681456 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.681588 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.681743 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.681895 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.682038 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.682211 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.682355 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.682637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.682733 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.682942 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.683125 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.683246 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.683439 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.683551 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.683777 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.683881 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.684103 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.684202 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.684434 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.684524 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.684748 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.684846 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.685055 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.685143 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.685361 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.685487 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.685671 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.685800 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.686031 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.686238 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.686618 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.686933 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.687045 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.687475 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.687928 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.688166 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.688263 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.688366 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.688508 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.688652 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.688873 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.688996 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.689206 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.689295 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.689532 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.689629 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.689856 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.689944 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.690204 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.690301 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.690510 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.690599 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.690811 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.691100 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.691188 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.691405 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.691494 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.691750 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.691951 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.692042 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.692122 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.692340 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.692430 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.692637 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.692726 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.692943 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.693030 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.693246 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.693336 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.693549 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.693636 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.693850 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.693946 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.694156 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.694252 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.694460 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.694548 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.694755 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.694852 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.695055 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.695142 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.695354 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.695441 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.695675 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.695786 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.695978 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.696076 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.696278 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.696365 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.696579 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.696676 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.696879 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.696967 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.697178 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.697265 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.697476 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.697564 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.697775 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.697863 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.698073 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.698160 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.699031 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.699211 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.699354 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.699495 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.699666 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.699810 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.699985 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.700132 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.700277 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.700434 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.700577 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.700735 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.700873 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.701010 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.701149 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.701348 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.701496 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.702175 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.702323 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.702464 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.702589 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.702741 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.702890 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.703049 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.703195 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.703325 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.703325 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.703710 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.703710 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.703998 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.703998 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.704235 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.704329 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.704477 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.704477 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.704696 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.704806 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.704949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.705112 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.705263 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.705385 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.705634 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.705725 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.705960 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.706047 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.706274 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.706475 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.706596 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.706695 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.706907 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.706996 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.707218 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.707316 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.707521 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.707638 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.707860 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.707950 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.708166 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.708270 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.708474 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.708562 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.708781 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.708868 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.709087 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.709176 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.709389 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.709477 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.709695 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.709792 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.710001 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.710102 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.710310 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.710401 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.710615 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.710719 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.710922 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.711019 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.711234 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.711323 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.711539 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.711719 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.711872 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.711970 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.712181 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.712280 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.712489 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.712634 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.712796 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.712885 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.713103 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.713191 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.713414 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.713505 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.713720 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.713817 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.714025 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.714120 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.714331 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.714422 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.714576 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:27:17.714672 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.714930 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.715269 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.715621 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.715944 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.716274 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.716743 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.716920 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.717233 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.718297 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.718629 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.718955 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.719273 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.719642 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.719964 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.720284 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.720610 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.720920 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.721230 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.721549 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.721892 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.722641 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.722961 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.723295 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.723643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.723978 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.724299 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.724614 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.724947 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.725262 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.725576 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.725889 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.726204 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.726526 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.726851 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.727167 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.727480 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.727829 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.728152 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.728489 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.728820 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.729133 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.729462 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.729791 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.730164 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.730462 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.730812 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.731142 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.731459 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.731800 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.732109 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:27:17.732725 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103442) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:27:17.786362 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO dbcounter [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Registered counter for database nova_api Jul 14 15:27:17.813927 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO dbcounter [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] Registered counter for database nova_api Jul 14 15:27:17.900620 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_db.sqlalchemy.engines [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:27:17.909006 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writer thread running {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:27:17.931753 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG oslo_db.sqlalchemy.engines [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:27:17.939924 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writer thread running {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:27:17.966988 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.context [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0dff6f42-13db-4133-b104-1554a748d0a4(cell1) {{(pid=103441) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 15:27:17.971603 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:17.973191 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:17.973989 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:17.976150 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:17.978144 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO dbcounter [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Registered counter for database nova_cell0 Jul 14 15:27:17.981977 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO dbcounter [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Registered counter for database nova_cell1 Jul 14 15:27:17.992032 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_db.sqlalchemy.engines [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:27:17.996525 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.context [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0dff6f42-13db-4133-b104-1554a748d0a4(cell1) {{(pid=103442) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 15:27:17.996860 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_db.sqlalchemy.engines [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:27:18.001306 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG oslo_concurrency.lockutils [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:18.002915 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG oslo_concurrency.lockutils [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:18.003746 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG oslo_concurrency.lockutils [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:27:18.004477 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writer thread running {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:27:18.005908 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG oslo_concurrency.lockutils [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103442) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:27:18.006117 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writer thread running {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:27:18.007965 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO dbcounter [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] Registered counter for database nova_cell0 Jul 14 15:27:18.011863 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO dbcounter [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] Registered counter for database nova_cell1 Jul 14 15:27:18.020747 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG oslo_db.sqlalchemy.engines [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:27:18.024110 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG oslo_db.sqlalchemy.engines [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:27:18.027897 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writer thread running {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:27:18.158378 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO dbcounter [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Registered counter for database nova_cell0 Jul 14 15:27:18.167693 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_db.sqlalchemy.engines [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:27:18.171723 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writer thread running {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:27:18.173295 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writer thread running {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:27:18.187630 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO dbcounter [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] Registered counter for database nova_cell0 Jul 14 15:27:18.199101 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG oslo_db.sqlalchemy.engines [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103442) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:27:18.205065 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writer thread running {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:27:18.528365 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: WARNING keystonemiddleware.auth_token [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:27:18.536963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: WARNING keystonemiddleware.auth_token [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:27:18.541785 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: WARNING keystonemiddleware.auth_token [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:27:18.549329 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: WARNING keystonemiddleware.auth_token [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:27:18.893964 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: WARNING keystonemiddleware.auth_token [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:27:18.900694 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: WARNING keystonemiddleware.auth_token [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:27:18.907017 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598b043d9c0 pid: 103441 (default app) Jul 14 15:27:18.909228 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:27:18.910533 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] 10.222.0.99 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001845 Jul 14 15:27:18.911927 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 1/1] 10.222.0.99 () {50 vars in 788 bytes} [Thu Jul 14 15:27:18 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:27:18.916183 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: WARNING keystonemiddleware.auth_token [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:27:18.923286 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: WARNING keystonemiddleware.auth_token [None req-0b6e40a0-be95-435e-b097-7b7003d22e22 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:27:18.929121 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5598b043d9c0 pid: 103442 (default app) Jul 14 15:28:39.656713 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:39.658483 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003255 Jul 14 15:28:39.659160 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 2/2] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:28:39.678072 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_api:SELECT=3 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:39.680022 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_cell0:SELECT=3 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:39.681390 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_cell1:SELECT=3 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:39.682409 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_cell0:SELECT=3 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:40.785937 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-140cb64f-36ad-465e-a51a-218f2f144451 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:40.831508 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-140cb64f-36ad-465e-a51a-218f2f144451 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 1.164368 Jul 14 15:28:40.833445 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 1/3] 10.222.0.99 () {60 vars in 1291 bytes} [Thu Jul 14 15:28:39 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 1167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:28:43.307239 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:43.310341 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-b3065488-e6a4-45ed-8565-31708666ceb8 None None] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001391 Jul 14 15:28:43.310341 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 3/4] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:28:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:43.844046 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-e8df3389-5cfa-4e76-8b68-e07d4c4e725c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "name": "cirros256", "vcpus": 1, "id": "c1", "ram": 256, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:43.863086 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:28:43.863086 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: warnings.warn(msg) Jul 14 15:28:43.895799 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-e8df3389-5cfa-4e76-8b68-e07d4c4e725c admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.580647 Jul 14 15:28:43.900004 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 2/5] 10.222.0.99 () {64 vars in 1282 bytes} [Thu Jul 14 15:28:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:28:43.910050 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writing DB stats nova_api:SELECT=3 {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:43.910845 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writing DB stats nova_cell0:SELECT=3 {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:43.911856 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writing DB stats nova_cell1:SELECT=3 {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:43.912576 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:28:44.129500 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-250a37a6-58c8-4a7d-9bf3-5495e381c4a9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:44.131969 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:28:44.131969 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: warnings.warn(msg) Jul 14 15:28:44.199278 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-250a37a6-58c8-4a7d-9bf3-5495e381c4a9 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.294767 Jul 14 15:28:44.199897 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 4/6] 10.222.0.99 () {64 vars in 1335 bytes} [Thu Jul 14 15:28:43 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:46.591424 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-e8df3389-5cfa-4e76-8b68-e07d4c4e725c admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:46.593987 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-e8df3389-5cfa-4e76-8b68-e07d4c4e725c admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003424 Jul 14 15:28:46.594904 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 3/7] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:28:46 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:47.395269 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-e0d63855-a853-4299-abc2-0da46d879698 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "os-flavor-access:is_public": true, "disk": 5, "name": "ds512M", "ram": 512, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:47.415307 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:28:47.415307 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: warnings.warn(msg) Jul 14 15:28:47.438021 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-e0d63855-a853-4299-abc2-0da46d879698 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.834512 Jul 14 15:28:47.438912 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 5/8] 10.222.0.99 () {64 vars in 1282 bytes} [Thu Jul 14 15:28:46 2022] POST /compute/v2.1/flavors => generated 404 bytes in 836 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:28:47.453060 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-b0dc50b1-300f-49a1-93d3-ea9f046d9346 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:47.455205 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:28:47.455205 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: warnings.warn(msg) Jul 14 15:28:47.512638 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-b0dc50b1-300f-49a1-93d3-ea9f046d9346 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.064382 Jul 14 15:28:47.515027 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 4/9] 10.222.0.99 () {64 vars in 1335 bytes} [Thu Jul 14 15:28:47 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:50.003108 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-e0d63855-a853-4299-abc2-0da46d879698 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:50.004240 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-e0d63855-a853-4299-abc2-0da46d879698 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002006 Jul 14 15:28:50.004652 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 6/10] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:28:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:50.538641 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-9eb06da7-3e83-4666-a332-a7464fd7b34c admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "id": "d2", "name": "ds1G", "ram": 1024, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:50.559491 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-9eb06da7-3e83-4666-a332-a7464fd7b34c admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.548258 Jul 14 15:28:50.560258 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 5/11] 10.222.0.99 () {64 vars in 1282 bytes} [Thu Jul 14 15:28:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:28:50.573085 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-afb6c5a4-9bb6-4302-81a3-d7ad75017c3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:50.600010 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-afb6c5a4-9bb6-4302-81a3-d7ad75017c3b admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030605 Jul 14 15:28:50.600808 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 7/12] 10.222.0.99 () {64 vars in 1335 bytes} [Thu Jul 14 15:28:50 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:28:52.932527 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-9eb06da7-3e83-4666-a332-a7464fd7b34c admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:52.933539 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-9eb06da7-3e83-4666-a332-a7464fd7b34c admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jul 14 15:28:52.933932 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 6/13] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:28:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:53.441218 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-9fb2af22-37bd-4ce5-a9bc-feb2323b8360 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 2048, "vcpus": 2, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "disk": 10, "id": "d3"}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:53.463694 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-9fb2af22-37bd-4ce5-a9bc-feb2323b8360 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.518740 Jul 14 15:28:53.463694 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 8/14] 10.222.0.99 () {64 vars in 1282 bytes} [Thu Jul 14 15:28:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:28:53.474425 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-73aff127-caf8-446b-a3a1-a8cbbd306f74 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:53.512280 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-73aff127-caf8-446b-a3a1-a8cbbd306f74 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042835 Jul 14 15:28:53.513081 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 7/15] 10.222.0.99 () {64 vars in 1335 bytes} [Thu Jul 14 15:28:53 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:55.800075 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-9fb2af22-37bd-4ce5-a9bc-feb2323b8360 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:55.801090 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-9fb2af22-37bd-4ce5-a9bc-feb2323b8360 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Jul 14 15:28:55.801486 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 9/16] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:28:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:56.243454 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-1196cb69-5968-468f-be6f-bbf8664c463f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 20, "name": "ds4G", "ram": 4096, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "vcpus": 4, "swap": 0}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:56.264746 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-1196cb69-5968-468f-be6f-bbf8664c463f admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.456618 Jul 14 15:28:56.269801 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 8/17] 10.222.0.99 () {64 vars in 1282 bytes} [Thu Jul 14 15:28:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:28:56.277926 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-63c8fdd5-7b4a-488a-b1e1-5b9c1b4fef5c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:28:56.304389 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-63c8fdd5-7b4a-488a-b1e1-5b9c1b4fef5c admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028640 Jul 14 15:28:56.304990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 10/18] 10.222.0.99 () {64 vars in 1335 bytes} [Thu Jul 14 15:28:56 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:28:58.644227 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-1196cb69-5968-468f-be6f-bbf8664c463f admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:58.645280 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-1196cb69-5968-468f-be6f-bbf8664c463f admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001555 Jul 14 15:28:58.645697 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 9/19] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:28:58 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:28:59.086479 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-d31a4521-b85e-426b-a310-e6cb9c6dcfde admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:28:59.112526 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-d31a4521-b85e-426b-a310-e6cb9c6dcfde admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.460550 Jul 14 15:28:59.113097 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 11/20] 10.222.0.99 () {60 vars in 1291 bytes} [Thu Jul 14 15:28:58 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:29:01.497319 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-1196cb69-5968-468f-be6f-bbf8664c463f admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:01.498377 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-1196cb69-5968-468f-be6f-bbf8664c463f admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Jul 14 15:29:01.498870 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 10/21] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:29:01 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:01.910635 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-af7a89d6-2464-4e6d-92c3-f72519eafc3a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "disk": 1, "os-flavor-access:is_public": true, "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "1", "name": "m1.tiny"}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:01.931968 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-af7a89d6-2464-4e6d-92c3-f72519eafc3a admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.427018 Jul 14 15:29:01.932739 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 12/22] 10.222.0.99 () {64 vars in 1282 bytes} [Thu Jul 14 15:29:01 2022] POST /compute/v2.1/flavors => generated 402 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:29:01.944775 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-a59ae7bb-58eb-48d0-9efe-bbe0bf1704af admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:01.969515 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-a59ae7bb-58eb-48d0-9efe-bbe0bf1704af admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027901 Jul 14 15:29:01.970131 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 11/23] 10.222.0.99 () {64 vars in 1332 bytes} [Thu Jul 14 15:29:01 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:29:04.478160 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-af7a89d6-2464-4e6d-92c3-f72519eafc3a admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:04.479199 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-af7a89d6-2464-4e6d-92c3-f72519eafc3a admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jul 14 15:29:04.479610 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 13/24] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:29:04 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:04.899469 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-db4aa6a9-7fa7-4e53-8edc-dbb83663aaf5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "2", "vcpus": 1, "ram": 2048, "disk": 20, "swap": 0, "name": "m1.small"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:04.916753 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-db4aa6a9-7fa7-4e53-8edc-dbb83663aaf5 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.426747 Jul 14 15:29:04.917306 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 12/25] 10.222.0.99 () {64 vars in 1282 bytes} [Thu Jul 14 15:29:04 2022] POST /compute/v2.1/flavors => generated 405 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:29:04.930042 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-f7251fcc-dd65-4657-8074-f8a8f730d93a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:04.954139 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-f7251fcc-dd65-4657-8074-f8a8f730d93a admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027845 Jul 14 15:29:04.959509 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 14/26] 10.222.0.99 () {64 vars in 1332 bytes} [Thu Jul 14 15:29:04 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:07.247562 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-db4aa6a9-7fa7-4e53-8edc-dbb83663aaf5 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:07.248711 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-db4aa6a9-7fa7-4e53-8edc-dbb83663aaf5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jul 14 15:29:07.249791 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 13/27] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:29:07 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:07.678973 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-e08bec72-0e7d-4e28-9fc5-d4debf7d3c9f admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "id": "3", "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 40, "vcpus": 2, "name": "m1.medium", "os-flavor-access:is_public": true, "swap": 0, "ram": 4096}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:07.698961 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-e08bec72-0e7d-4e28-9fc5-d4debf7d3c9f admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.443272 Jul 14 15:29:07.703905 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 15/28] 10.222.0.99 () {64 vars in 1282 bytes} [Thu Jul 14 15:29:07 2022] POST /compute/v2.1/flavors => generated 406 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:29:07.712033 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-d22af6c6-5230-49e0-882a-d7fc22bfe277 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:07.739395 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-d22af6c6-5230-49e0-882a-d7fc22bfe277 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.030874 Jul 14 15:29:07.740320 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 14/29] 10.222.0.99 () {64 vars in 1332 bytes} [Thu Jul 14 15:29:07 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:10.056719 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-e08bec72-0e7d-4e28-9fc5-d4debf7d3c9f admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:10.058407 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-e08bec72-0e7d-4e28-9fc5-d4debf7d3c9f admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002117 Jul 14 15:29:10.059915 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 16/30] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:29:10 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:10.513460 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-cccb1f79-f5ee-4612-a9d1-d9bccff3c090 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4", "rxtx_factor": 1.0, "swap": 0, "vcpus": 4, "disk": 80}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:10.519087 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=8,nova_api:SAVEPOINT=4,nova_api:RELEASE=4 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:10.535753 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-cccb1f79-f5ee-4612-a9d1-d9bccff3c090 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.470794 Jul 14 15:29:10.536717 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 15/31] 10.222.0.99 () {64 vars in 1282 bytes} [Thu Jul 14 15:29:10 2022] POST /compute/v2.1/flavors => generated 405 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:29:10.549483 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-619c34fe-0bfc-405a-84c2-3bf35151161e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:10.576249 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-619c34fe-0bfc-405a-84c2-3bf35151161e admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031389 Jul 14 15:29:10.577283 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 17/32] 10.222.0.99 () {64 vars in 1332 bytes} [Thu Jul 14 15:29:10 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:12.872610 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-cccb1f79-f5ee-4612-a9d1-d9bccff3c090 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:12.874446 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-cccb1f79-f5ee-4612-a9d1-d9bccff3c090 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002228 Jul 14 15:29:12.874843 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 16/33] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:29:12 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:13.349353 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-f5b9f95e-ee1d-409e-8c4e-bd658332c8c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "5", "ram": 16384, "name": "m1.xlarge", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "disk": 160, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 8}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:13.368555 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-f5b9f95e-ee1d-409e-8c4e-bd658332c8c9 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.487659 Jul 14 15:29:13.369114 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 18/34] 10.222.0.99 () {64 vars in 1282 bytes} [Thu Jul 14 15:29:12 2022] POST /compute/v2.1/flavors => generated 408 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:29:13.382142 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-0eb8437b-16b8-45d2-99c5-84ad2bf80837 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:13.411156 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-0eb8437b-16b8-45d2-99c5-84ad2bf80837 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032769 Jul 14 15:29:13.412360 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 17/35] 10.222.0.99 () {64 vars in 1332 bytes} [Thu Jul 14 15:29:13 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:29:33.392479 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-f5b9f95e-ee1d-409e-8c4e-bd658332c8c9 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:33.393822 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-f5b9f95e-ee1d-409e-8c4e-bd658332c8c9 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001865 Jul 14 15:29:33.394245 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 19/36] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:29:33 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:33.409810 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_api:INSERT=2,nova_api:SELECT=8,nova_api:SAVEPOINT=1,nova_api:RELEASE=1 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:33.822834 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-ab93da3b-5817-495a-ba0c-5a6d2aec04fb admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:33.841110 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-ab93da3b-5817-495a-ba0c-5a6d2aec04fb admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.438124 Jul 14 15:29:33.841632 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 18/37] 10.222.0.99 () {60 vars in 1291 bytes} [Thu Jul 14 15:29:33 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:29:35.046436 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-f5b9f95e-ee1d-409e-8c4e-bd658332c8c9 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:35.047381 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-f5b9f95e-ee1d-409e-8c4e-bd658332c8c9 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001461 Jul 14 15:29:35.047897 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 20/38] 10.222.0.99 () {56 vars in 1074 bytes} [Thu Jul 14 15:29:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:35.616210 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-3abe514a-1284-4d00-b301-7df1cc739f29 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:35.622288 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.wsgi [None req-3abe514a-1284-4d00-b301-7df1cc739f29 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-3abe514a-1284-4d00-b301-7df1cc739f29 admin admin] Request method failure captured: Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Accept: application/json Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Accept-Encoding: gzip, deflate Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Connection: keep-alive Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Content-Length: 0 Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Host: 10.222.0.99 Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Openstack-Api-Version: compute 2.90 Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Openstack-System-Scope: None Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: User-Agent: python-novaclient Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Auth-Token: gAAAAABi0DZeYpY4TIlz3mSB2GxIidC65_06w6oW9Z69TN0Nl8XHmcJcnlfhgXOvBdftpgNTllQFIPlqxoy-WIkLBRXl81btmEzLYLbM0ivlbHT07Rc4dcWyonSTu2SsVLmnK_glLGF50ESBb6MXqw2v9qlUjblSDSXCqTVBQ7XFbBwqXn_c4-g Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Domain-Id: None Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Domain-Name: None Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Identity-Status: Confirmed Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Is-Admin-Project: True Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Project-Domain-Id: default Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Project-Domain-Name: Default Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Project-Id: ae21968b232140b899e10f7d7d033a88 Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Project-Name: admin Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Role: reader,member,admin Jul 14 15:29:35.625637 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Roles: reader,member,admin Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ae21968b232140b899e10f7d7d033a88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Tenant: admin Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Tenant-Id: ae21968b232140b899e10f7d7d033a88 Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Tenant-Name: admin Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User: admin Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User-Domain-Id: default Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User-Domain-Name: Default Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User-Id: 3e33ee1d9fa74c5fa2f58e221ad2d0a8 Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User-Name: admin Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: method: > Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: exception: Flavor 42 could not be found. Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: action_args: {'id': '42'} Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:29:35.627571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:35.628643 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:35.630180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-3abe514a-1284-4d00-b301-7df1cc739f29 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103442) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:29:35.631388 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-3abe514a-1284-4d00-b301-7df1cc739f29 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.440606 Jul 14 15:29:35.631388 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 19/39] 10.222.0.99 () {60 vars in 1190 bytes} [Thu Jul 14 15:29:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 442 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:35.637092 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-b751e8d2-4a85-4ad9-9cd2-6318660cb2ca admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:35.641210 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:29:35.666928 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-b751e8d2-4a85-4ad9-9cd2-6318660cb2ca admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033480 Jul 14 15:29:35.667544 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 21/40] 10.222.0.99 () {60 vars in 1210 bytes} [Thu Jul 14 15:29:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:29:35.677931 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-97b2fc3a-9228-49db-a345-67496af92c8b admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:35.700305 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-97b2fc3a-9228-49db-a345-67496af92c8b admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026192 Jul 14 15:29:35.700874 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 20/41] 10.222.0.99 () {60 vars in 1210 bytes} [Thu Jul 14 15:29:35 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:29:35.711076 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-b27905be-6e9c-4c26-bf3e-b794cd187a6a admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:35.719576 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.wsgi [None req-b27905be-6e9c-4c26-bf3e-b794cd187a6a admin admin] HTTP exception thrown: Flavor 42 could not be found. Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-b27905be-6e9c-4c26-bf3e-b794cd187a6a admin admin] Request method failure captured: Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Accept: application/json Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Accept-Encoding: gzip, deflate Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Connection: keep-alive Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Content-Length: 0 Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Host: 10.222.0.99 Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Openstack-Api-Version: compute 2.90 Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Openstack-System-Scope: None Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: User-Agent: python-novaclient Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Auth-Token: gAAAAABi0DZeYpY4TIlz3mSB2GxIidC65_06w6oW9Z69TN0Nl8XHmcJcnlfhgXOvBdftpgNTllQFIPlqxoy-WIkLBRXl81btmEzLYLbM0ivlbHT07Rc4dcWyonSTu2SsVLmnK_glLGF50ESBb6MXqw2v9qlUjblSDSXCqTVBQ7XFbBwqXn_c4-g Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Domain-Id: None Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Domain-Name: None Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Identity-Status: Confirmed Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Is-Admin-Project: True Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Project-Domain-Id: default Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Project-Domain-Name: Default Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Project-Id: ae21968b232140b899e10f7d7d033a88 Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Project-Name: admin Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Role: reader,member,admin Jul 14 15:29:35.723035 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Roles: reader,member,admin Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ae21968b232140b899e10f7d7d033a88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Tenant: admin Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Tenant-Id: ae21968b232140b899e10f7d7d033a88 Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Tenant-Name: admin Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User: admin Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User-Domain-Id: default Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User-Domain-Name: Default Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User-Id: 3e33ee1d9fa74c5fa2f58e221ad2d0a8 Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User-Name: admin Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: method: > Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: exception: Flavor 42 could not be found. Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: action_args: {'id': '42'} Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:29:35.724561 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:35.725429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:35.726949 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-b27905be-6e9c-4c26-bf3e-b794cd187a6a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:29:35.728136 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-b27905be-6e9c-4c26-bf3e-b794cd187a6a admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.017085 Jul 14 15:29:35.728136 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 22/42] 10.222.0.99 () {60 vars in 1190 bytes} [Thu Jul 14 15:29:35 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 18 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:36.800592 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-97b2fc3a-9228-49db-a345-67496af92c8b admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:36.801633 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-97b2fc3a-9228-49db-a345-67496af92c8b admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Jul 14 15:29:36.802029 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 21/43] 10.222.0.99 () {56 vars in 1074 bytes} [Thu Jul 14 15:29:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:37.357335 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-18cf0bfb-abf1-4f09-a6b4-d7ca20973d90 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:37.363424 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.wsgi [None req-18cf0bfb-abf1-4f09-a6b4-d7ca20973d90 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-18cf0bfb-abf1-4f09-a6b4-d7ca20973d90 admin admin] Request method failure captured: Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Accept: application/json Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Accept-Encoding: gzip, deflate Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Connection: keep-alive Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Content-Length: 0 Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Host: 10.222.0.99 Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Openstack-Api-Version: compute 2.90 Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Openstack-System-Scope: None Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: User-Agent: python-novaclient Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Auth-Token: gAAAAABi0DZgiLzf6eVXqqDCiwl4Q2PcY025778jPLlgroMP1ywWuNc8IKm44ePW-UNnsyfDemj37EagvyTiSFvN3sTisCa9FEz2ACjae6CNsYLWkphSlqiFRcQGgweZI80bb7_umG0wnen5VGEI3D3VBNOaordhlriCKbhFrvcxX8FRd2XrcsU Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Domain-Id: None Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Domain-Name: None Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Identity-Status: Confirmed Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Is-Admin-Project: True Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Project-Domain-Id: default Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Project-Domain-Name: Default Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Project-Id: ae21968b232140b899e10f7d7d033a88 Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Project-Name: admin Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Role: reader,member,admin Jul 14 15:29:37.364990 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Roles: reader,member,admin Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ae21968b232140b899e10f7d7d033a88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Tenant: admin Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Tenant-Id: ae21968b232140b899e10f7d7d033a88 Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Tenant-Name: admin Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User: admin Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User-Domain-Id: default Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User-Domain-Name: Default Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User-Id: 3e33ee1d9fa74c5fa2f58e221ad2d0a8 Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User-Name: admin Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: method: > Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: exception: Flavor 84 could not be found. Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: action_args: {'id': '84'} Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:29:37.366462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:37.367337 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:37.368428 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-18cf0bfb-abf1-4f09-a6b4-d7ca20973d90 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:29:37.369502 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-18cf0bfb-abf1-4f09-a6b4-d7ca20973d90 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.427259 Jul 14 15:29:37.369502 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 23/44] 10.222.0.99 () {60 vars in 1190 bytes} [Thu Jul 14 15:29:36 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 428 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:37.377005 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-debc7a5f-5f14-4df9-b104-d8d64ba26da7 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:37.391310 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-debc7a5f-5f14-4df9-b104-d8d64ba26da7 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018593 Jul 14 15:29:37.392406 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 22/45] 10.222.0.99 () {60 vars in 1210 bytes} [Thu Jul 14 15:29:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:29:37.402170 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-51387f92-331b-43ba-a3c3-35457c99cac5 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:37.415825 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-51387f92-331b-43ba-a3c3-35457c99cac5 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017296 Jul 14 15:29:37.416343 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 24/46] 10.222.0.99 () {60 vars in 1210 bytes} [Thu Jul 14 15:29:37 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:29:37.425846 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-98da9a25-d48b-463a-88d1-fd54ee91caa8 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:37.431329 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.wsgi [None req-98da9a25-d48b-463a-88d1-fd54ee91caa8 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-98da9a25-d48b-463a-88d1-fd54ee91caa8 admin admin] Request method failure captured: Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Accept: application/json Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Accept-Encoding: gzip, deflate Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Connection: keep-alive Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Content-Length: 0 Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Host: 10.222.0.99 Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Openstack-Api-Version: compute 2.90 Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Openstack-System-Scope: None Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: User-Agent: python-novaclient Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Auth-Token: gAAAAABi0DZgiLzf6eVXqqDCiwl4Q2PcY025778jPLlgroMP1ywWuNc8IKm44ePW-UNnsyfDemj37EagvyTiSFvN3sTisCa9FEz2ACjae6CNsYLWkphSlqiFRcQGgweZI80bb7_umG0wnen5VGEI3D3VBNOaordhlriCKbhFrvcxX8FRd2XrcsU Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Domain-Id: None Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Domain-Name: None Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Identity-Status: Confirmed Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Is-Admin-Project: True Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Project-Domain-Id: default Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Project-Domain-Name: Default Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Project-Id: ae21968b232140b899e10f7d7d033a88 Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Project-Name: admin Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Role: reader,member,admin Jul 14 15:29:37.432868 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Roles: reader,member,admin Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ae21968b232140b899e10f7d7d033a88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Tenant: admin Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Tenant-Id: ae21968b232140b899e10f7d7d033a88 Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Tenant-Name: admin Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User: admin Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User-Domain-Id: default Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User-Domain-Name: Default Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User-Id: 3e33ee1d9fa74c5fa2f58e221ad2d0a8 Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User-Name: admin Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: method: > Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: exception: Flavor 84 could not be found. Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: action_args: {'id': '84'} Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:29:37.434373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:37.435194 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:37.437084 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-98da9a25-d48b-463a-88d1-fd54ee91caa8 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103442) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:29:37.438345 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-98da9a25-d48b-463a-88d1-fd54ee91caa8 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011969 Jul 14 15:29:37.438345 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 23/47] 10.222.0.99 () {60 vars in 1190 bytes} [Thu Jul 14 15:29:37 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:38.464336 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-51387f92-331b-43ba-a3c3-35457c99cac5 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:38.465329 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-51387f92-331b-43ba-a3c3-35457c99cac5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jul 14 15:29:38.465713 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 25/48] 10.222.0.99 () {56 vars in 1074 bytes} [Thu Jul 14 15:29:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:29:39.006059 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-a170d08d-1abc-4ad3-a8ed-4bd068156b4a admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:39.011778 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.wsgi [None req-a170d08d-1abc-4ad3-a8ed-4bd068156b4a admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-a170d08d-1abc-4ad3-a8ed-4bd068156b4a admin admin] Request method failure captured: Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Accept: application/json Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Accept-Encoding: gzip, deflate Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Connection: keep-alive Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Content-Length: 0 Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Host: 10.222.0.99 Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Openstack-Api-Version: compute 2.90 Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Openstack-System-Scope: None Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: User-Agent: python-novaclient Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Auth-Token: gAAAAABi0DZi4tNb39KojNItwfVLE757oWIe5k9esKPbEu8NBRv4cCFeQUChgR8pcwaBhBUOJvUELb_lh4RizRxUKb-LhkGuUpOgpLnBErf06boVtxfWM57xi0FLpLFDyAAbUjzeZdP5f-Ca5mnT4qn_Le9pDfyDp85Bz5zoT8Hgcr9-Hvwevrs Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Domain-Id: None Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Domain-Name: None Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Identity-Status: Confirmed Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Is-Admin-Project: True Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Project-Domain-Id: default Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Project-Domain-Name: Default Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Project-Id: ae21968b232140b899e10f7d7d033a88 Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Project-Name: admin Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Role: reader,member,admin Jul 14 15:29:39.013259 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Roles: reader,member,admin Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ae21968b232140b899e10f7d7d033a88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Tenant: admin Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Tenant-Id: ae21968b232140b899e10f7d7d033a88 Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-Tenant-Name: admin Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User: admin Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User-Domain-Id: default Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User-Domain-Name: Default Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User-Id: 3e33ee1d9fa74c5fa2f58e221ad2d0a8 Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: X-User-Name: admin Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: method: > Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: exception: Flavor 451 could not be found. Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: action_args: {'id': '451'} Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:29:39.016015 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:39.016840 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: ERROR nova.api.openstack.wsgi Jul 14 15:29:39.018373 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-a170d08d-1abc-4ad3-a8ed-4bd068156b4a admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103442) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:29:39.019622 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-a170d08d-1abc-4ad3-a8ed-4bd068156b4a admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.413738 Jul 14 15:29:39.019622 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 24/49] 10.222.0.99 () {60 vars in 1193 bytes} [Thu Jul 14 15:29:38 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 415 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:39.025526 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-d264f938-7e45-4809-8d66-9e1738bb3b71 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:39.040631 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-d264f938-7e45-4809-8d66-9e1738bb3b71 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018704 Jul 14 15:29:39.041175 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 26/50] 10.222.0.99 () {60 vars in 1210 bytes} [Thu Jul 14 15:29:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:29:39.051245 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:39.067180 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019512 Jul 14 15:29:39.067736 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 25/51] 10.222.0.99 () {60 vars in 1210 bytes} [Thu Jul 14 15:29:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:29:39.077051 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-ec92d219-b268-4790-9572-205e850857e2 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:39.082407 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.wsgi [None req-ec92d219-b268-4790-9572-205e850857e2 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-ec92d219-b268-4790-9572-205e850857e2 admin admin] Request method failure captured: Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Accept: application/json Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Accept-Encoding: gzip, deflate Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Connection: keep-alive Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Content-Length: 0 Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Host: 10.222.0.99 Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Openstack-Api-Version: compute 2.90 Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Openstack-System-Scope: None Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: User-Agent: python-novaclient Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Auth-Token: gAAAAABi0DZi4tNb39KojNItwfVLE757oWIe5k9esKPbEu8NBRv4cCFeQUChgR8pcwaBhBUOJvUELb_lh4RizRxUKb-LhkGuUpOgpLnBErf06boVtxfWM57xi0FLpLFDyAAbUjzeZdP5f-Ca5mnT4qn_Le9pDfyDp85Bz5zoT8Hgcr9-Hvwevrs Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Domain-Id: None Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Domain-Name: None Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Identity-Status: Confirmed Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Is-Admin-Project: True Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Openstack-Nova-Api-Version: 2.90 Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Project-Domain-Id: default Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Project-Domain-Name: Default Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Project-Id: ae21968b232140b899e10f7d7d033a88 Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Project-Name: admin Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Role: reader,member,admin Jul 14 15:29:39.083963 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Roles: reader,member,admin Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_ae21968b232140b899e10f7d7d033a88"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/ae21968b232140b899e10f7d7d033a88"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Tenant: admin Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Tenant-Id: ae21968b232140b899e10f7d7d033a88 Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-Tenant-Name: admin Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User: admin Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User-Domain-Id: default Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User-Domain-Name: Default Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User-Id: 3e33ee1d9fa74c5fa2f58e221ad2d0a8 Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: X-User-Name: admin Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: method: > Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: exception: Flavor 451 could not be found. Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: action_args: {'id': '451'} Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:29:39.085538 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:39.086352 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: ERROR nova.api.openstack.wsgi Jul 14 15:29:39.087427 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-ec92d219-b268-4790-9572-205e850857e2 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:29:39.088932 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-ec92d219-b268-4790-9572-205e850857e2 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011891 Jul 14 15:29:39.088932 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 27/52] 10.222.0.99 () {60 vars in 1193 bytes} [Thu Jul 14 15:29:39 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jul 14 15:29:40.105995 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:40.107004 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jul 14 15:29:40.107726 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 26/53] 10.222.0.99 () {56 vars in 1074 bytes} [Thu Jul 14 15:29:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:40.666234 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-cff8ac70-ab70-44bd-8f7b-e3368635ecac admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:40.675497 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-cff8ac70-ab70-44bd-8f7b-e3368635ecac admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.428851 Jul 14 15:29:40.676092 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 28/54] 10.222.0.99 () {64 vars in 1235 bytes} [Thu Jul 14 15:29:40 2022] POST /compute/v2.1/flavors => generated 404 bytes in 430 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:29:41.661500 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:41.662488 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jul 14 15:29:41.662874 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 27/55] 10.222.0.99 () {56 vars in 1074 bytes} [Thu Jul 14 15:29:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:42.209330 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-bc16a65c-d2d6-4d64-94ce-5bebd9689e11 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:42.229221 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-bc16a65c-d2d6-4d64-94ce-5bebd9689e11 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.424019 Jul 14 15:29:42.229777 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 29/56] 10.222.0.99 () {64 vars in 1235 bytes} [Thu Jul 14 15:29:41 2022] POST /compute/v2.1/flavors => generated 405 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:29:43.226779 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:43.227835 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001455 Jul 14 15:29:43.228232 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 28/57] 10.222.0.99 () {56 vars in 1074 bytes} [Thu Jul 14 15:29:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:43.769170 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-1b516f3a-4fda-483e-b618-1b3825d2bc71 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:43.788816 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-1b516f3a-4fda-483e-b618-1b3825d2bc71 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.418531 Jul 14 15:29:43.789385 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 30/58] 10.222.0.99 () {64 vars in 1235 bytes} [Thu Jul 14 15:29:43 2022] POST /compute/v2.1/flavors => generated 407 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:29:44.813742 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:44.814787 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001584 Jul 14 15:29:44.815195 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 29/59] 10.222.0.99 () {56 vars in 1074 bytes} [Thu Jul 14 15:29:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:29:45.371077 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-140b5e72-3301-41d1-9522-f85d64c49137 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:29:45.392915 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-140b5e72-3301-41d1-9522-f85d64c49137 admin admin] 10.222.0.99 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.435762 Jul 14 15:29:45.393470 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 31/60] 10.222.0.99 () {64 vars in 1235 bytes} [Thu Jul 14 15:29:44 2022] POST /compute/v2.1/flavors => generated 409 bytes in 437 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:29:46.392754 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:46.393976 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001747 Jul 14 15:29:46.394370 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 30/61] 10.222.0.99 () {56 vars in 1074 bytes} [Thu Jul 14 15:29:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:29:46.941532 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-71976752-8dd1-441c-8def-ae99e0b940aa admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:29:46.961183 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-71976752-8dd1-441c-8def-ae99e0b940aa admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.425427 Jul 14 15:29:46.961721 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 32/62] 10.222.0.99 () {60 vars in 1202 bytes} [Thu Jul 14 15:29:46 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:30:41.105571 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:41.106580 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-7353604e-32e5-48ba-999c-00f4aa1f01a5 admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jul 14 15:30:41.106976 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 31/63] 10.222.0.99 () {54 vars in 930 bytes} [Thu Jul 14 15:30:41 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:30:41.117639 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:41.542230 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-520b1cdd-c654-441e-937d-7a29125bfcb1 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:41.563521 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-520b1cdd-c654-441e-937d-7a29125bfcb1 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.450102 Jul 14 15:30:41.564021 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 33/64] 10.222.0.99 () {60 vars in 1291 bytes} [Thu Jul 14 15:30:41 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:30:41.586380 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG dbcounter [-] [103442] Writing DB stats nova_api:SELECT=14 {{(pid=103442) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:30:41.590375 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-05c092fd-1d75-4a9c-914d-ec7bbbf5a28d admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:41.599331 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-05c092fd-1d75-4a9c-914d-ec7bbbf5a28d admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014650 Jul 14 15:30:41.599904 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 32/65] 10.222.0.99 () {60 vars in 1282 bytes} [Thu Jul 14 15:30:41 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:30:41.612631 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-f28e16b4-582c-4c40-839b-d7001564ef7d admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:41.620461 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-f28e16b4-582c-4c40-839b-d7001564ef7d admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012641 Jul 14 15:30:41.620975 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 34/66] 10.222.0.99 () {60 vars in 1285 bytes} [Thu Jul 14 15:30:41 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:41.633134 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-26f38b35-b804-4afa-bd9d-6d07c25bc7cd admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:41.641645 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-26f38b35-b804-4afa-bd9d-6d07c25bc7cd admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012020 Jul 14 15:30:41.642200 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 33/67] 10.222.0.99 () {60 vars in 1285 bytes} [Thu Jul 14 15:30:41 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:30:41.654377 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-8f344b24-1dcf-4dac-a8b9-e1bd1cb02a19 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:30:41.662393 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-8f344b24-1dcf-4dac-a8b9-e1bd1cb02a19 admin admin] 10.222.0.99 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011687 Jul 14 15:30:41.662928 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 35/68] 10.222.0.99 () {60 vars in 1282 bytes} [Thu Jul 14 15:30:41 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:34:18.706068 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-26f38b35-b804-4afa-bd9d-6d07c25bc7cd admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:18.707065 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-26f38b35-b804-4afa-bd9d-6d07c25bc7cd admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Jul 14 15:34:18.707462 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 34/69] 10.222.0.99 () {56 vars in 1074 bytes} [Thu Jul 14 15:34:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:18.848605 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writing DB stats nova_api:SELECT=6 {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:19.016053 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-bb1584af-9ca7-4ae0-a19c-20703b7406c4 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:19.017258 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:34:19.017258 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: warnings.warn(msg) Jul 14 15:34:19.018462 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-bb1584af-9ca7-4ae0-a19c-20703b7406c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:19.018903 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-bb1584af-9ca7-4ae0-a19c-20703b7406c4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:19.019728 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-bb1584af-9ca7-4ae0-a19c-20703b7406c4 admin admin] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:19.020163 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-bb1584af-9ca7-4ae0-a19c-20703b7406c4 admin admin] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:19.055429 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-bb1584af-9ca7-4ae0-a19c-20703b7406c4 admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.208416 Jul 14 15:34:19.056115 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 36/70] 10.222.0.99 () {60 vars in 1193 bytes} [Thu Jul 14 15:34:18 2022] GET /compute/v2.1/os-services => generated 791 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:34:19.909441 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-26f38b35-b804-4afa-bd9d-6d07c25bc7cd admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:19.910447 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-26f38b35-b804-4afa-bd9d-6d07c25bc7cd admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001411 Jul 14 15:34:19.910842 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 35/71] 10.222.0.99 () {56 vars in 1074 bytes} [Thu Jul 14 15:34:19 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:20.102406 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-b77ac2e6-fd3f-4b4b-8fb4-291b4d40d499 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:20.103616 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:34:20.103616 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: warnings.warn(msg) Jul 14 15:34:20.104873 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-b77ac2e6-fd3f-4b4b-8fb4-291b4d40d499 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:20.105312 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-b77ac2e6-fd3f-4b4b-8fb4-291b4d40d499 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:20.106097 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-b77ac2e6-fd3f-4b4b-8fb4-291b4d40d499 admin admin] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:20.107151 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-b77ac2e6-fd3f-4b4b-8fb4-291b4d40d499 admin admin] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:20.126628 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-b77ac2e6-fd3f-4b4b-8fb4-291b4d40d499 admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.076100 Jul 14 15:34:20.127114 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 37/72] 10.222.0.99 () {60 vars in 1193 bytes} [Thu Jul 14 15:34:20 2022] GET /compute/v2.1/os-services => generated 791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:34:31.380951 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-26f38b35-b804-4afa-bd9d-6d07c25bc7cd admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:31.382333 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-26f38b35-b804-4afa-bd9d-6d07c25bc7cd admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jul 14 15:34:31.382481 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 36/73] 10.222.0.99 () {56 vars in 1074 bytes} [Thu Jul 14 15:34:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:31.538491 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writing DB stats nova_cell0:SELECT=4 {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:31.539304 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writing DB stats nova_cell1:SELECT=4 {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:31.539837 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG dbcounter [-] [103441] Writing DB stats nova_api:SELECT=8 {{(pid=103441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:34:31.589347 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-b56bb09c-4cae-4c94-8188-010c3026ccf2 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:31.590634 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:34:31.590634 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: warnings.warn(msg) Jul 14 15:34:31.591825 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-b56bb09c-4cae-4c94-8188-010c3026ccf2 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:31.592979 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-b56bb09c-4cae-4c94-8188-010c3026ccf2 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:31.594269 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-b56bb09c-4cae-4c94-8188-010c3026ccf2 admin admin] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:31.594924 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-b56bb09c-4cae-4c94-8188-010c3026ccf2 admin admin] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:31.624964 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-b56bb09c-4cae-4c94-8188-010c3026ccf2 admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.095023 Jul 14 15:34:31.625533 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 38/74] 10.222.0.99 () {60 vars in 1193 bytes} [Thu Jul 14 15:34:31 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:34:32.464139 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: DEBUG nova.api.openstack.wsgi [None req-26f38b35-b804-4afa-bd9d-6d07c25bc7cd admin admin] Calling method '>' {{(pid=103442) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:32.465270 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: INFO nova.api.openstack.requestlog [None req-26f38b35-b804-4afa-bd9d-6d07c25bc7cd admin admin] 10.222.0.99 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001626 Jul 14 15:34:32.465676 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: [pid: 103442|app: 0|req: 37/75] 10.222.0.99 () {56 vars in 1074 bytes} [Thu Jul 14 15:34:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:34:32.662833 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG nova.api.openstack.wsgi [None req-6e996bd2-03e8-4ddd-b0b6-6ef77dcf2ca4 admin admin] Calling method '>' {{(pid=103441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:34:32.664473 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 14 15:34:32.664473 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: warnings.warn(msg) Jul 14 15:34:32.665360 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-6e996bd2-03e8-4ddd-b0b6-6ef77dcf2ca4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:32.665808 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-6e996bd2-03e8-4ddd-b0b6-6ef77dcf2ca4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:32.666601 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-6e996bd2-03e8-4ddd-b0b6-6ef77dcf2ca4 admin admin] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:34:32.667032 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: DEBUG oslo_concurrency.lockutils [None req-6e996bd2-03e8-4ddd-b0b6-6ef77dcf2ca4 admin admin] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:34:32.690346 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: INFO nova.api.openstack.requestlog [None req-6e996bd2-03e8-4ddd-b0b6-6ef77dcf2ca4 admin admin] 10.222.0.99 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.079566 Jul 14 15:34:32.690837 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: [pid: 103441|app: 0|req: 39/76] 10.222.0.99 () {60 vars in 1193 bytes} [Thu Jul 14 15:34:32 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:35:37.863778 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: Thu Jul 14 15:35:37 2022 - graceful shutdown triggered... Jul 14 15:35:37.863243 dv-cinder-826510-8-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jul 14 15:35:37.864742 dv-cinder-826510-8-iscsi devstack@n-api.service[103442]: Gracefully killing worker 2 (pid: 103442)... Jul 14 15:35:37.865168 dv-cinder-826510-8-iscsi devstack@n-api.service[103441]: Gracefully killing worker 1 (pid: 103441)... Jul 14 15:35:38.864398 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: worker 1 buried after 1 seconds Jul 14 15:35:38.864966 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: worker 2 buried after 1 seconds Jul 14 15:35:38.864966 dv-cinder-826510-8-iscsi devstack@n-api.service[103440]: goodbye to uWSGI. Jul 14 15:35:38.865957 dv-cinder-826510-8-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jul 14 15:35:38.866498 dv-cinder-826510-8-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jul 14 15:35:38.869388 dv-cinder-826510-8-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jul 14 15:35:38.879898 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jul 14 15:35:38.882074 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jul 14 15:35:38 2022] *** Jul 14 15:35:38.882074 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 14 15:35:38.882074 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 14 15:35:38.882074 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: nodename: dv-cinder-826510-8-iscsi Jul 14 15:35:38.882074 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: machine: x86_64 Jul 14 15:35:38.882074 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: clock source: unix Jul 14 15:35:38.882074 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: pcre jit disabled Jul 14 15:35:38.882074 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: detected number of CPU cores: 4 Jul 14 15:35:38.882074 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: current working directory: / Jul 14 15:35:38.882074 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: detected binary path: /usr/bin/uwsgi-core Jul 14 15:35:38.882074 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: your processes number limit is 47680 Jul 14 15:35:38.882783 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: your memory page size is 4096 bytes Jul 14 15:35:38.882783 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: detected max file descriptor number: 2048 Jul 14 15:35:38.882783 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: lock engine: pthread robust mutexes Jul 14 15:35:38.882783 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: thunder lock: enabled Jul 14 15:35:38.882783 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jul 14 15:35:38.882783 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Jul 14 15:35:38.928821 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: Python main interpreter initialized at 0x55f76fdb39c0 Jul 14 15:35:38.928821 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: python threads support enabled Jul 14 15:35:38.928821 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: your server socket listen backlog is limited to 100 connections Jul 14 15:35:38.928821 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: your mercy for graceful operations on workers is 90 seconds Jul 14 15:35:38.929280 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: mapped 403077 bytes (393 KB) for 2 cores Jul 14 15:35:38.929280 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: *** Operational MODE: preforking *** Jul 14 15:35:38.929564 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: *** uWSGI is running in multiple interpreter mode *** Jul 14 15:35:38.929564 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: spawned uWSGI master process (pid: 124486) Jul 14 15:35:38.929863 dv-cinder-826510-8-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jul 14 15:35:38.930381 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: spawned uWSGI worker 1 (pid: 124502, cores: 1) Jul 14 15:35:38.930913 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: spawned uWSGI worker 2 (pid: 124503, cores: 1) Jul 14 15:35:38.931212 dv-cinder-826510-8-iscsi devstack@n-api.service[124486]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 14 15:35:39.615300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 15:35:39.637268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jul 14 15:35:40.855392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:35:40.855392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: from cryptography.utils import int_from_bytes Jul 14 15:35:40.856164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:35:40.856164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: from cryptography.utils import int_from_bytes Jul 14 15:35:40.859654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:35:40.859654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: from cryptography.utils import int_from_bytes Jul 14 15:35:40.860347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 14 15:35:40.860347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: from cryptography.utils import int_from_bytes Jul 14 15:35:43.230815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:35:43.231482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:35:43.231627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:35:43.232192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:35:43.232457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:35:43.232854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.233189 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.233517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.233843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.234183 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.234500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.234828 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.235157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.235501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.236480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.236682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.237025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826510-8-iscsi {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.237451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.237758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.238077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.238405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.238716 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.239049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.239361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.239902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.241278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.241278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.241489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.241710 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.242205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.242692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.243184 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.243510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.243890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.244226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.244621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826510-8-iscsi {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.244949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.245283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.245596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.246024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.246345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.246709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.246990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.247354 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.247698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.248051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.248368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.248691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.249026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.249331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.249646 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.249963 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.250282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.250596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.250906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.251157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.252218 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.252666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.253004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.253336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.253600 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.253864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.254308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.254638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.254957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.255275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.255614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.255932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.256247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.256561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.256875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.257188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.257518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.257840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.258171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.258484 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.258815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.259229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.259491 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.259848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.260202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.260533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.260935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.261263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.261592 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.261905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.262221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.262535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.262860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.263201 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.263513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.263802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.264115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.264429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.264756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.265068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.265386 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.265696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.266004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.266316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.266629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.267018 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.267337 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.267686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.268003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.268316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.268630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.268943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.269276 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.269604 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.269918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.270228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.270797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.271111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.271437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.271776 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.272091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.272516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.272835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.273149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.273480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.273795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.274104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.274425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.274731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.275048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.275383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.275737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.276055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.276367 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.276679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.276987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.277301 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.277613 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.277931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.278232 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.278562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.278892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.279209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.279524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.279863 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.280192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.280541 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.280889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.281242 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.281565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.281905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.282246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.282606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.282932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.283257 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.283688 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.283969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.284292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.284610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.284936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.285265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.285672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.286013 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.286342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.286666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.286995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.287307 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.287670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.288001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.288324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.288675 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.289074 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.289600 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.290090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.290589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.291059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.291343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 14 15:35:43.291831 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 14 15:35:43.292163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 14 15:35:43.292280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.292527 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.292640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 14 15:35:43.292775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 14 15:35:43.292902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.293199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.293440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.293546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.293766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.293868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.294094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.294208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.294413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.294511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.294744 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.294850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.295054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.295153 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.295373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.295482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.295728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.295827 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.296056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.296162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.296314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.296458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.296624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.296804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.296976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826510-8-iscsi {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.297124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.297269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.297413 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.297555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.297708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.297853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.298011 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.298671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.298830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.298976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.299154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.299308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.299465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.299668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.299822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.300559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.300870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.300870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.301197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.301346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.301500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.301655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.301866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.302235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.302414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.302602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.302808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.303061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.303295 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.303450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.303636 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.303808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.303957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.304110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.304264 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.304416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.304574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.304718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.304879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.305031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826510-8-iscsi {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.305183 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.305335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.305480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.305770 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.306002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.306155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.306299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.306451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.306596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.306844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.307032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.307188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.307334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.307485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.307485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.307876 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.308031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.308031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.308475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.308704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.308862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.309027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.309222 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.309404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.309404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.309679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.309884 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.309884 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.310158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.310964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.310964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.311263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.311418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.311418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.311771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.311918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.312068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.312463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.312625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.312772 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.312925 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.313080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.313237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.313395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.313395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.313869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.314678 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.314838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.314994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.315157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.315311 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.315463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.315629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.315793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.315956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.316116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.316270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.316414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.316573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.316726 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.316884 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.317029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.317181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.317324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.317467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.317609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.317609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.318536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.318536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.318930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.318930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.319236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.319392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.319547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.319728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.319875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.320019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.320163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.99 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.320315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.321239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.99 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.321397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.321629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.321784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.321929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.322102 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.322250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.322250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.322792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.322792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.323408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.323408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.324039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.324204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.324399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.324549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.324549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.324855 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.325009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.325165 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.325312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.325312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.325636 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.325869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.326069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.326296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.326550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.326713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.326870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.327063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.327227 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.327380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.327533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.327801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.327997 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.328200 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.328353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.328872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.328872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.329193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.329373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.329373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.329666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.329824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.329967 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.330177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.330177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.330592 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.330969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.331501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.331666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.331818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.332053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.332225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.332381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.332810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.332810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.333132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.333285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.333465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.333613 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.333775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.333927 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.334086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.334242 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.334432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.334589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.334736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.334930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.335091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.335236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.335387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.335584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.335792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.335938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.335938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.336209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.336352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.336504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.336680 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.336829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.336985 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.337137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.337290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.337446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.337626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.337811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.337968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.338121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.338121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.338411 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.338565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.338709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.338861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.339059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.339059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.339358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.339502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.339674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.339868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.340018 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.340243 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.340396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.340540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.340689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.341212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.342177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.342361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.342518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.342693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.343085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.343240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.343396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.343541 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.343745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.343900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.344052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.344241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.344405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.344550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.344704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.344848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.344848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.345227 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 14 15:35:43.345484 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.345639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.345898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.346053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.346267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.346418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.346577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.346724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.346867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.347022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.347201 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.347361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.347506 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.347667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.347816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.347972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.348152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.348318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.348482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.348636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.348787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.348945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.349088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.349247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.349400 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.349553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.349696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.349848 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.350054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.350210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.350424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.350424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.350711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.350862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.351134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.351498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.351987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.352143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.352288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.352432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.352591 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.352737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.352880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.353265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.353418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.353578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.353755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.354853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.355014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.355014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.355312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.355464 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.355630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.355795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.355967 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.356685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.356851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.356851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.357147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.357293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.357445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.357599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.357752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.357907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.358052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.358052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.358333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.358522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.358680 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.358825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.358969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.359130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.359321 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.359513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.359733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.359894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.360056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.360202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.360359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.360511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.361646 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.362034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.362352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.362551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.362551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.363007 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.363425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.363617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.363782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.363929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.364080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.364225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.364369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.364527 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.364686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.364831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.364975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.365137 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.365291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.365455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.365610 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.365763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.366162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.366333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.366498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.366663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.366815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.366965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.367115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.367465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.367734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.367896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.368056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.368822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.368935 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.369025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.369125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.369220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.369312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.369458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.369555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.369650 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.369744 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.369830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.369922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.370013 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.370013 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.370166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.370265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.370265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.370428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.370428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.370621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.370742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.370837 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.370837 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.370991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.371075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.371165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.371258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.371351 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.371351 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.371749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.371855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.372029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.372136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.372225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.372225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.372388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.372481 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.372643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.372643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.372808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.372808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.373000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.373094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.373193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.373559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.373669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.373765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.373863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.373948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.374042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.374135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.374220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.374311 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.374403 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.374494 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.374589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.374674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.374766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.374851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.374934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.375035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.375120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.375219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.375304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.375395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.375496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.375612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.375753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.375857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.375944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.376028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.376118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.376245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.376362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.376437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.376997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.377132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.377319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.377419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.377506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.377590 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.377682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.377775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.377869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.377962 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.378054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.378146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.378231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.378315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.378407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.378499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.378585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.378719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.378813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.378952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.379057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.379143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.379234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.379327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.379412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.379503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.379629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.379718 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.379830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.379926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.380019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.380117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.380210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.380296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.380296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.380457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.380549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.380646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.380731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.380822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.380914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.380999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.381082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.381179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.381264 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.381347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.381437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.381529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.381634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.381791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.381891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.381978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.382065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.382065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.382227 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.382320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.382413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.382512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.382597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.382681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.382772 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.382857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.382949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.383034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.383125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.383217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.383310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.383391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.383729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.383831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.383930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.384034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.384130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.384217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.384301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.384393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.384486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.384580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.384667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.384759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.384849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.384941 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.385026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.385125 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.385218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.385432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.385608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.385708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.385795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.385987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.386082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.386297 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.386400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.386625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.386764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.386916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.387007 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.387232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.387335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.387555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.387686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.387908 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.388004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.388218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.388319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.388532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.388640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.388879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.388981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.389156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.389469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.389793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.390044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.390164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.390367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.390462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.390687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.390794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.391005 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.391097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.391315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.391415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.391753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.391901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.392165 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.392352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.392792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.393117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.393249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.393445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.393586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.393749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.394023 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.394117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.394368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.394469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.394677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.394768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.394990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.395089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.395572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.395744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.395914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.396010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.396243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.396336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.396558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.396665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.396870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.397009 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.397182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.397336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.397509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.397655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.397822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.397968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.398130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.398280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.398438 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.398605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.398735 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.398920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.399089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.399256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.399428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.399568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.399871 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.400143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.400249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.400465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.400581 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.400815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.400912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.401137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.401241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.401459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.401638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.401773 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.401959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.402115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.402473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.402581 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.402719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.402808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.403033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.403125 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.403349 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.403455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.403691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.403871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.404128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.404225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.404332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.404631 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.404801 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.404942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.405246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.405353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.405554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.405688 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.405866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.406040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.406212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.406305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.406738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.406836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.407084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.407221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.407436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.407824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.408012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.408369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.408559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.408774 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.408937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.409195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.409338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.409621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.409899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.410033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.410353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.410464 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.410797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.411514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.411671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.411671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.411826 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.412174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.412269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.412359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.412452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.412554 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.412863 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.413284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.413594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.413733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.413932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.414071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.414440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.414532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.414635 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.414709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.414962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.415070 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.415154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.415355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.415571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.415709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.415961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.416056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.416274 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.416368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.416588 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.416682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.416912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.417007 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.417222 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.417313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.417543 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.417646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.417861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.417961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.418178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.418271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.418499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.418604 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.418801 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.418895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.419122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.419226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.419466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.419578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.419785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.419892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.420094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.420193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.420424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.420524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.420754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.420847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.421067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.421159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.421397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.421498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.421705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.421809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.422012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.422104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.422323 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.422418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.422630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.422736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.422992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.423096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.423866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.424009 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.424179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.424283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.424524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.424739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.424856 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.425032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.425164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.425349 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.425509 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.425667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.425844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.425982 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.426164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.426275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.426548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.426659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.426884 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.426977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.427202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.427515 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.427853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.427971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.428181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.428306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.428490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.428594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.428820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.428921 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.429107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.429208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.429383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.429495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.429697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.429792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.430026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.430124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.430308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.430402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.430686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.430787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.431015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.431127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.431477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.431834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.432162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.432436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.432562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.432780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.432982 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.433095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.433185 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.433544 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.433655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.433732 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.433835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.434046 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.434173 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.434359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.434492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.434682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.434860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.435040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.435298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.435451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.435630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.435739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.435925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.436041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.436249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.436485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.436586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.436819 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.436921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.437145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.437283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.437453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.437595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.437764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.437875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.438077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.438170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.438383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.438483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.438690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.438893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.439566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.439693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.439915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.440199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.440312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.440537 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.440821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.441001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.441139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.441241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.441448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.441615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.441771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.441873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.442083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.442186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.442403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.442573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.442716 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.442864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.443032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.443265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.443471 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.443701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.443877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.444027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.444205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.444355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.444502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.444659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.445019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.445183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.445365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.445521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.445665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.445817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.445972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.446123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.446277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.446419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.446571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.446714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.446856 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.447013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.447157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.447311 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.447453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.447675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.447903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.448127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.448286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.448444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.448602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.448746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.448903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.449066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.449222 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.449379 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.449535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.449689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.449851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.449992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.450147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.450292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.450437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.450594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.450751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.450918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.451063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.451207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.451407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.451623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.451623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.451957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.452104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.452248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.452393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.452546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.452711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.452860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.453014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.453169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.453314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.453473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.453630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.453630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.453966 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.454113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.454262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.454426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.454566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.454703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.454845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.455284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.455436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.455617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.455781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.455781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.456052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.456256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.456424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.456581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.456725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.456868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.457023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.457166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.457319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.457473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.457615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.457757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.457954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.458109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.458268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.458424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.458569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.458711 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.458855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.458987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.459137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.459290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.459449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.459589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.459863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.460024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.460171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.460314 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.460459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.460604 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.460760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.460926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.461084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.461240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.461395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.461542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.461700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.461865 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.462078 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.462273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.462460 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.462606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.462710 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.462839 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.462927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.463016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.463088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.463171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.463261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.463347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.463430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.463512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.463612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.463942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.464057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.464243 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.464342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.464632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.464944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.465273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.465597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.465923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.466034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.466232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.466345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.466549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.466656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.466861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.466970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.467188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.467296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.467514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.467653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.467850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.468166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.468472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.468798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.469124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.469438 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.469763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.470232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.470830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.471213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.471504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.471652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.471981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.472115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.472193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.472348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.472646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.472863 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.473022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.473192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.473348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.473510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.473661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.473820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.473990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.474229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.474383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.474530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.474680 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.474823 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.474964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.475116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.475267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.475459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.475634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.475807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.475903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.475983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.476107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.476210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.476434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.476536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.476751 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.476844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.477079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.477172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.477399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.477509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.477738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.477862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.478147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.478309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.478473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.478570 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.478869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.479084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.479307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.479462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.479644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.479850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.480022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.480143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.480335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.480458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.480619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.480756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.480958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.481065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.481278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.481373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.481603 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.481705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.481919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.482026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.482234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.482328 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.482557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.482659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.482888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.483001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.483194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.483502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.483724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.483838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.483976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.484176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.484365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.484462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.484736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.484874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.485047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.485144 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.485416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.485561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.486205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.486414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.486552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.486722 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.487048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.487173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.487369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.487467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.487750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.487874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.488093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.488233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.488480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.488675 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.488855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.488968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.489089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.489265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.489426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.489637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.489868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.490017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.490218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.490377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.490533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.490675 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.490856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.490966 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.491242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.491366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.491571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.491995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.491995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.492144 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.492258 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.492489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.492631 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.492731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.492882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.492985 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.493202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.493423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.493528 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.493746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.493839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.494074 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.494176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.494405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.494583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.494724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.494861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.495021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.495174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.495353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.495529 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.495730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.495950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.496056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.496289 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.496393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.496614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.496708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.496988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.497096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.497263 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.497372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.497586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.497678 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.497905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.498006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.498214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.498321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.498527 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.498620 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.499450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.499567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.499753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.499853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.499853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.500008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.500091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.500173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.500270 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.500364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.500494 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.500626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.500723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.500904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.501039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.501954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.502126 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.502268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.502421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.502562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.502801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.502904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.503162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.503261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.503473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.503579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.504646 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.504750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.504829 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.504899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.504969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.505049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.505129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.505206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.505276 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.505353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.505433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.505511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.505613 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.505689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.505915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.506008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.506210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.506325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.506541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.506633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.506858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.506974 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.507174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.507271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.508383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.508511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.508603 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.508752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.508871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.508992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.509105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.509105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.509309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.509410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.509511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.509642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.509759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.509878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.510034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.510163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.510351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.510486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.511573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.511968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.512404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.512934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.513182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.513306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.513418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.513538 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.513659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.513772 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.513891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.514010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.514137 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.514251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.514376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.514518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.514658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.514804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.515028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.515173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.515318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.516402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.516544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.516666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.516779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.516779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.516779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.516779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.516779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.517501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.517501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.517728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.518377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.519047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.519358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.519732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.520073 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.520647 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.520851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.521026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.521198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.521364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.521967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.522343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.522704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.522829 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.523039 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.523137 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.523367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.523467 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.523729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.523944 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.524043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.524282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.524397 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.524647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.524747 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.525181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.525292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.525292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.525456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.525721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.525814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.525992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.526083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.526270 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124502) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:35:43.526386 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.526573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.526853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.527496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.527496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.528257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.528536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.528878 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.529176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.529495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.529815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.530865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.530865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.530865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.531338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.531338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.531683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.532000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.532268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.533264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.533869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.534227 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.534763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.535460 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.535575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.536001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.536364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.536685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.537021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.537339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.537799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.538286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.538482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.539085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.539423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.539812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.540168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.540506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.540819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.541132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.541442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.541775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.542095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.542412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.542741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.543060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.543375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.543724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.544043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.544357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.544672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.544985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.545300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.545608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.545927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.546250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.546614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.546938 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.547260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.547727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.548056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.548987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.549527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.551885 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.552294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.552653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.553178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.553727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.554295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.554782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.555095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.555403 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.555843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.556153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.556495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.556829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.557152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.557485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.557806 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.558206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.558564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.558902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.559235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.559550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.559924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.560207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.560525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.560852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.561169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.561508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.561819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.562161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.562476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.562785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.563248 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.563557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.564485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.564961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.565275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.565702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.566027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.566338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.566649 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.566965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.567274 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.567588 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.568086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.568401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.568709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.569058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.569395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.569717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.570042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.570357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.570683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.570997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.571330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.571666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.571989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.572302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.572639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.572954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.573420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.573740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.574055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.574366 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.574701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.575043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.575373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.575709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.576108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.576433 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.576760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.577133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.577451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.577787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.578100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.578412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.578723 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.579036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.579386 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.579836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.580520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.580870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.581524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.581524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.581902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.582160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.582473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.582806 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.583135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.583681 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.584007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.584359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.584693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.585011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.585713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.586040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 14 15:35:43.586293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124503) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 14 15:35:43.684991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO dbcounter [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] Registered counter for database nova_api Jul 14 15:35:43.708317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_db.sqlalchemy.engines [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:35:43.715680 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writer thread running {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:35:43.751786 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO dbcounter [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] Registered counter for database nova_api Jul 14 15:35:43.774433 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_db.sqlalchemy.engines [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:35:43.777196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.context [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0dff6f42-13db-4133-b104-1554a748d0a4(cell1) {{(pid=124502) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 15:35:43.781387 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:43.783377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:43.783626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writer thread running {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:35:43.783926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:43.785939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:43.787989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO dbcounter [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] Registered counter for database nova_cell0 Jul 14 15:35:43.792183 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO dbcounter [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] Registered counter for database nova_cell1 Jul 14 15:35:43.802098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_db.sqlalchemy.engines [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:35:43.802912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_db.sqlalchemy.engines [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:35:43.810749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writer thread running {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:35:43.811092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writer thread running {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:35:43.842562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.context [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),0dff6f42-13db-4133-b104-1554a748d0a4(cell1) {{(pid=124503) load_cells /opt/stack/nova/nova/context.py:464}} Jul 14 15:35:43.846960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:43.848636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:43.849509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:35:43.851553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:35:43.853587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO dbcounter [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] Registered counter for database nova_cell0 Jul 14 15:35:43.857739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO dbcounter [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] Registered counter for database nova_cell1 Jul 14 15:35:43.865597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_db.sqlalchemy.engines [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:35:43.866900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_db.sqlalchemy.engines [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:35:43.873674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writer thread running {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:35:43.874981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writer thread running {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:35:43.963945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO dbcounter [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] Registered counter for database nova_cell0 Jul 14 15:35:43.970599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_db.sqlalchemy.engines [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124502) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:35:43.975060 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writer thread running {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:35:44.026539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO dbcounter [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] Registered counter for database nova_cell0 Jul 14 15:35:44.034917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_db.sqlalchemy.engines [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124503) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 14 15:35:44.039350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writer thread running {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 14 15:35:44.297281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: WARNING keystonemiddleware.auth_token [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:35:44.305596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: WARNING keystonemiddleware.auth_token [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:35:44.371094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: WARNING keystonemiddleware.auth_token [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:35:44.380097 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: WARNING keystonemiddleware.auth_token [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:35:44.656148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: WARNING keystonemiddleware.auth_token [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:35:44.663123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: WARNING keystonemiddleware.auth_token [None req-accc0284-15fd-42fd-9215-647167c5bca8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:35:44.669715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f76fdb39c0 pid: 124502 (default app) Jul 14 15:35:44.735292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: WARNING keystonemiddleware.auth_token [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jul 14 15:35:44.742575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: WARNING keystonemiddleware.auth_token [None req-20a254f0-fb25-4970-bd46-36e21598290b None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jul 14 15:35:44.749121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55f76fdb39c0 pid: 124503 (default app) Jul 14 15:36:27.911837 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=3 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:27.913817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=3 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:27.916485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=3 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:27.918655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=3 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:28.427719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:28.430462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:28.432352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:28.436454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:29.858787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8aa14d00-1468-47f4-bc26-f0797832cd12 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Action: 'create', calling method: .version_select at 0x7f357d6b5c10>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1736276683", "metadata": {"Type": "work"}}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8aa14d00-1468-47f4-bc26-f0797832cd12 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Request method failure captured: Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 122 Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0Df7EJ1jGSVWQrGsK6kxoC2CLoOa97lhIaLiQYGoHprcYH7qzRAe02G4VRyt8naxyb3q2a4FJ7F7ggb4Ygfb0pun5aqg7G0sPxlhEHwWdHM4Z2XSRBi5LXNXhpFcZ0GnIj_POw0QY3yqyajmc8toYmbcAirDcGCDdEq9ipbZxdQxT-E Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 5172d2ae5b244afd99f04b3cd6e056d0 Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:36:29.882848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 5172d2ae5b244afd99f04b3cd6e056d0 Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-VolumesNegativeTest-1780807723-project Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 30ffdf00311048a6a47d142e5231119d Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-VolumesNegativeTest-1780807723-project Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1736276683", "metadata": {"Type": "work"}}} Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: Jul 14 15:36:29.884273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1736276683', 'metadata': {'Type': 'work'}}}} Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi '#$%' Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:29.885141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:36:29.886512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:36:29.889806 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jul 14 15:36:29.889806 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.891275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8aa14d00-1468-47f4-bc26-f0797832cd12 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:29.892546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8aa14d00-1468-47f4-bc26-f0797832cd12 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 1.999502 Jul 14 15:36:29.894060 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1/1] 10.222.0.99 () {60 vars in 1155 bytes} [Thu Jul 14 15:36:27 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 2004 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 15:36:29.905171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6adbe7c6-7312-47b0-9f86-68a903f3b1f5 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Action: 'create', calling method: .version_select at 0x7f357d6d0f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2035186767", "metadata": {"Type": "work"}}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6adbe7c6-7312-47b0-9f86-68a903f3b1f5 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Request method failure captured: Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 120 Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0Df7EJ1jGSVWQrGsK6kxoC2CLoOa97lhIaLiQYGoHprcYH7qzRAe02G4VRyt8naxyb3q2a4FJ7F7ggb4Ygfb0pun5aqg7G0sPxlhEHwWdHM4Z2XSRBi5LXNXhpFcZ0GnIj_POw0QY3yqyajmc8toYmbcAirDcGCDdEq9ipbZxdQxT-E Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 5172d2ae5b244afd99f04b3cd6e056d0 Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:36:29.912220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 5172d2ae5b244afd99f04b3cd6e056d0 Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-VolumesNegativeTest-1780807723-project Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 30ffdf00311048a6a47d142e5231119d Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-VolumesNegativeTest-1780807723-project Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2035186767", "metadata": {"Type": "work"}}} Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: Jul 14 15:36:29.913703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2035186767', 'metadata': {'Type': 'work'}}}} Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi '0' Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:29.914629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:36:29.916167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:36:29.917799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jul 14 15:36:29.917799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.918387 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6adbe7c6-7312-47b0-9f86-68a903f3b1f5 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:29.922559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6adbe7c6-7312-47b0-9f86-68a903f3b1f5 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.022406 Jul 14 15:36:29.923572 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 2/2] 10.222.0.99 () {60 vars in 1155 bytes} [Thu Jul 14 15:36:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 24 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:36:29.937166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6a548dfe-7f46-452a-9432-e56b3160e796 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Action: 'create', calling method: .version_select at 0x7f357d6d00d0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1480495143", "metadata": {"Type": "work"}}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6a548dfe-7f46-452a-9432-e56b3160e796 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Request method failure captured: Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 119 Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0Df7EJ1jGSVWQrGsK6kxoC2CLoOa97lhIaLiQYGoHprcYH7qzRAe02G4VRyt8naxyb3q2a4FJ7F7ggb4Ygfb0pun5aqg7G0sPxlhEHwWdHM4Z2XSRBi5LXNXhpFcZ0GnIj_POw0QY3yqyajmc8toYmbcAirDcGCDdEq9ipbZxdQxT-E Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 5172d2ae5b244afd99f04b3cd6e056d0 Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:36:29.945024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 5172d2ae5b244afd99f04b3cd6e056d0 Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-VolumesNegativeTest-1780807723-project Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 30ffdf00311048a6a47d142e5231119d Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-VolumesNegativeTest-1780807723-project Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1480495143", "metadata": {"Type": "work"}}} Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: Jul 14 15:36:29.946259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1480495143', 'metadata': {'Type': 'work'}}}} Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise error Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi On instance['volume']: Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi '' Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:29.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jul 14 15:36:29.948560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jul 14 15:36:29.949868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jul 14 15:36:29.949868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:29.954532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6a548dfe-7f46-452a-9432-e56b3160e796 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:29.960636 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6a548dfe-7f46-452a-9432-e56b3160e796 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.029794 Jul 14 15:36:29.961714 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 3/3] 10.222.0.99 () {60 vars in 1155 bytes} [Thu Jul 14 15:36:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 31 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:36:29.971009 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7353f23-af96-4767-824c-cf403620d57d tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Calling method '.version_select at 0x7f357d5e5c10>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:30.190634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c9f0d2ec-fbf8-45f8-acbe-8a22c488fc63 tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] Action: 'create', calling method: .version_select at 0x7f357d727ca0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1755886671", "metadata": {"Type": "work"}}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:30.378063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-d7353f23-af96-4767-824c-cf403620d57d tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] HTTP exception thrown: Volume tempest-invalid-131536385 could not be found. Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7353f23-af96-4767-824c-cf403620d57d tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Request method failure captured: Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-131536385 HTTP/1.1 Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0Df7EJ1jGSVWQrGsK6kxoC2CLoOa97lhIaLiQYGoHprcYH7qzRAe02G4VRyt8naxyb3q2a4FJ7F7ggb4Ygfb0pun5aqg7G0sPxlhEHwWdHM4Z2XSRBi5LXNXhpFcZ0GnIj_POw0QY3yqyajmc8toYmbcAirDcGCDdEq9ipbZxdQxT-E Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 5172d2ae5b244afd99f04b3cd6e056d0 Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:36:30.382071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 5172d2ae5b244afd99f04b3cd6e056d0 Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-VolumesNegativeTest-1780807723-project Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 30ffdf00311048a6a47d142e5231119d Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-VolumesNegativeTest-1780807723-project Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Volume tempest-invalid-131536385 could not be found. Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'tempest-invalid-131536385'} Jul 14 15:36:30.383732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-131536385 could not be found. (HTTP 404) (Request-ID: req-4793a9c2-8e79-426e-bda5-0f58d369ba00) Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:30.384673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 15:36:30.386116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-131536385 could not be found. Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:36:30.387477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-131536385 could not be found. Jul 14 15:36:30.388818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.388818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:30.388818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.388818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:30.388818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:30.388818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:30.388818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:36:30.388818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:36:30.388818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-131536385 could not be found. Jul 14 15:36:30.388818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.388818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7353f23-af96-4767-824c-cf403620d57d tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Returning 404 to user: Volume tempest-invalid-131536385 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:30.390563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d7353f23-af96-4767-824c-cf403620d57d tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/tempest-invalid-131536385" status: 404 len: 98 microversion: 2.1 time: 0.423552 Jul 14 15:36:30.393603 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 4/4] 10.222.0.99 () {58 vars in 1214 bytes} [Thu Jul 14 15:36:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-131536385 => generated 98 bytes in 427 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Jul 14 15:36:30.406861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-814e5ad7-9318-4d01-9cba-3f9084f5c444 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003969 Jul 14 15:36:30.412618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 5/5] 10.222.0.99 () {58 vars in 1139 bytes} [Thu Jul 14 15:36:30 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 11 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 15:36:30.428565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-79f889f0-64a0-4956-a302-8b276f8ef3a8 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005743 Jul 14 15:36:30.429511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 6/6] 10.222.0.99 () {58 vars in 1136 bytes} [Thu Jul 14 15:36:30 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 12 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jul 14 15:36:30.441208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-830f330b-8933-4a16-92bf-13750eab8e81 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Calling method '.version_select at 0x7f357d51b040>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:30.892287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-830f330b-8933-4a16-92bf-13750eab8e81 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] HTTP exception thrown: Volume e66c378d-3fd3-484d-b63b-7327ce48cf41 could not be found. Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-830f330b-8933-4a16-92bf-13750eab8e81 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Request method failure captured: Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/os-volumes/e66c378d-3fd3-484d-b63b-7327ce48cf41 HTTP/1.1 Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0Df7EJ1jGSVWQrGsK6kxoC2CLoOa97lhIaLiQYGoHprcYH7qzRAe02G4VRyt8naxyb3q2a4FJ7F7ggb4Ygfb0pun5aqg7G0sPxlhEHwWdHM4Z2XSRBi5LXNXhpFcZ0GnIj_POw0QY3yqyajmc8toYmbcAirDcGCDdEq9ipbZxdQxT-E Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 5172d2ae5b244afd99f04b3cd6e056d0 Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:36:30.894695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 5172d2ae5b244afd99f04b3cd6e056d0 Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-VolumesNegativeTest-1780807723-project Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 30ffdf00311048a6a47d142e5231119d Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-VolumesNegativeTest-1780807723-project Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Volume e66c378d-3fd3-484d-b63b-7327ce48cf41 could not be found. Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'e66c378d-3fd3-484d-b63b-7327ce48cf41'} Jul 14 15:36:30.896632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e66c378d-3fd3-484d-b63b-7327ce48cf41 could not be found. (HTTP 404) (Request-ID: req-dee3dfa6-22d9-4cd2-b48e-b459793f5476) Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:30.897783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 15:36:30.899151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e66c378d-3fd3-484d-b63b-7327ce48cf41 could not be found. Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 15:36:30.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e66c378d-3fd3-484d-b63b-7327ce48cf41 could not be found. Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e66c378d-3fd3-484d-b63b-7327ce48cf41 could not be found. Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-830f330b-8933-4a16-92bf-13750eab8e81 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Returning 404 to user: Volume e66c378d-3fd3-484d-b63b-7327ce48cf41 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-830f330b-8933-4a16-92bf-13750eab8e81 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/e66c378d-3fd3-484d-b63b-7327ce48cf41" status: 404 len: 109 microversion: 2.1 time: 0.460162 Jul 14 15:36:30.901960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 7/7] 10.222.0.99 () {58 vars in 1247 bytes} [Thu Jul 14 15:36:30 2022] DELETE /compute/v2.1/os-volumes/e66c378d-3fd3-484d-b63b-7327ce48cf41 => generated 109 bytes in 461 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:36:30.905068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-01f4a8cd-1fb4-4b2a-a5c4-56d46ad3b3ff tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] Calling method '.version_select at 0x7f357d51b3a0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:31.039633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-01f4a8cd-1fb4-4b2a-a5c4-56d46ad3b3ff tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/5d5898f9-9c02-4752-813a-c1f909f9726a" status: 200 len: 351 microversion: 2.1 time: 0.141291 Jul 14 15:36:31.040218 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 8/8] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 15:36:30 2022] GET /compute/v2.1/os-volumes/5d5898f9-9c02-4752-813a-c1f909f9726a => generated 351 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:31.045741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-838765cd-a0b1-40c9-9780-cb032f8de413 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Calling method '.version_select at 0x7f357d51b9d0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:31.439905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-838765cd-a0b1-40c9-9780-cb032f8de413 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] HTTP exception thrown: Volume bf3cacd4-119d-4b90-8a2c-d92ff7b17339 could not be found. Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-838765cd-a0b1-40c9-9780-cb032f8de413 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Request method failure captured: Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/os-volumes/bf3cacd4-119d-4b90-8a2c-d92ff7b17339 HTTP/1.1 Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0Df7EJ1jGSVWQrGsK6kxoC2CLoOa97lhIaLiQYGoHprcYH7qzRAe02G4VRyt8naxyb3q2a4FJ7F7ggb4Ygfb0pun5aqg7G0sPxlhEHwWdHM4Z2XSRBi5LXNXhpFcZ0GnIj_POw0QY3yqyajmc8toYmbcAirDcGCDdEq9ipbZxdQxT-E Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 5172d2ae5b244afd99f04b3cd6e056d0 Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:36:31.442172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/5172d2ae5b244afd99f04b3cd6e056d0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 5172d2ae5b244afd99f04b3cd6e056d0 Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-VolumesNegativeTest-1780807723 Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-VolumesNegativeTest-1780807723-project Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 30ffdf00311048a6a47d142e5231119d Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-VolumesNegativeTest-1780807723-project Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Volume bf3cacd4-119d-4b90-8a2c-d92ff7b17339 could not be found. Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'bf3cacd4-119d-4b90-8a2c-d92ff7b17339'} Jul 14 15:36:31.443423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume bf3cacd4-119d-4b90-8a2c-d92ff7b17339 could not be found. (HTTP 404) (Request-ID: req-e2f48345-d621-4fae-93c8-123e0d57e694) Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:31.444525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:36:31.445553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume bf3cacd4-119d-4b90-8a2c-d92ff7b17339 could not be found. Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 15:36:31.446443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume bf3cacd4-119d-4b90-8a2c-d92ff7b17339 could not be found. Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume bf3cacd4-119d-4b90-8a2c-d92ff7b17339 could not be found. Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-838765cd-a0b1-40c9-9780-cb032f8de413 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] Returning 404 to user: Volume bf3cacd4-119d-4b90-8a2c-d92ff7b17339 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-838765cd-a0b1-40c9-9780-cb032f8de413 tempest-VolumesNegativeTest-1780807723 tempest-VolumesNegativeTest-1780807723-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/bf3cacd4-119d-4b90-8a2c-d92ff7b17339" status: 404 len: 109 microversion: 2.1 time: 0.402331 Jul 14 15:36:31.447370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 9/9] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 15:36:31 2022] GET /compute/v2.1/os-volumes/bf3cacd4-119d-4b90-8a2c-d92ff7b17339 => generated 109 bytes in 404 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:36:31.524283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c9f0d2ec-fbf8-45f8-acbe-8a22c488fc63 tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 3.130376 Jul 14 15:36:31.525287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1/10] 10.222.0.99 () {60 vars in 1155 bytes} [Thu Jul 14 15:36:28 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 3133 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 15:36:31.537244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9e09c010-3e83-401f-8fbc-8bfd141988f7 tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] Calling method '.version_select at 0x7f357d51b310>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:31.666337 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9e09c010-3e83-401f-8fbc-8bfd141988f7 tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2" status: 200 len: 353 microversion: 2.1 time: 0.130674 Jul 14 15:36:31.667820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 10/11] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 15:36:31 2022] GET /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2 => generated 353 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:32.680179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-03aca31e-a9db-4cf3-a1a7-8e9d2860cd21 tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] Calling method '.version_select at 0x7f357d580af0>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:32.792812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8054b1ee-a4ad-44d8-befb-b4ca5f95e71c tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] Calling method '.version_select at 0x7f357d4bc160>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:33.138086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-03aca31e-a9db-4cf3-a1a7-8e9d2860cd21 tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2" status: 200 len: 354 microversion: 2.1 time: 0.458687 Jul 14 15:36:33.141646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 2/12] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 15:36:32 2022] GET /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2 => generated 354 bytes in 466 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:33.153954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f05ce926-7f08-455e-b13f-0b76c57c53c6 tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] Calling method '.version_select at 0x7f357d580c10>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:33.176844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8054b1ee-a4ad-44d8-befb-b4ca5f95e71c tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/c8f99f80-54a5-4df6-bedd-aca647147d41" status: 200 len: 350 microversion: 2.1 time: 0.387773 Jul 14 15:36:33.183132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 11/13] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 15:36:32 2022] GET /compute/v2.1/os-volumes/c8f99f80-54a5-4df6-bedd-aca647147d41 => generated 350 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:33.324724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f05ce926-7f08-455e-b13f-0b76c57c53c6 tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2" status: 200 len: 354 microversion: 2.1 time: 0.175604 Jul 14 15:36:33.337052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 3/14] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 15:36:33 2022] GET /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2 => generated 354 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:33.341847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fdab255d-a1d6-4ef5-9926-b54595f7b12a tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] Calling method '.version_select at 0x7f357d4bc8b0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:33.475855 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fdab255d-a1d6-4ef5-9926-b54595f7b12a tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2" status: 202 len: 0 microversion: 2.1 time: 0.137730 Jul 14 15:36:33.477270 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 12/15] 10.222.0.99 () {58 vars in 1247 bytes} [Thu Jul 14 15:36:33 2022] DELETE /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2 => generated 0 bytes in 140 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:36:33.488820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4953f9d1-6263-4686-b877-b78773113205 tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] Calling method '.version_select at 0x7f357d59a280>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:33.580552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4953f9d1-6263-4686-b877-b78773113205 tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2" status: 200 len: 353 microversion: 2.1 time: 0.098011 Jul 14 15:36:33.581191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 4/16] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 15:36:33 2022] GET /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2 => generated 353 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:34.602850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-39a16ee4-f999-44f5-8b9d-9a18c5f0d8ff tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] Calling method '.version_select at 0x7f357d4ff430>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:34.672787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-39a16ee4-f999-44f5-8b9d-9a18c5f0d8ff tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] HTTP exception thrown: Volume d4285e06-765f-4dfc-a644-00e5e05d86a2 could not be found. Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-39a16ee4-f999-44f5-8b9d-9a18c5f0d8ff tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] Request method failure captured: Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2 HTTP/1.1 Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0Df81fb_4tuV0L0IvCBn9xXRfLaTe1N29PtahQc-amOj3yGJ-W3YwMsvAdzHEJo2OgXQVj-Xlz6zrPZlDIX4E4Xe9vaQZ95uJaKAZISBtaMU__-fD-aa7lgQwic4xI-c6Sf8UN7wl7Q6nDwM7J40Q6dDZDhDvqJiRnnKdROG6FHwHYQ Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 9d2c9c1fb5054eeb9c45eeebda004ff2 Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-VolumesGetTestJSON-91890595 Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:36:34.675526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_9d2c9c1fb5054eeb9c45eeebda004ff2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d2c9c1fb5054eeb9c45eeebda004ff2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/9d2c9c1fb5054eeb9c45eeebda004ff2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/9d2c9c1fb5054eeb9c45eeebda004ff2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-VolumesGetTestJSON-91890595 Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 9d2c9c1fb5054eeb9c45eeebda004ff2 Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-VolumesGetTestJSON-91890595 Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-VolumesGetTestJSON-91890595-project Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 59d957e121f54219b36f26ec7e023684 Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-VolumesGetTestJSON-91890595-project Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Volume d4285e06-765f-4dfc-a644-00e5e05d86a2 could not be found. Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'd4285e06-765f-4dfc-a644-00e5e05d86a2'} Jul 14 15:36:34.676795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d4285e06-765f-4dfc-a644-00e5e05d86a2 could not be found. (HTTP 404) (Request-ID: req-fcd7b31a-bb30-42f9-bffe-028f530ea0e8) Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:34.677555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 15:36:34.678591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d4285e06-765f-4dfc-a644-00e5e05d86a2 could not be found. Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 15:36:34.679790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:36:34.680868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d4285e06-765f-4dfc-a644-00e5e05d86a2 could not be found. Jul 14 15:36:34.680868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:34.680868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:36:34.680868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:34.680868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:36:34.680868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:36:34.680868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:36:34.680868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:36:34.680868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:36:34.680868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d4285e06-765f-4dfc-a644-00e5e05d86a2 could not be found. Jul 14 15:36:34.680868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:36:34.682287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-39a16ee4-f999-44f5-8b9d-9a18c5f0d8ff tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] Returning 404 to user: Volume d4285e06-765f-4dfc-a644-00e5e05d86a2 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:36:34.683303 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-39a16ee4-f999-44f5-8b9d-9a18c5f0d8ff tempest-VolumesGetTestJSON-91890595 tempest-VolumesGetTestJSON-91890595-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2" status: 404 len: 109 microversion: 2.1 time: 0.090219 Jul 14 15:36:34.684378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 13/17] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 15:36:34 2022] GET /compute/v2.1/os-volumes/d4285e06-765f-4dfc-a644-00e5e05d86a2 => generated 109 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:36:34.855179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-143a57b1-1500-41c4-be29-d2c1506e1df9 tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] Calling method '.version_select at 0x7f357d59a940>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:35.028177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-143a57b1-1500-41c4-be29-d2c1506e1df9 tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/50f2fbd3-d93b-4503-b10b-7fd83e29ebae" status: 200 len: 351 microversion: 2.1 time: 0.197291 Jul 14 15:36:35.028732 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 5/18] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 15:36:34 2022] GET /compute/v2.1/os-volumes/50f2fbd3-d93b-4503-b10b-7fd83e29ebae => generated 351 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:35.045792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-658e8adb-6b5b-4815-81d9-f72fbf2e2cc6 tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] Calling method '.version_select at 0x7f357d51b1f0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:35.201819 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-658e8adb-6b5b-4815-81d9-f72fbf2e2cc6 tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] 10.222.0.99 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.164492 Jul 14 15:36:35.204014 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 14/19] 10.222.0.99 () {58 vars in 1133 bytes} [Thu Jul 14 15:36:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:35.217886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4a35a52d-ee2c-4932-bf93-a35a8b83f2d6 tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] Calling method '.version_select at 0x7f357d59ac10>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:35.442149 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4a35a52d-ee2c-4932-bf93-a35a8b83f2d6 tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] 10.222.0.99 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.228427 Jul 14 15:36:35.443083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 6/20] 10.222.0.99 () {58 vars in 1148 bytes} [Thu Jul 14 15:36:35 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:35.456602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a810ae30-3be9-4cbd-a883-f460f003f869 tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] Calling method '.version_select at 0x7f357d51bdc0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:35.619235 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a810ae30-3be9-4cbd-a883-f460f003f869 tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] 10.222.0.99 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.167819 Jul 14 15:36:35.627908 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 15/21] 10.222.0.99 () {58 vars in 1133 bytes} [Thu Jul 14 15:36:35 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:35.644234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-13323b99-30ab-48cf-8378-9c2fba212ed3 tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] Calling method '.version_select at 0x7f357d6185e0>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:35.825222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-13323b99-30ab-48cf-8378-9c2fba212ed3 tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] 10.222.0.99 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.196195 Jul 14 15:36:35.826017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 7/22] 10.222.0.99 () {58 vars in 1166 bytes} [Thu Jul 14 15:36:35 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:36:35.840161 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-eafe3f23-1e5b-4d0c-a12c-fa36d8168e0c tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] Calling method '.version_select at 0x7f357d4ff9d0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:36.053799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-eafe3f23-1e5b-4d0c-a12c-fa36d8168e0c tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.217747 Jul 14 15:36:36.054669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 16/23] 10.222.0.99 () {58 vars in 1169 bytes} [Thu Jul 14 15:36:35 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:36.068390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fa5cbc2c-1d0f-4974-b218-05c2d740e6ce tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] Calling method '.version_select at 0x7f357d5e5700>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:36.326446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fa5cbc2c-1d0f-4974-b218-05c2d740e6ce tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.262054 Jul 14 15:36:36.327428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 17/24] 10.222.0.99 () {58 vars in 1154 bytes} [Thu Jul 14 15:36:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:36.339665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a319e198-6917-45b5-8b6d-c9ef9332792b tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] Calling method '.version_select at 0x7f357d5e5430>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:36.560724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a319e198-6917-45b5-8b6d-c9ef9332792b tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.224828 Jul 14 15:36:36.561624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 18/25] 10.222.0.99 () {58 vars in 1187 bytes} [Thu Jul 14 15:36:36 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:36:36.574338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7ab4e59c-be97-44d0-ae96-4b413b23c2a5 tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] Calling method '.version_select at 0x7f357d4ff430>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:36.631802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1690033415", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "networks": [{"uuid": "1faf04dd-570a-410d-a629-9b348e97fb74"}]}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:36.726337 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7ab4e59c-be97-44d0-ae96-4b413b23c2a5 tempest-VolumesTestJSON-1458322541 tempest-VolumesTestJSON-1458322541-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.156659 Jul 14 15:36:36.727563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 19/26] 10.222.0.99 () {58 vars in 1154 bytes} [Thu Jul 14 15:36:36 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:36:36.865552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.network.neutron [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] validate_networks() for [('1faf04dd-570a-410d-a629-9b348e97fb74', None, None, None, None, None)] {{(pid=124503) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:36:40.086732 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Flavor limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:36:40.089135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Image limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:36:40.092546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Flavor pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:36:40.094356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Image pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:36:40.095009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:36:40.142483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:40.143236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:40.144244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:40.144896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:40.237259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Getting quotas for project b9490b542a1f4c78aef9015ecb97dabd. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:36:40.250276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Getting quotas for user 3db7ba60a24747efb55601b6e2401983 and project b9490b542a1f4c78aef9015ecb97dabd. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:36:40.279084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Going to run 1 instances... {{(pid=124503) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:36:40.282526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124503) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:36:40.460070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1f69df5e-b488-43b5-8583-d7f2969d58be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 4.502985 Jul 14 15:36:40.461555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 8/27] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 15:36:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 4505 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:36:40.473768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-50fa8000-eefa-43e8-affb-91d8720f3c48 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:40.474620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-50fa8000-eefa-43e8-affb-91d8720f3c48 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:40.958029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-50fa8000-eefa-43e8-affb-91d8720f3c48 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:41.007327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-50fa8000-eefa-43e8-affb-91d8720f3c48 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1215 microversion: 2.1 time: 0.534439 Jul 14 15:36:41.036943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 20/28] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:40 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1215 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:42.045871 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e738c447-1868-4de8-ac9b-f59c0129f513 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:42.048206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e738c447-1868-4de8-ac9b-f59c0129f513 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:42.560786 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e738c447-1868-4de8-ac9b-f59c0129f513 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:42.583232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e738c447-1868-4de8-ac9b-f59c0129f513 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1215 microversion: 2.1 time: 0.541748 Jul 14 15:36:42.583869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 9/29] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:42 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1215 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:43.544874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b57f39e1-9478-4aeb-b099-15967109ef03 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Action: 'create', calling method: .version_select at 0x7f357d5e54c0>, body: {"keypair": {"name": "tempest-keypair-782876498", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBG3Fb2woaLX8sPRLZ99qxCoQYRVE5/yZBimIjz+OY2vSr7nTPo1vDzitJhW3f0s1oF8QPu7y/4Yvva/SdZVO14aaDobHVXb6FMCiXyHXyPx1P2ihA3mTf7v3sHop9GtI7Q=="}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:43.603508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0c46fe24-f1e0-43ba-8a83-8863505200a2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:43.604293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0c46fe24-f1e0-43ba-8a83-8863505200a2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:43.622239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0c46fe24-f1e0-43ba-8a83-8863505200a2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:43.622695 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0c46fe24-f1e0-43ba-8a83-8863505200a2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:43.648905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0c46fe24-f1e0-43ba-8a83-8863505200a2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:43.649286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0c46fe24-f1e0-43ba-8a83-8863505200a2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:43.656619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-b57f39e1-9478-4aeb-b099-15967109ef03 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Getting quotas for project 636b923a8a58435484086dc8394ccc23. Resources: {'key_pairs'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:36:43.676362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-b57f39e1-9478-4aeb-b099-15967109ef03 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Getting quotas for user 781567471d0f4ca4add4331d405febd4 and project 636b923a8a58435484086dc8394ccc23. Resources: {'key_pairs'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:36:43.795466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b57f39e1-9478-4aeb-b099-15967109ef03 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.703889 Jul 14 15:36:43.798003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 21/30] 10.222.0.99 () {62 vars in 1199 bytes} [Thu Jul 14 15:36:43 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 710 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jul 14 15:36:44.243380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0c46fe24-f1e0-43ba-8a83-8863505200a2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:44.260947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0c46fe24-f1e0-43ba-8a83-8863505200a2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1267 microversion: 2.1 time: 0.661169 Jul 14 15:36:44.269362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 10/31] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:43 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1267 bytes in 669 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:36:45.163265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2094624158", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:45.281795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-52eb943c-a45c-48fc-b7a9-69506be2a83a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:45.282486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-52eb943c-a45c-48fc-b7a9-69506be2a83a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:45.301468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52eb943c-a45c-48fc-b7a9-69506be2a83a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:45.302657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52eb943c-a45c-48fc-b7a9-69506be2a83a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:45.304168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52eb943c-a45c-48fc-b7a9-69506be2a83a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:45.306499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52eb943c-a45c-48fc-b7a9-69506be2a83a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:45.388094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.network.neutron [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] validate_networks() for [('dae89fa7-f52a-48c3-941f-a22cec0d55f2', None, None, None, None, None)] {{(pid=124502) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:36:45.521055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-52eb943c-a45c-48fc-b7a9-69506be2a83a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:45.578756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-52eb943c-a45c-48fc-b7a9-69506be2a83a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1273 microversion: 2.1 time: 0.301744 Jul 14 15:36:45.579490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 11/32] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:45 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1273 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:46.603868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1f5b2ae0-841a-4b4b-960e-949088b0348d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:46.605525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1f5b2ae0-841a-4b4b-960e-949088b0348d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:46.629558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f5b2ae0-841a-4b4b-960e-949088b0348d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:46.631988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f5b2ae0-841a-4b4b-960e-949088b0348d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:46.634528 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f5b2ae0-841a-4b4b-960e-949088b0348d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:46.636549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f5b2ae0-841a-4b4b-960e-949088b0348d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:46.821080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1f5b2ae0-841a-4b4b-960e-949088b0348d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:46.829291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1f5b2ae0-841a-4b4b-960e-949088b0348d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1273 microversion: 2.1 time: 0.235050 Jul 14 15:36:46.833036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 12/33] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:46 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1273 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:36:47.850347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4edd2d5c-800e-4c2e-b539-30ffc006e060 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:47.850962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4edd2d5c-800e-4c2e-b539-30ffc006e060 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:47.876407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4edd2d5c-800e-4c2e-b539-30ffc006e060 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:47.877304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4edd2d5c-800e-4c2e-b539-30ffc006e060 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:47.878332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4edd2d5c-800e-4c2e-b539-30ffc006e060 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:47.879843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4edd2d5c-800e-4c2e-b539-30ffc006e060 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:48.130669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4edd2d5c-800e-4c2e-b539-30ffc006e060 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:48.139030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4edd2d5c-800e-4c2e-b539-30ffc006e060 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1273 microversion: 2.1 time: 0.292460 Jul 14 15:36:48.139629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 13/34] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:47 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1273 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:36:48.310981 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Flavor limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:36:48.314986 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Image limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:36:48.316037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Flavor pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:36:48.316794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Image pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:36:48.317883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:36:48.360049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:48.363341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:48.367262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:48.370031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:48.500597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Getting quotas for project 2a542b3ba16943a4ab7d2624d961b4a5. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:36:48.521044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Getting quotas for user d01c301ea20d4acab8dff1148501a975 and project 2a542b3ba16943a4ab7d2624d961b4a5. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:36:48.614252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Going to run 1 instances... {{(pid=124502) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:36:48.622676 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124502) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:36:48.805043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d2b6143f-a3b5-4754-8bf6-10016aee9af0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.226084 Jul 14 15:36:48.805695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 22/35] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 15:36:44 2022] POST /compute/v2.1/servers => generated 383 bytes in 4228 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:36:48.817225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f6ad9d27-ce88-4ecc-a6d8-ff249e6064a8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:48.818108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f6ad9d27-ce88-4ecc-a6d8-ff249e6064a8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:49.164061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7e1defd8-11ce-439f-bf07-9ec07ef5f47d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:49.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7e1defd8-11ce-439f-bf07-9ec07ef5f47d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:49.203477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e1defd8-11ce-439f-bf07-9ec07ef5f47d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:49.209777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f6ad9d27-ce88-4ecc-a6d8-ff249e6064a8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:49.218301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f6ad9d27-ce88-4ecc-a6d8-ff249e6064a8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1222 microversion: 2.1 time: 0.405364 Jul 14 15:36:49.223925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 14/36] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:48 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1222 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:49.238329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e1defd8-11ce-439f-bf07-9ec07ef5f47d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.044s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:49.239193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e1defd8-11ce-439f-bf07-9ec07ef5f47d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:49.246129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e1defd8-11ce-439f-bf07-9ec07ef5f47d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:49.800205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-382947040", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:50.028432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.network.neutron [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] validate_networks() for [('dae89fa7-f52a-48c3-941f-a22cec0d55f2', None, None, None, None, None)] {{(pid=124503) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:36:50.176487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:50.308534 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7e1defd8-11ce-439f-bf07-9ec07ef5f47d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:50.383482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7e1defd8-11ce-439f-bf07-9ec07ef5f47d tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 1.229894 Jul 14 15:36:50.384417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 23/37] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:49 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 1232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:51.904147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7c3d45b1-5baa-4e13-9d11-7eac76616f64 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Action: 'create', calling method: .version_select at 0x7f357c2f2790>, body: {"keypair": {"name": "tempest-keypair-1544239903", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPmHsuocoY7T760A9xMOBk+EzYkZaG8lXnW6+0H8jKp/y0YIdWr2A+xz6mdA5nQ2FLx1GXS/qqyRSuI1api0XfhSp+CxGQQT6qivg9ne9A1P8zTVASAbThLBikX+Dh8lzQ=="}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:51.975499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-7c3d45b1-5baa-4e13-9d11-7eac76616f64 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Getting quotas for project 67ea0d1ef31b495b8dad23f39cedf1bf. Resources: {'key_pairs'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:36:51.995850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-7c3d45b1-5baa-4e13-9d11-7eac76616f64 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Getting quotas for user 46f52ad195a34123982d238ea351172d and project 67ea0d1ef31b495b8dad23f39cedf1bf. Resources: {'key_pairs'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:36:52.116970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7c3d45b1-5baa-4e13-9d11-7eac76616f64 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.463298 Jul 14 15:36:52.133160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 24/38] 10.222.0.99 () {60 vars in 1158 bytes} [Thu Jul 14 15:36:50 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1479 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:36:52.143216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bf64e3f9-18c4-424b-bef7-78bc2530b3f8 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:52.145129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bf64e3f9-18c4-424b-bef7-78bc2530b3f8 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:52.167134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf64e3f9-18c4-424b-bef7-78bc2530b3f8 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:52.172356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf64e3f9-18c4-424b-bef7-78bc2530b3f8 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:52.173476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf64e3f9-18c4-424b-bef7-78bc2530b3f8 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:52.175896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf64e3f9-18c4-424b-bef7-78bc2530b3f8 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:54.048800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Flavor limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:36:54.049278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Image limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:36:54.049727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Flavor pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:36:54.050142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Image pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:36:54.050761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:36:54.082082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:54.084912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:54.090843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:54.091674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:54.223109 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Getting quotas for project 2a542b3ba16943a4ab7d2624d961b4a5. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:36:54.229186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Getting quotas for user d01c301ea20d4acab8dff1148501a975 and project 2a542b3ba16943a4ab7d2624d961b4a5. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:36:54.259417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Going to run 1 instances... {{(pid=124503) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:36:54.261612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124503) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:36:54.414084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e47dabe-7666-4b65-a66a-e0b76a58d73c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.617994 Jul 14 15:36:54.424956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 15/39] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 15:36:49 2022] POST /compute/v2.1/servers => generated 383 bytes in 4632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:36:54.442960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-32181ace-50ac-4d0e-9ce5-75a358865552 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:54.446523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-32181ace-50ac-4d0e-9ce5-75a358865552 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:54.803911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bf64e3f9-18c4-424b-bef7-78bc2530b3f8 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:54.812937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bf64e3f9-18c4-424b-bef7-78bc2530b3f8 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 2.677673 Jul 14 15:36:54.813542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 25/40] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:52 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 2680 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:55.019462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-32181ace-50ac-4d0e-9ce5-75a358865552 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:55.032717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-32181ace-50ac-4d0e-9ce5-75a358865552 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1221 microversion: 2.1 time: 0.606126 Jul 14 15:36:55.033248 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 16/41] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:54 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1221 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:55.830899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-edeaaa48-cab3-4c5e-a927-8aba803dae9b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:55.831665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-edeaaa48-cab3-4c5e-a927-8aba803dae9b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:55.841674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-edeaaa48-cab3-4c5e-a927-8aba803dae9b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:55.846417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-edeaaa48-cab3-4c5e-a927-8aba803dae9b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:55.848640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-edeaaa48-cab3-4c5e-a927-8aba803dae9b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:55.849308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-edeaaa48-cab3-4c5e-a927-8aba803dae9b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:56.052614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dcb11d05-b02c-4a2b-9e90-307085bf18cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:56.054206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dcb11d05-b02c-4a2b-9e90-307085bf18cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:56.080480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dcb11d05-b02c-4a2b-9e90-307085bf18cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:56.080939 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dcb11d05-b02c-4a2b-9e90-307085bf18cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:56.081721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dcb11d05-b02c-4a2b-9e90-307085bf18cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:56.087483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dcb11d05-b02c-4a2b-9e90-307085bf18cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:56.574106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dcb11d05-b02c-4a2b-9e90-307085bf18cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:56.589924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dcb11d05-b02c-4a2b-9e90-307085bf18cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1225 microversion: 2.1 time: 0.535063 Jul 14 15:36:56.592769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 17/42] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:56 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1225 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:56.618191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-531348108", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5937a23f-e004-4882-8a0a-065fcac79e3e"}], "security_groups": [{"name": "tempest-securitygroup--617436895"}], "key_name": "tempest-keypair-782876498", "user_data": "}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:57.206050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.network.neutron [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] validate_networks() for [('5937a23f-e004-4882-8a0a-065fcac79e3e', None, None, None, None, None)] {{(pid=124503) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:36:57.939667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-edeaaa48-cab3-4c5e-a927-8aba803dae9b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:57.965903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-edeaaa48-cab3-4c5e-a927-8aba803dae9b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 2.131137 Jul 14 15:36:57.966576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 26/43] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:55 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 2141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:58.416093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:58.585217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-b024c442-0ed3-4021-acc1-6fff2c81cb4a req-9902cf75-5bd5-4ef7-9adb-692dc6bb2bfb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac", "tag": "6c2e9773-4369-4a54-ae35-882ccbb7222a"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:36:58.648111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-b024c442-0ed3-4021-acc1-6fff2c81cb4a req-9902cf75-5bd5-4ef7-9adb-692dc6bb2bfb service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:58.648697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-b024c442-0ed3-4021-acc1-6fff2c81cb4a req-9902cf75-5bd5-4ef7-9adb-692dc6bb2bfb service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:58.665861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=6 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:36:58.746560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-b024c442-0ed3-4021-acc1-6fff2c81cb4a req-9902cf75-5bd5-4ef7-9adb-692dc6bb2bfb service nova] Creating event network-changed:6c2e9773-4369-4a54-ae35-882ccbb7222a for instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac on hv-cinder-82651 Jul 14 15:36:58.750744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-b024c442-0ed3-4021-acc1-6fff2c81cb4a req-9902cf75-5bd5-4ef7-9adb-692dc6bb2bfb service nova] Acquired lock "compute-rpcapi-router" {{(pid=124502) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 15:36:58.753097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8a5f5c4-7ed3-4ef9-85e8-9789c51ea512 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:58.764201 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8a5f5c4-7ed3-4ef9-85e8-9789c51ea512 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:58.775345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8a5f5c4-7ed3-4ef9-85e8-9789c51ea512 None None] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:58.776484 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8a5f5c4-7ed3-4ef9-85e8-9789c51ea512 None None] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:58.804469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.compute.rpcapi [None req-d8a5f5c4-7ed3-4ef9-85e8-9789c51ea512 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 15:36:58.806326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8a5f5c4-7ed3-4ef9-85e8-9789c51ea512 None None] Releasing lock "compute-rpcapi-router" {{(pid=124502) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 15:36:58.853546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d8a5f5c4-7ed3-4ef9-85e8-9789c51ea512 None None] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.885365 Jul 14 15:36:58.854700 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 27/44] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:36:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 887 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:36:58.866126 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-61cbb9cb-db53-40d0-b2d2-cf8f404001d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:58.867148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-61cbb9cb-db53-40d0-b2d2-cf8f404001d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:58.883064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-61cbb9cb-db53-40d0-b2d2-cf8f404001d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:58.884305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-61cbb9cb-db53-40d0-b2d2-cf8f404001d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:58.886423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-61cbb9cb-db53-40d0-b2d2-cf8f404001d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:58.889283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-61cbb9cb-db53-40d0-b2d2-cf8f404001d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:59.194035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-61cbb9cb-db53-40d0-b2d2-cf8f404001d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:36:59.224844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-61cbb9cb-db53-40d0-b2d2-cf8f404001d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1279 microversion: 2.1 time: 0.368611 Jul 14 15:36:59.225966 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 28/45] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:58 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1279 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:36:59.257506 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ea80e8a0-b522-4a15-8233-cb5f3fdfb2df tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:36:59.261110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ea80e8a0-b522-4a15-8233-cb5f3fdfb2df tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:36:59.285911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea80e8a0-b522-4a15-8233-cb5f3fdfb2df tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:59.286417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea80e8a0-b522-4a15-8233-cb5f3fdfb2df tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:36:59.287255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea80e8a0-b522-4a15-8233-cb5f3fdfb2df tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:36:59.287736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea80e8a0-b522-4a15-8233-cb5f3fdfb2df tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:00.102092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ea80e8a0-b522-4a15-8233-cb5f3fdfb2df tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:00.112605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ea80e8a0-b522-4a15-8233-cb5f3fdfb2df tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.882341 Jul 14 15:37:00.118066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 29/46] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:36:59 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 888 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:00.244568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f01d4587-a744-4915-889b-5cac5a93c84b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:00.245255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f01d4587-a744-4915-889b-5cac5a93c84b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:00.255456 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f01d4587-a744-4915-889b-5cac5a93c84b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:00.259180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f01d4587-a744-4915-889b-5cac5a93c84b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:00.262339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f01d4587-a744-4915-889b-5cac5a93c84b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:00.263028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f01d4587-a744-4915-889b-5cac5a93c84b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:00.394321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Flavor limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:37:00.397592 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Image limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:37:00.398565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Flavor pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:37:00.399185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Image pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:37:00.399987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:37:00.431645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:00.435032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:00.436120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:00.440250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:00.516499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Getting quotas for project 636b923a8a58435484086dc8394ccc23. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:37:00.537443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Getting quotas for user 781567471d0f4ca4add4331d405febd4 and project 636b923a8a58435484086dc8394ccc23. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:37:00.569106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Going to run 1 instances... {{(pid=124503) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:37:00.575937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124503) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:37:00.647938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f01d4587-a744-4915-889b-5cac5a93c84b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:00.660003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f01d4587-a744-4915-889b-5cac5a93c84b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1279 microversion: 2.1 time: 0.418452 Jul 14 15:37:00.660618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 30/47] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:00 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1279 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:00.777839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0e4fdfb4-e714-4d32-84df-c5449529fffa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 4.183800 Jul 14 15:37:00.778427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 18/48] 10.222.0.99 () {62 vars in 1187 bytes} [Thu Jul 14 15:36:56 2022] POST /compute/v2.1/servers => generated 401 bytes in 4185 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jul 14 15:37:00.790185 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c471dcfe-7088-4b0d-9186-28853cd9911c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:00.790930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c471dcfe-7088-4b0d-9186-28853cd9911c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:01.131897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e5f76076-7de1-4e45-897e-fafa25620a11 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:01.132398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e5f76076-7de1-4e45-897e-fafa25620a11 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:01.143698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e5f76076-7de1-4e45-897e-fafa25620a11 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:01.144187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e5f76076-7de1-4e45-897e-fafa25620a11 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:01.144934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e5f76076-7de1-4e45-897e-fafa25620a11 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:01.145376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e5f76076-7de1-4e45-897e-fafa25620a11 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:01.927227 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e5f76076-7de1-4e45-897e-fafa25620a11 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:01.949409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e5f76076-7de1-4e45-897e-fafa25620a11 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.822124 Jul 14 15:37:01.959143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 19/49] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:01 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:01.986003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-19cd79ed-9e65-4370-b6aa-97be63363d72 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:01.993558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-19cd79ed-9e65-4370-b6aa-97be63363d72 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:02.008012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-19cd79ed-9e65-4370-b6aa-97be63363d72 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:02.018707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-19cd79ed-9e65-4370-b6aa-97be63363d72 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:02.023486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-19cd79ed-9e65-4370-b6aa-97be63363d72 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:02.026503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-19cd79ed-9e65-4370-b6aa-97be63363d72 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:02.041967 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=16 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:02.094890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c471dcfe-7088-4b0d-9186-28853cd9911c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:02.105222 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c471dcfe-7088-4b0d-9186-28853cd9911c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:02.115333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c471dcfe-7088-4b0d-9186-28853cd9911c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:02.117528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c471dcfe-7088-4b0d-9186-28853cd9911c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1280 microversion: 2.20 time: 1.330989 Jul 14 15:37:02.118938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 31/50] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:00 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1280 bytes in 1333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:02.253674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-19cd79ed-9e65-4370-b6aa-97be63363d72 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:02.273577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-19cd79ed-9e65-4370-b6aa-97be63363d72 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1279 microversion: 2.1 time: 0.310812 Jul 14 15:37:02.274968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 20/51] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:01 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1279 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:02.976640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a63b8faa-af0c-4b91-abb0-0ddfdbf7d45b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:02.977399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a63b8faa-af0c-4b91-abb0-0ddfdbf7d45b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:03.003827 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a63b8faa-af0c-4b91-abb0-0ddfdbf7d45b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:03.004504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a63b8faa-af0c-4b91-abb0-0ddfdbf7d45b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:03.005529 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a63b8faa-af0c-4b91-abb0-0ddfdbf7d45b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:03.007122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a63b8faa-af0c-4b91-abb0-0ddfdbf7d45b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:03.136235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3fafd32b-ba9a-446f-ae23-e66492c8b578 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:03.136669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3fafd32b-ba9a-446f-ae23-e66492c8b578 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:03.164214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3fafd32b-ba9a-446f-ae23-e66492c8b578 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:03.164682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3fafd32b-ba9a-446f-ae23-e66492c8b578 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:03.169427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3fafd32b-ba9a-446f-ae23-e66492c8b578 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:03.172074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3fafd32b-ba9a-446f-ae23-e66492c8b578 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:03.497247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a63b8faa-af0c-4b91-abb0-0ddfdbf7d45b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:03.511257 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a63b8faa-af0c-4b91-abb0-0ddfdbf7d45b tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.534616 Jul 14 15:37:03.513967 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 32/52] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:02 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 544 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:03.525696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7c1872c9-2af1-4185-bd54-87a149be21e0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:03.526641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7c1872c9-2af1-4185-bd54-87a149be21e0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:03.547100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3fafd32b-ba9a-446f-ae23-e66492c8b578 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:03.548589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c1872c9-2af1-4185-bd54-87a149be21e0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:03.551267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c1872c9-2af1-4185-bd54-87a149be21e0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:03.552359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c1872c9-2af1-4185-bd54-87a149be21e0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:03.555928 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c1872c9-2af1-4185-bd54-87a149be21e0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:03.559771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3fafd32b-ba9a-446f-ae23-e66492c8b578 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:03.568875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3fafd32b-ba9a-446f-ae23-e66492c8b578 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:03.573442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3fafd32b-ba9a-446f-ae23-e66492c8b578 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1276 microversion: 2.20 time: 0.441423 Jul 14 15:37:03.575794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 21/53] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1276 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:03.768566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1786327182", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c48309c-ba99-490f-9743-fd4ada15ac8c"}], "security_groups": [{"name": "tempest-securitygroup--255274630"}], "key_name": "tempest-keypair-1544239903", "user_data": "}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:03.945608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.network.neutron [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] validate_networks() for [('2c48309c-ba99-490f-9743-fd4ada15ac8c', None, None, None, None, None)] {{(pid=124503) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:37:03.958339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7c1872c9-2af1-4185-bd54-87a149be21e0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:03.967920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7c1872c9-2af1-4185-bd54-87a149be21e0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.447108 Jul 14 15:37:03.972479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 33/54] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:03 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 453 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:04.122262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-69b0cd5a-486a-4918-ac68-9fbeb022f662 req-fa7c4b05-6265-4c94-a6a6-9e1b890ff530 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "15c97816-6d05-424a-832a-48500a73d87f", "tag": "ef1ba542-f905-48ed-ae96-28d22e39407f"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:04.138145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-69b0cd5a-486a-4918-ac68-9fbeb022f662 req-fa7c4b05-6265-4c94-a6a6-9e1b890ff530 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:04.139998 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-69b0cd5a-486a-4918-ac68-9fbeb022f662 req-fa7c4b05-6265-4c94-a6a6-9e1b890ff530 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:04.167193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-69b0cd5a-486a-4918-ac68-9fbeb022f662 req-fa7c4b05-6265-4c94-a6a6-9e1b890ff530 service nova] Creating event network-changed:ef1ba542-f905-48ed-ae96-28d22e39407f for instance 15c97816-6d05-424a-832a-48500a73d87f on hv-cinder-82651 Jul 14 15:37:04.181426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-69b0cd5a-486a-4918-ac68-9fbeb022f662 req-fa7c4b05-6265-4c94-a6a6-9e1b890ff530 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064044 Jul 14 15:37:04.184802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 34/55] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:04.534223 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-93449a65-7ef4-4c34-8d4c-2b1c91131e1a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:04.535095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-93449a65-7ef4-4c34-8d4c-2b1c91131e1a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:04.551513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93449a65-7ef4-4c34-8d4c-2b1c91131e1a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:04.553875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93449a65-7ef4-4c34-8d4c-2b1c91131e1a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:04.554670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93449a65-7ef4-4c34-8d4c-2b1c91131e1a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:04.555110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93449a65-7ef4-4c34-8d4c-2b1c91131e1a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:04.744894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Flavor limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:37:04.746172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Image limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:37:04.746804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Flavor pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:37:04.747377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Image pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:37:04.747991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:37:04.776485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:04.777352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:04.779076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:04.779895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:04.789859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-93449a65-7ef4-4c34-8d4c-2b1c91131e1a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:04.807731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Getting quotas for project 67ea0d1ef31b495b8dad23f39cedf1bf. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:37:04.812519 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Getting quotas for user 46f52ad195a34123982d238ea351172d and project 67ea0d1ef31b495b8dad23f39cedf1bf. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:37:04.814158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-93449a65-7ef4-4c34-8d4c-2b1c91131e1a tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.287343 Jul 14 15:37:04.820519 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 35/56] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:04 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:04.825529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Going to run 1 instances... {{(pid=124503) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:37:04.825883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2c6b6afe-9df9-41af-b39d-dc2f48e5ad49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:04.826502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2c6b6afe-9df9-41af-b39d-dc2f48e5ad49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:04.829108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124503) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:37:04.851809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2c6b6afe-9df9-41af-b39d-dc2f48e5ad49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:04.852433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2c6b6afe-9df9-41af-b39d-dc2f48e5ad49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:04.853230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2c6b6afe-9df9-41af-b39d-dc2f48e5ad49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:04.853810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2c6b6afe-9df9-41af-b39d-dc2f48e5ad49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:04.937918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5629e43d-f0dc-43c3-bcb5-b0a175a86b89 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.175335 Jul 14 15:37:04.939351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2c6b6afe-9df9-41af-b39d-dc2f48e5ad49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:04.944929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 22/57] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 15:37:03 2022] POST /compute/v2.1/servers => generated 401 bytes in 1183 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:37:04.955888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9335bf97-5d50-44fe-ab85-a7ced6a834a6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:04.956351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2c6b6afe-9df9-41af-b39d-dc2f48e5ad49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:04.958114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2c6b6afe-9df9-41af-b39d-dc2f48e5ad49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:04.958912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9335bf97-5d50-44fe-ab85-a7ced6a834a6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:04.959304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2c6b6afe-9df9-41af-b39d-dc2f48e5ad49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1276 microversion: 2.20 time: 0.137765 Jul 14 15:37:04.960218 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 36/58] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1276 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:05.019968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a4c7afa3-f8fa-455f-ac56-54f4bfaffa7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:05.022738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a4c7afa3-f8fa-455f-ac56-54f4bfaffa7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:05.029968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a4c7afa3-f8fa-455f-ac56-54f4bfaffa7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:05.035719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a4c7afa3-f8fa-455f-ac56-54f4bfaffa7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:05.036581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a4c7afa3-f8fa-455f-ac56-54f4bfaffa7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:05.037031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a4c7afa3-f8fa-455f-ac56-54f4bfaffa7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:05.104958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9335bf97-5d50-44fe-ab85-a7ced6a834a6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:05.114466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9335bf97-5d50-44fe-ab85-a7ced6a834a6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1238 microversion: 2.1 time: 0.163555 Jul 14 15:37:05.115260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 23/59] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:04 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1238 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:05.292274 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a4c7afa3-f8fa-455f-ac56-54f4bfaffa7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:05.307969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a4c7afa3-f8fa-455f-ac56-54f4bfaffa7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.322619 Jul 14 15:37:05.311230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 37/60] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:04 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:05.834361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-064c4589-b068-4490-94f0-90cb0bbeb2be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:05.835244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-064c4589-b068-4490-94f0-90cb0bbeb2be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:05.844984 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-064c4589-b068-4490-94f0-90cb0bbeb2be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:05.845739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-064c4589-b068-4490-94f0-90cb0bbeb2be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:05.846697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-064c4589-b068-4490-94f0-90cb0bbeb2be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:05.847285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-064c4589-b068-4490-94f0-90cb0bbeb2be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:05.977412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c436e878-af00-48dd-aa01-8e7fabf40eca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:05.978021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c436e878-af00-48dd-aa01-8e7fabf40eca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:05.987583 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c436e878-af00-48dd-aa01-8e7fabf40eca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:05.989816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c436e878-af00-48dd-aa01-8e7fabf40eca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:05.990564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c436e878-af00-48dd-aa01-8e7fabf40eca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:05.992865 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c436e878-af00-48dd-aa01-8e7fabf40eca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:06.085369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c436e878-af00-48dd-aa01-8e7fabf40eca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:06.095578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c436e878-af00-48dd-aa01-8e7fabf40eca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:06.097458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c436e878-af00-48dd-aa01-8e7fabf40eca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:06.098788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c436e878-af00-48dd-aa01-8e7fabf40eca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1276 microversion: 2.20 time: 0.125268 Jul 14 15:37:06.099883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 38/61] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:05 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1276 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:06.135327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-26b6e50e-7739-4339-9af4-a33e8d09fc63 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:06.136579 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-26b6e50e-7739-4339-9af4-a33e8d09fc63 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:06.146373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26b6e50e-7739-4339-9af4-a33e8d09fc63 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:06.146848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26b6e50e-7739-4339-9af4-a33e8d09fc63 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:06.147820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26b6e50e-7739-4339-9af4-a33e8d09fc63 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:06.148536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26b6e50e-7739-4339-9af4-a33e8d09fc63 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:06.234275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-064c4589-b068-4490-94f0-90cb0bbeb2be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:06.240642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-26b6e50e-7739-4339-9af4-a33e8d09fc63 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:06.243511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-064c4589-b068-4490-94f0-90cb0bbeb2be tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.413051 Jul 14 15:37:06.245370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 24/62] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:05 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:06.259792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-26b6e50e-7739-4339-9af4-a33e8d09fc63 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1242 microversion: 2.1 time: 0.130650 Jul 14 15:37:06.260725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 39/63] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:06 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1242 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:06.328753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c98a981c-1673-4077-b826-15a1fd447628 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:06.329541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c98a981c-1673-4077-b826-15a1fd447628 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:06.335489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c98a981c-1673-4077-b826-15a1fd447628 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:06.335992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c98a981c-1673-4077-b826-15a1fd447628 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:06.336774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c98a981c-1673-4077-b826-15a1fd447628 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:06.337214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c98a981c-1673-4077-b826-15a1fd447628 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:06.480778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c98a981c-1673-4077-b826-15a1fd447628 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:06.489329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c98a981c-1673-4077-b826-15a1fd447628 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.164797 Jul 14 15:37:06.499235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 25/64] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:06 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:07.116545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9feec346-ce4d-4c26-9455-55a58ce69c88 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:07.117164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9feec346-ce4d-4c26-9455-55a58ce69c88 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:07.126362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9feec346-ce4d-4c26-9455-55a58ce69c88 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:07.126825 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9feec346-ce4d-4c26-9455-55a58ce69c88 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:07.127635 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9feec346-ce4d-4c26-9455-55a58ce69c88 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:07.128081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9feec346-ce4d-4c26-9455-55a58ce69c88 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:07.203659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9feec346-ce4d-4c26-9455-55a58ce69c88 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:07.214020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9feec346-ce4d-4c26-9455-55a58ce69c88 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:07.216773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9feec346-ce4d-4c26-9455-55a58ce69c88 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:07.218320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9feec346-ce4d-4c26-9455-55a58ce69c88 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1276 microversion: 2.20 time: 0.105408 Jul 14 15:37:07.218905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 40/65] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:07 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1276 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:07.263431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d4b82bae-7dc1-40ae-813a-1153ca826c95 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:07.264166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d4b82bae-7dc1-40ae-813a-1153ca826c95 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:07.270567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d4b82bae-7dc1-40ae-813a-1153ca826c95 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:07.271173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d4b82bae-7dc1-40ae-813a-1153ca826c95 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:07.271973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d4b82bae-7dc1-40ae-813a-1153ca826c95 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:07.272615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d4b82bae-7dc1-40ae-813a-1153ca826c95 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:07.277885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e83783ab-fa93-4af7-8821-8999e97ff165 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:07.278507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e83783ab-fa93-4af7-8821-8999e97ff165 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:07.285499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e83783ab-fa93-4af7-8821-8999e97ff165 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:07.285962 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e83783ab-fa93-4af7-8821-8999e97ff165 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:07.286756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e83783ab-fa93-4af7-8821-8999e97ff165 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:07.287199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e83783ab-fa93-4af7-8821-8999e97ff165 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:07.364802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e83783ab-fa93-4af7-8821-8999e97ff165 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:07.372899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e83783ab-fa93-4af7-8821-8999e97ff165 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1242 microversion: 2.1 time: 0.098812 Jul 14 15:37:07.373768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 41/66] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:07 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1242 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:07.426127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d4b82bae-7dc1-40ae-813a-1153ca826c95 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:07.433590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d4b82bae-7dc1-40ae-813a-1153ca826c95 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.173997 Jul 14 15:37:07.434172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 26/67] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:07 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:07.506283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e056f2f6-922f-4527-9173-0f7f9612cbe0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:07.506901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e056f2f6-922f-4527-9173-0f7f9612cbe0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:07.512944 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e056f2f6-922f-4527-9173-0f7f9612cbe0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:07.513402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e056f2f6-922f-4527-9173-0f7f9612cbe0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:07.514687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e056f2f6-922f-4527-9173-0f7f9612cbe0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:07.515135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e056f2f6-922f-4527-9173-0f7f9612cbe0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:07.519337 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:07.661805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e056f2f6-922f-4527-9173-0f7f9612cbe0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:07.669176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e056f2f6-922f-4527-9173-0f7f9612cbe0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.166786 Jul 14 15:37:07.669746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 42/68] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:07 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:08.238549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b8a3d1e4-f1af-4db2-91ce-ce0b078033cf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:08.239696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b8a3d1e4-f1af-4db2-91ce-ce0b078033cf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:08.249931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8a3d1e4-f1af-4db2-91ce-ce0b078033cf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:08.250454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8a3d1e4-f1af-4db2-91ce-ce0b078033cf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:08.251348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8a3d1e4-f1af-4db2-91ce-ce0b078033cf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:08.251781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8a3d1e4-f1af-4db2-91ce-ce0b078033cf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:08.331370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b8a3d1e4-f1af-4db2-91ce-ce0b078033cf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:08.340250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b8a3d1e4-f1af-4db2-91ce-ce0b078033cf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:08.341786 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b8a3d1e4-f1af-4db2-91ce-ce0b078033cf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:08.343458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b8a3d1e4-f1af-4db2-91ce-ce0b078033cf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1276 microversion: 2.20 time: 0.110887 Jul 14 15:37:08.345409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 27/69] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:08 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1276 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:08.390695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-41ffcebd-6fc6-4f85-ad79-ca1ed7cb9c36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:08.391304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-41ffcebd-6fc6-4f85-ad79-ca1ed7cb9c36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:08.398900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-41ffcebd-6fc6-4f85-ad79-ca1ed7cb9c36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:08.399790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-41ffcebd-6fc6-4f85-ad79-ca1ed7cb9c36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:08.400698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-41ffcebd-6fc6-4f85-ad79-ca1ed7cb9c36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:08.401135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-41ffcebd-6fc6-4f85-ad79-ca1ed7cb9c36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:08.450483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-83c1a7f5-44b7-48c4-bc16-396f18a9c3a7 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:08.451346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-83c1a7f5-44b7-48c4-bc16-396f18a9c3a7 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:08.459012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83c1a7f5-44b7-48c4-bc16-396f18a9c3a7 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:08.459525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83c1a7f5-44b7-48c4-bc16-396f18a9c3a7 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:08.462149 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83c1a7f5-44b7-48c4-bc16-396f18a9c3a7 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:08.462625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83c1a7f5-44b7-48c4-bc16-396f18a9c3a7 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:08.486244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-41ffcebd-6fc6-4f85-ad79-ca1ed7cb9c36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:08.495495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-41ffcebd-6fc6-4f85-ad79-ca1ed7cb9c36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1242 microversion: 2.1 time: 0.109019 Jul 14 15:37:08.496212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 43/70] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:08 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1242 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:08.650292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-83c1a7f5-44b7-48c4-bc16-396f18a9c3a7 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:08.652692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=85 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:08.662571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-83c1a7f5-44b7-48c4-bc16-396f18a9c3a7 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.216201 Jul 14 15:37:08.663547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 28/71] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:08 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:08.686937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-361ea56b-7b3c-440a-9d46-5f4038d727f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:08.687741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-361ea56b-7b3c-440a-9d46-5f4038d727f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:08.695298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-361ea56b-7b3c-440a-9d46-5f4038d727f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:08.695798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-361ea56b-7b3c-440a-9d46-5f4038d727f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:08.697022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-361ea56b-7b3c-440a-9d46-5f4038d727f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:08.697645 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-361ea56b-7b3c-440a-9d46-5f4038d727f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:08.797465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:08.852191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-361ea56b-7b3c-440a-9d46-5f4038d727f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:08.860486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-361ea56b-7b3c-440a-9d46-5f4038d727f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.178106 Jul 14 15:37:08.861061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 44/72] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:08 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:09.363130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-05d1df8a-37c8-4206-80e5-f365a7595885 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:09.364483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-05d1df8a-37c8-4206-80e5-f365a7595885 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:09.370608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05d1df8a-37c8-4206-80e5-f365a7595885 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:09.371035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05d1df8a-37c8-4206-80e5-f365a7595885 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:09.371827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05d1df8a-37c8-4206-80e5-f365a7595885 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:09.372261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05d1df8a-37c8-4206-80e5-f365a7595885 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:09.436164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-05d1df8a-37c8-4206-80e5-f365a7595885 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:09.444264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-05d1df8a-37c8-4206-80e5-f365a7595885 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:09.445760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-05d1df8a-37c8-4206-80e5-f365a7595885 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:09.446905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-05d1df8a-37c8-4206-80e5-f365a7595885 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1276 microversion: 2.20 time: 0.088454 Jul 14 15:37:09.447486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 29/73] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:09 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:09.512607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-65dbfab4-3793-40fb-a120-519c164a43af tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:09.513217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-65dbfab4-3793-40fb-a120-519c164a43af tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:09.520394 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65dbfab4-3793-40fb-a120-519c164a43af tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:09.521105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65dbfab4-3793-40fb-a120-519c164a43af tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:09.521861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65dbfab4-3793-40fb-a120-519c164a43af tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:09.522297 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65dbfab4-3793-40fb-a120-519c164a43af tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:09.590869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-65dbfab4-3793-40fb-a120-519c164a43af tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:09.600521 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-65dbfab4-3793-40fb-a120-519c164a43af tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1242 microversion: 2.1 time: 0.091650 Jul 14 15:37:09.601104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 45/74] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:09 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1242 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:09.688820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ac1b5f0a-5785-4647-85f0-7f6d2ac77a89 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:09.688820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ac1b5f0a-5785-4647-85f0-7f6d2ac77a89 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:09.694849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac1b5f0a-5785-4647-85f0-7f6d2ac77a89 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:09.695443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac1b5f0a-5785-4647-85f0-7f6d2ac77a89 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:09.696371 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac1b5f0a-5785-4647-85f0-7f6d2ac77a89 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:09.696808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac1b5f0a-5785-4647-85f0-7f6d2ac77a89 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:09.845661 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ac1b5f0a-5785-4647-85f0-7f6d2ac77a89 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:09.853660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ac1b5f0a-5785-4647-85f0-7f6d2ac77a89 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.175775 Jul 14 15:37:09.854234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 30/75] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:09 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:09.878900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-187c8159-b4f4-4b43-b001-361ad2bef4f0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:09.879622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-187c8159-b4f4-4b43-b001-361ad2bef4f0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:09.886401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-187c8159-b4f4-4b43-b001-361ad2bef4f0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:09.886925 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-187c8159-b4f4-4b43-b001-361ad2bef4f0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:09.887807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-187c8159-b4f4-4b43-b001-361ad2bef4f0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:09.888483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-187c8159-b4f4-4b43-b001-361ad2bef4f0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:10.084890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-187c8159-b4f4-4b43-b001-361ad2bef4f0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:10.094153 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-187c8159-b4f4-4b43-b001-361ad2bef4f0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.220660 Jul 14 15:37:10.094991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 46/76] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:09 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:10.466114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-901f3c96-329a-4d84-89b6-76d14aa282ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:10.468271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-901f3c96-329a-4d84-89b6-76d14aa282ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:10.476543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-901f3c96-329a-4d84-89b6-76d14aa282ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:10.477213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-901f3c96-329a-4d84-89b6-76d14aa282ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:10.478692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-901f3c96-329a-4d84-89b6-76d14aa282ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:10.479310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-901f3c96-329a-4d84-89b6-76d14aa282ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:10.578987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-901f3c96-329a-4d84-89b6-76d14aa282ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:10.590777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-901f3c96-329a-4d84-89b6-76d14aa282ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:10.596742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-901f3c96-329a-4d84-89b6-76d14aa282ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:10.603527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-901f3c96-329a-4d84-89b6-76d14aa282ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1276 microversion: 2.20 time: 0.141695 Jul 14 15:37:10.614325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 31/77] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:10 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1276 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:10.628046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0eeb1aed-4f69-446c-9d06-a7970a9682f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:10.628756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0eeb1aed-4f69-446c-9d06-a7970a9682f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:10.631914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:10.646902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0eeb1aed-4f69-446c-9d06-a7970a9682f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:10.647538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0eeb1aed-4f69-446c-9d06-a7970a9682f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:10.664791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0eeb1aed-4f69-446c-9d06-a7970a9682f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:10.665515 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0eeb1aed-4f69-446c-9d06-a7970a9682f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:10.872221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-467199ff-3a5f-4a79-b6b5-9d2733da8dbb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:10.872908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-467199ff-3a5f-4a79-b6b5-9d2733da8dbb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:10.898196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-467199ff-3a5f-4a79-b6b5-9d2733da8dbb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:10.901587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-467199ff-3a5f-4a79-b6b5-9d2733da8dbb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:10.907996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-467199ff-3a5f-4a79-b6b5-9d2733da8dbb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:10.910069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-467199ff-3a5f-4a79-b6b5-9d2733da8dbb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:10.969968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0eeb1aed-4f69-446c-9d06-a7970a9682f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:10.988389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0eeb1aed-4f69-446c-9d06-a7970a9682f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1242 microversion: 2.1 time: 0.365712 Jul 14 15:37:10.989780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 47/78] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:10 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1242 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:11.112389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fe9de094-90bc-4beb-b131-2ef68ca22282 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:11.113011 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fe9de094-90bc-4beb-b131-2ef68ca22282 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:11.121164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe9de094-90bc-4beb-b131-2ef68ca22282 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:11.121629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe9de094-90bc-4beb-b131-2ef68ca22282 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:11.123217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe9de094-90bc-4beb-b131-2ef68ca22282 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:11.124055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe9de094-90bc-4beb-b131-2ef68ca22282 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:11.333392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-467199ff-3a5f-4a79-b6b5-9d2733da8dbb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:11.354322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-467199ff-3a5f-4a79-b6b5-9d2733da8dbb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.486654 Jul 14 15:37:11.359480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 32/79] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:10 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:11.605768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fe9de094-90bc-4beb-b131-2ef68ca22282 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:11.623370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fe9de094-90bc-4beb-b131-2ef68ca22282 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.516885 Jul 14 15:37:11.627143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 48/80] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:11 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:11.636994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-78779527-3561-42d4-a7df-ad96c6cd125e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:11.636994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-78779527-3561-42d4-a7df-ad96c6cd125e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:11.650828 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-78779527-3561-42d4-a7df-ad96c6cd125e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:11.652561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-78779527-3561-42d4-a7df-ad96c6cd125e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:11.653562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-78779527-3561-42d4-a7df-ad96c6cd125e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:11.654140 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-78779527-3561-42d4-a7df-ad96c6cd125e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:11.963648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-78779527-3561-42d4-a7df-ad96c6cd125e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:11.980900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-78779527-3561-42d4-a7df-ad96c6cd125e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:11.984537 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-78779527-3561-42d4-a7df-ad96c6cd125e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:11.986584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-78779527-3561-42d4-a7df-ad96c6cd125e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1340 microversion: 2.20 time: 0.366554 Jul 14 15:37:11.987629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 33/81] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:11 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1340 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:12.007240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1c2951a5-138f-4417-b91b-e42b848f2674 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:12.010355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1c2951a5-138f-4417-b91b-e42b848f2674 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:12.021143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1c2951a5-138f-4417-b91b-e42b848f2674 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:12.022293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1c2951a5-138f-4417-b91b-e42b848f2674 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:12.023350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1c2951a5-138f-4417-b91b-e42b848f2674 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:12.024214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1c2951a5-138f-4417-b91b-e42b848f2674 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:12.100559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:12.348968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1c2951a5-138f-4417-b91b-e42b848f2674 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:12.357120 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1c2951a5-138f-4417-b91b-e42b848f2674 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1308 microversion: 2.1 time: 0.354611 Jul 14 15:37:12.357808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 49/82] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:12 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1308 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:12.376754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-37cea2e5-db04-4043-bf5c-72a8359921a9 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:12.377375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-37cea2e5-db04-4043-bf5c-72a8359921a9 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:12.384502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37cea2e5-db04-4043-bf5c-72a8359921a9 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:12.384972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37cea2e5-db04-4043-bf5c-72a8359921a9 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:12.385739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37cea2e5-db04-4043-bf5c-72a8359921a9 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:12.386181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37cea2e5-db04-4043-bf5c-72a8359921a9 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:12.647168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-55da49cf-8e05-4049-8f8c-0ccc97d031f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:12.647993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-55da49cf-8e05-4049-8f8c-0ccc97d031f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:12.662214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55da49cf-8e05-4049-8f8c-0ccc97d031f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:12.664745 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55da49cf-8e05-4049-8f8c-0ccc97d031f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:12.666548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55da49cf-8e05-4049-8f8c-0ccc97d031f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:12.668693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55da49cf-8e05-4049-8f8c-0ccc97d031f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:12.789953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37cea2e5-db04-4043-bf5c-72a8359921a9 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:12.801218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-37cea2e5-db04-4043-bf5c-72a8359921a9 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.429272 Jul 14 15:37:12.816245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 34/83] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:12 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:13.057922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-55da49cf-8e05-4049-8f8c-0ccc97d031f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:13.068119 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-55da49cf-8e05-4049-8f8c-0ccc97d031f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.426476 Jul 14 15:37:13.068306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 50/84] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:12 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:13.081587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-78cfec87-04cc-414e-ad42-8b0fabb5e9ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:13.082208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-78cfec87-04cc-414e-ad42-8b0fabb5e9ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:13.097362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78cfec87-04cc-414e-ad42-8b0fabb5e9ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:13.097806 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78cfec87-04cc-414e-ad42-8b0fabb5e9ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:13.098671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78cfec87-04cc-414e-ad42-8b0fabb5e9ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:13.099011 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78cfec87-04cc-414e-ad42-8b0fabb5e9ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:13.141077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-027f793f-a6e8-47a2-a6ff-742e8e3871a0 req-7768685f-5c44-4a75-b47f-aa703bbd381a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3264933c-e17b-494c-8d12-86fd9c3ad82d", "tag": "66177828-49fe-493d-8421-513610bbef0f"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:13.167824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-027f793f-a6e8-47a2-a6ff-742e8e3871a0 req-7768685f-5c44-4a75-b47f-aa703bbd381a service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:13.167824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-027f793f-a6e8-47a2-a6ff-742e8e3871a0 req-7768685f-5c44-4a75-b47f-aa703bbd381a service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:13.207318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-78cfec87-04cc-414e-ad42-8b0fabb5e9ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:13.221782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-78cfec87-04cc-414e-ad42-8b0fabb5e9ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:13.227487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-78cfec87-04cc-414e-ad42-8b0fabb5e9ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:13.228089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-027f793f-a6e8-47a2-a6ff-742e8e3871a0 req-7768685f-5c44-4a75-b47f-aa703bbd381a service nova] Creating event network-changed:66177828-49fe-493d-8421-513610bbef0f for instance 3264933c-e17b-494c-8d12-86fd9c3ad82d on hv-cinder-82651 Jul 14 15:37:13.229685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-027f793f-a6e8-47a2-a6ff-742e8e3871a0 req-7768685f-5c44-4a75-b47f-aa703bbd381a service nova] Acquired lock "compute-rpcapi-router" {{(pid=124503) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jul 14 15:37:13.231180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-78cfec87-04cc-414e-ad42-8b0fabb5e9ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1338 microversion: 2.20 time: 0.155663 Jul 14 15:37:13.232127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b61ab629-148f-4eb6-8d61-b4250c7b78cf None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:13.233752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 51/85] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:13 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1338 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:13.248112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b61ab629-148f-4eb6-8d61-b4250c7b78cf None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:13.251686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b61ab629-148f-4eb6-8d61-b4250c7b78cf None None] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:13.252297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b61ab629-148f-4eb6-8d61-b4250c7b78cf None None] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:13.263577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.compute.rpcapi [None req-b61ab629-148f-4eb6-8d61-b4250c7b78cf None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jul 14 15:37:13.265668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b61ab629-148f-4eb6-8d61-b4250c7b78cf None None] Releasing lock "compute-rpcapi-router" {{(pid=124503) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jul 14 15:37:13.298497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b61ab629-148f-4eb6-8d61-b4250c7b78cf None None] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.322388 Jul 14 15:37:13.298497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 35/86] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:13.376893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-45ceb6e6-23e6-47b3-96fe-8ded31fe402b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:13.377873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-45ceb6e6-23e6-47b3-96fe-8ded31fe402b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:13.385087 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45ceb6e6-23e6-47b3-96fe-8ded31fe402b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:13.386491 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45ceb6e6-23e6-47b3-96fe-8ded31fe402b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:13.387535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45ceb6e6-23e6-47b3-96fe-8ded31fe402b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:13.388388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45ceb6e6-23e6-47b3-96fe-8ded31fe402b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:13.481469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-45ceb6e6-23e6-47b3-96fe-8ded31fe402b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:13.492063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-45ceb6e6-23e6-47b3-96fe-8ded31fe402b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1296 microversion: 2.1 time: 0.120560 Jul 14 15:37:13.493505 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 52/87] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:13 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1296 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:13.822870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5ff5ff29-ed1a-4084-9252-03f31c575683 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:13.823425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5ff5ff29-ed1a-4084-9252-03f31c575683 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:13.830343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ff5ff29-ed1a-4084-9252-03f31c575683 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:13.831016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ff5ff29-ed1a-4084-9252-03f31c575683 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:13.831813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ff5ff29-ed1a-4084-9252-03f31c575683 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:13.832724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ff5ff29-ed1a-4084-9252-03f31c575683 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:13.999419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5ff5ff29-ed1a-4084-9252-03f31c575683 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:14.008010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5ff5ff29-ed1a-4084-9252-03f31c575683 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.189375 Jul 14 15:37:14.008597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 36/88] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:13 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:14.088343 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-914c2a88-398d-4958-aef1-cdd080c29d3b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:14.089059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-914c2a88-398d-4958-aef1-cdd080c29d3b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:14.096582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-914c2a88-398d-4958-aef1-cdd080c29d3b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:14.097117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-914c2a88-398d-4958-aef1-cdd080c29d3b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:14.098102 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-914c2a88-398d-4958-aef1-cdd080c29d3b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:14.098710 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-914c2a88-398d-4958-aef1-cdd080c29d3b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:14.252206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-914c2a88-398d-4958-aef1-cdd080c29d3b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:14.257008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f13bd4a4-b946-4200-a0d7-93b03cf1dc1f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:14.259880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f13bd4a4-b946-4200-a0d7-93b03cf1dc1f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:14.261026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-914c2a88-398d-4958-aef1-cdd080c29d3b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.178065 Jul 14 15:37:14.269650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f13bd4a4-b946-4200-a0d7-93b03cf1dc1f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:14.270330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f13bd4a4-b946-4200-a0d7-93b03cf1dc1f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:14.271872 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 53/89] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:14 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:14.272140 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f13bd4a4-b946-4200-a0d7-93b03cf1dc1f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:14.272796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f13bd4a4-b946-4200-a0d7-93b03cf1dc1f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:14.341292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f13bd4a4-b946-4200-a0d7-93b03cf1dc1f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:14.351136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f13bd4a4-b946-4200-a0d7-93b03cf1dc1f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:14.353030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f13bd4a4-b946-4200-a0d7-93b03cf1dc1f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:14.354295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f13bd4a4-b946-4200-a0d7-93b03cf1dc1f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1338 microversion: 2.20 time: 0.102353 Jul 14 15:37:14.355044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 37/90] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:14 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1338 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:37:14.518048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fab409d7-14f2-434f-9f03-8905859d3f78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:14.518813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fab409d7-14f2-434f-9f03-8905859d3f78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:14.527428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fab409d7-14f2-434f-9f03-8905859d3f78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:14.527994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fab409d7-14f2-434f-9f03-8905859d3f78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:14.529017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fab409d7-14f2-434f-9f03-8905859d3f78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:14.529589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fab409d7-14f2-434f-9f03-8905859d3f78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:14.598497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fab409d7-14f2-434f-9f03-8905859d3f78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:14.606434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fab409d7-14f2-434f-9f03-8905859d3f78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1296 microversion: 2.1 time: 0.092838 Jul 14 15:37:14.607308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 54/91] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:14 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:15.026981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1290a9a5-742e-417a-be37-4fe9f18698ac tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:15.027715 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1290a9a5-742e-417a-be37-4fe9f18698ac tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:15.035135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1290a9a5-742e-417a-be37-4fe9f18698ac tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:15.035586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1290a9a5-742e-417a-be37-4fe9f18698ac tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:15.036384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1290a9a5-742e-417a-be37-4fe9f18698ac tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:15.036822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1290a9a5-742e-417a-be37-4fe9f18698ac tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:15.114918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=32 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:15.187700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1290a9a5-742e-417a-be37-4fe9f18698ac tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:15.199941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1290a9a5-742e-417a-be37-4fe9f18698ac tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.172767 Jul 14 15:37:15.199941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 38/92] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:15 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:15.278628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f372ae15-40c4-448e-b84d-2840da13f01b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:15.280132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f372ae15-40c4-448e-b84d-2840da13f01b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:15.287030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f372ae15-40c4-448e-b84d-2840da13f01b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:15.287619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f372ae15-40c4-448e-b84d-2840da13f01b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:15.288678 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f372ae15-40c4-448e-b84d-2840da13f01b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:15.289179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f372ae15-40c4-448e-b84d-2840da13f01b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:15.372845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-33297a29-6769-4145-86bb-e0cd5301308c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:15.374318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-33297a29-6769-4145-86bb-e0cd5301308c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:15.384724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-33297a29-6769-4145-86bb-e0cd5301308c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:15.385800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-33297a29-6769-4145-86bb-e0cd5301308c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:15.386599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-33297a29-6769-4145-86bb-e0cd5301308c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:15.387038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-33297a29-6769-4145-86bb-e0cd5301308c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:15.447871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f372ae15-40c4-448e-b84d-2840da13f01b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:15.456436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f372ae15-40c4-448e-b84d-2840da13f01b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.181667 Jul 14 15:37:15.459668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 55/93] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:15 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:15.468475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-33297a29-6769-4145-86bb-e0cd5301308c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:15.476543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-33297a29-6769-4145-86bb-e0cd5301308c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:15.478031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-33297a29-6769-4145-86bb-e0cd5301308c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:15.479130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-33297a29-6769-4145-86bb-e0cd5301308c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1338 microversion: 2.20 time: 0.110336 Jul 14 15:37:15.479736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 39/94] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:15 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1338 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:37:15.624186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f8f07775-0fc3-41ca-a4ee-9260d37536fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:15.625114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f8f07775-0fc3-41ca-a4ee-9260d37536fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:15.631743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8f07775-0fc3-41ca-a4ee-9260d37536fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:15.632485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8f07775-0fc3-41ca-a4ee-9260d37536fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:15.633443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8f07775-0fc3-41ca-a4ee-9260d37536fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:15.634070 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8f07775-0fc3-41ca-a4ee-9260d37536fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:15.713371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f8f07775-0fc3-41ca-a4ee-9260d37536fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:15.724586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f8f07775-0fc3-41ca-a4ee-9260d37536fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1296 microversion: 2.1 time: 0.104432 Jul 14 15:37:15.725376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 56/95] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:15 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1296 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:16.215834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ddb618fe-8d89-4fe6-bd2d-72df533b69b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:16.216549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ddb618fe-8d89-4fe6-bd2d-72df533b69b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:16.223979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddb618fe-8d89-4fe6-bd2d-72df533b69b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.224822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddb618fe-8d89-4fe6-bd2d-72df533b69b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:16.225854 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddb618fe-8d89-4fe6-bd2d-72df533b69b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.226408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddb618fe-8d89-4fe6-bd2d-72df533b69b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:16.483640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9f893ba5-0aea-445b-b6b2-b13ffd3c29d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:16.485923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9f893ba5-0aea-445b-b6b2-b13ffd3c29d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:16.493704 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f893ba5-0aea-445b-b6b2-b13ffd3c29d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.494222 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f893ba5-0aea-445b-b6b2-b13ffd3c29d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:16.495285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f893ba5-0aea-445b-b6b2-b13ffd3c29d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.495898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f893ba5-0aea-445b-b6b2-b13ffd3c29d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:16.876235 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9f893ba5-0aea-445b-b6b2-b13ffd3c29d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:16.891027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9f893ba5-0aea-445b-b6b2-b13ffd3c29d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.421107 Jul 14 15:37:16.891747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 57/96] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:16 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 423 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:16.896317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ddb618fe-8d89-4fe6-bd2d-72df533b69b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:16.908186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8e9084fc-5300-4c00-8e51-deb38f4c52d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:16.910139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8e9084fc-5300-4c00-8e51-deb38f4c52d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:16.910967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ddb618fe-8d89-4fe6-bd2d-72df533b69b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.700470 Jul 14 15:37:16.911557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 40/97] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:16 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 702 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:16.919533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e9084fc-5300-4c00-8e51-deb38f4c52d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.920006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e9084fc-5300-4c00-8e51-deb38f4c52d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:16.921525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e9084fc-5300-4c00-8e51-deb38f4c52d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.921977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e9084fc-5300-4c00-8e51-deb38f4c52d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:16.937054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2eca8b5b-8059-4a58-8185-965109cc87c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:16.937743 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2eca8b5b-8059-4a58-8185-965109cc87c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:16.945922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2eca8b5b-8059-4a58-8185-965109cc87c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.946709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2eca8b5b-8059-4a58-8185-965109cc87c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:16.950932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2eca8b5b-8059-4a58-8185-965109cc87c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:16.954938 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2eca8b5b-8059-4a58-8185-965109cc87c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:17.075712 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8e9084fc-5300-4c00-8e51-deb38f4c52d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:17.081904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:17.097528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8e9084fc-5300-4c00-8e51-deb38f4c52d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:17.099055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8e9084fc-5300-4c00-8e51-deb38f4c52d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:17.100230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8e9084fc-5300-4c00-8e51-deb38f4c52d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1338 microversion: 2.20 time: 0.207354 Jul 14 15:37:17.101774 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 58/98] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:16 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1338 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:17.178615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2eca8b5b-8059-4a58-8185-965109cc87c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:17.188885 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2eca8b5b-8059-4a58-8185-965109cc87c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1296 microversion: 2.1 time: 0.264211 Jul 14 15:37:17.189977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 41/99] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:16 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1296 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:17.907442 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b5ef4f39-cbf2-4322-919b-e81a708d52d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:17.908084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b5ef4f39-cbf2-4322-919b-e81a708d52d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:17.914343 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5ef4f39-cbf2-4322-919b-e81a708d52d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:17.914790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5ef4f39-cbf2-4322-919b-e81a708d52d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:17.915550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5ef4f39-cbf2-4322-919b-e81a708d52d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:17.916009 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5ef4f39-cbf2-4322-919b-e81a708d52d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:17.928235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4fa7a00d-12aa-4765-b3f1-a11b19ef4ecb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:17.928841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4fa7a00d-12aa-4765-b3f1-a11b19ef4ecb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:17.934892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4fa7a00d-12aa-4765-b3f1-a11b19ef4ecb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:17.935332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4fa7a00d-12aa-4765-b3f1-a11b19ef4ecb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:17.936829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4fa7a00d-12aa-4765-b3f1-a11b19ef4ecb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:17.937418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4fa7a00d-12aa-4765-b3f1-a11b19ef4ecb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:18.078747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b5ef4f39-cbf2-4322-919b-e81a708d52d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:18.087788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b5ef4f39-cbf2-4322-919b-e81a708d52d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.184196 Jul 14 15:37:18.088381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 59/100] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:17 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:18.088495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4fa7a00d-12aa-4765-b3f1-a11b19ef4ecb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:18.097248 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4fa7a00d-12aa-4765-b3f1-a11b19ef4ecb tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.172704 Jul 14 15:37:18.097917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 42/101] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:17 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:18.122430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e7851669-e7d8-4c64-ad10-985a7b0e7297 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:18.123022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e7851669-e7d8-4c64-ad10-985a7b0e7297 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:18.129670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7851669-e7d8-4c64-ad10-985a7b0e7297 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:18.130115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7851669-e7d8-4c64-ad10-985a7b0e7297 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:18.130884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7851669-e7d8-4c64-ad10-985a7b0e7297 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:18.131319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7851669-e7d8-4c64-ad10-985a7b0e7297 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:18.206012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0c86993a-5e72-43c3-bec0-127bcc9c2b4a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:18.209350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0c86993a-5e72-43c3-bec0-127bcc9c2b4a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:18.215427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0c86993a-5e72-43c3-bec0-127bcc9c2b4a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:18.215846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0c86993a-5e72-43c3-bec0-127bcc9c2b4a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:18.216604 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0c86993a-5e72-43c3-bec0-127bcc9c2b4a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:18.217565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0c86993a-5e72-43c3-bec0-127bcc9c2b4a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:18.274427 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e7851669-e7d8-4c64-ad10-985a7b0e7297 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:18.283295 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e7851669-e7d8-4c64-ad10-985a7b0e7297 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:18.284840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e7851669-e7d8-4c64-ad10-985a7b0e7297 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:18.286091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e7851669-e7d8-4c64-ad10-985a7b0e7297 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.167670 Jul 14 15:37:18.286652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 60/102] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:18 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:18.355874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0c86993a-5e72-43c3-bec0-127bcc9c2b4a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:18.364285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0c86993a-5e72-43c3-bec0-127bcc9c2b4a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.162095 Jul 14 15:37:18.364854 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 43/103] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:18 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:19.105245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-65d0fa68-9e01-4435-9282-80a221e17873 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:19.105968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-65d0fa68-9e01-4435-9282-80a221e17873 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:19.118404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a08c7f1f-3ff4-481a-ba5b-af8ba3d3bf72 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:19.119013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a08c7f1f-3ff4-481a-ba5b-af8ba3d3bf72 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:19.125685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65d0fa68-9e01-4435-9282-80a221e17873 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:19.126357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65d0fa68-9e01-4435-9282-80a221e17873 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:19.127059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65d0fa68-9e01-4435-9282-80a221e17873 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:19.127502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65d0fa68-9e01-4435-9282-80a221e17873 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:19.133353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a08c7f1f-3ff4-481a-ba5b-af8ba3d3bf72 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:19.133917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a08c7f1f-3ff4-481a-ba5b-af8ba3d3bf72 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:19.134685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a08c7f1f-3ff4-481a-ba5b-af8ba3d3bf72 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:19.135114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a08c7f1f-3ff4-481a-ba5b-af8ba3d3bf72 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:19.298741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a08c7f1f-3ff4-481a-ba5b-af8ba3d3bf72 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:19.301315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-65d0fa68-9e01-4435-9282-80a221e17873 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:19.307552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a08c7f1f-3ff4-481a-ba5b-af8ba3d3bf72 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.192848 Jul 14 15:37:19.308167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 44/104] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:19 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:19.308820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-65d0fa68-9e01-4435-9282-80a221e17873 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.207725 Jul 14 15:37:19.318486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 61/105] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:19 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:19.318667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-684c8490-9bfd-4256-b24c-f9e51faa7f2b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:19.318667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-684c8490-9bfd-4256-b24c-f9e51faa7f2b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:19.322359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-684c8490-9bfd-4256-b24c-f9e51faa7f2b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:19.323122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-684c8490-9bfd-4256-b24c-f9e51faa7f2b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:19.324095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-684c8490-9bfd-4256-b24c-f9e51faa7f2b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:19.324534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-684c8490-9bfd-4256-b24c-f9e51faa7f2b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:19.444799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-f9a6e17f-c44c-4f90-8c5e-04fac90410dc req-aa6eadba-1e95-4abe-81eb-cb0ab9690391 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac", "name": "network-vif-plugged", "status": "completed", "tag": "6c2e9773-4369-4a54-ae35-882ccbb7222a"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:19.454867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-f9a6e17f-c44c-4f90-8c5e-04fac90410dc req-aa6eadba-1e95-4abe-81eb-cb0ab9690391 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:19.455326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-f9a6e17f-c44c-4f90-8c5e-04fac90410dc req-aa6eadba-1e95-4abe-81eb-cb0ab9690391 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:19.468849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-f9a6e17f-c44c-4f90-8c5e-04fac90410dc req-aa6eadba-1e95-4abe-81eb-cb0ab9690391 service nova] Creating event network-vif-plugged:6c2e9773-4369-4a54-ae35-882ccbb7222a for instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac on hv-cinder-82651 Jul 14 15:37:19.474293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-f9a6e17f-c44c-4f90-8c5e-04fac90410dc req-aa6eadba-1e95-4abe-81eb-cb0ab9690391 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112792 Jul 14 15:37:19.475191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 62/106] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:19.482188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f3491d2f-09e8-4557-a7e7-4e068c161cce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:19.484091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f3491d2f-09e8-4557-a7e7-4e068c161cce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:19.484926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-684c8490-9bfd-4256-b24c-f9e51faa7f2b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:19.489426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:19.491866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f3491d2f-09e8-4557-a7e7-4e068c161cce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:19.492330 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f3491d2f-09e8-4557-a7e7-4e068c161cce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:19.493250 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f3491d2f-09e8-4557-a7e7-4e068c161cce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:19.494039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f3491d2f-09e8-4557-a7e7-4e068c161cce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:19.502099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-684c8490-9bfd-4256-b24c-f9e51faa7f2b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:19.503896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-684c8490-9bfd-4256-b24c-f9e51faa7f2b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:19.505256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-684c8490-9bfd-4256-b24c-f9e51faa7f2b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.196163 Jul 14 15:37:19.506052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 45/107] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:19 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:19.657034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f3491d2f-09e8-4557-a7e7-4e068c161cce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:19.664563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f3491d2f-09e8-4557-a7e7-4e068c161cce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.188021 Jul 14 15:37:19.665138 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 63/108] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:19 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:20.325300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2182aa57-519e-4105-bed8-266b7f543de2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:20.325809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2182aa57-519e-4105-bed8-266b7f543de2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:20.325918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cd3a8875-aecb-4ce2-b184-6e7482e3c528 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:20.326935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cd3a8875-aecb-4ce2-b184-6e7482e3c528 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:20.332125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2182aa57-519e-4105-bed8-266b7f543de2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:20.332572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2182aa57-519e-4105-bed8-266b7f543de2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:20.332902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd3a8875-aecb-4ce2-b184-6e7482e3c528 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:20.333326 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2182aa57-519e-4105-bed8-266b7f543de2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:20.333419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd3a8875-aecb-4ce2-b184-6e7482e3c528 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:20.333759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2182aa57-519e-4105-bed8-266b7f543de2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:20.334094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd3a8875-aecb-4ce2-b184-6e7482e3c528 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:20.334538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd3a8875-aecb-4ce2-b184-6e7482e3c528 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:20.465501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2182aa57-519e-4105-bed8-266b7f543de2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:20.465604 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cd3a8875-aecb-4ce2-b184-6e7482e3c528 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:20.473433 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2182aa57-519e-4105-bed8-266b7f543de2 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.152034 Jul 14 15:37:20.474001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 46/109] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:20 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:20.475622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cd3a8875-aecb-4ce2-b184-6e7482e3c528 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.153517 Jul 14 15:37:20.476196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 64/110] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:20 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:20.524462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-40a9653c-67bf-4005-8eb7-8566c6874856 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:20.525061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-40a9653c-67bf-4005-8eb7-8566c6874856 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:20.530969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40a9653c-67bf-4005-8eb7-8566c6874856 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:20.531406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40a9653c-67bf-4005-8eb7-8566c6874856 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:20.532207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40a9653c-67bf-4005-8eb7-8566c6874856 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:20.532637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40a9653c-67bf-4005-8eb7-8566c6874856 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:20.669520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-40a9653c-67bf-4005-8eb7-8566c6874856 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:20.678017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-40a9653c-67bf-4005-8eb7-8566c6874856 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:20.687759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-40a9653c-67bf-4005-8eb7-8566c6874856 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:20.687759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-40a9653c-67bf-4005-8eb7-8566c6874856 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.160424 Jul 14 15:37:20.687759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 47/111] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:20.688210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-49496294-8a21-470c-a815-56a252d0b38a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:20.688210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-49496294-8a21-470c-a815-56a252d0b38a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:20.690202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-49496294-8a21-470c-a815-56a252d0b38a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:20.690683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-49496294-8a21-470c-a815-56a252d0b38a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:20.691488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-49496294-8a21-470c-a815-56a252d0b38a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:20.691967 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-49496294-8a21-470c-a815-56a252d0b38a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:20.823160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-49496294-8a21-470c-a815-56a252d0b38a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:20.830958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-49496294-8a21-470c-a815-56a252d0b38a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.153401 Jul 14 15:37:20.831520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 65/112] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:20 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:21.493877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6c82f959-7720-4cc4-9b19-fd99d2f055b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:21.494503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6c82f959-7720-4cc4-9b19-fd99d2f055b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:21.501508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6c82f959-7720-4cc4-9b19-fd99d2f055b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:21.502222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6c82f959-7720-4cc4-9b19-fd99d2f055b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:21.502863 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f69a3da9-b853-408b-b74b-ecb198aaaa82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:21.503474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6c82f959-7720-4cc4-9b19-fd99d2f055b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:21.503611 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f69a3da9-b853-408b-b74b-ecb198aaaa82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:21.504207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6c82f959-7720-4cc4-9b19-fd99d2f055b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:21.511000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f69a3da9-b853-408b-b74b-ecb198aaaa82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:21.511667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f69a3da9-b853-408b-b74b-ecb198aaaa82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:21.512479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f69a3da9-b853-408b-b74b-ecb198aaaa82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:21.512926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f69a3da9-b853-408b-b74b-ecb198aaaa82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:21.851041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6c82f959-7720-4cc4-9b19-fd99d2f055b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:21.866175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6c82f959-7720-4cc4-9b19-fd99d2f055b6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.378598 Jul 14 15:37:21.879692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 48/113] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:21 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:21.897260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-678d39a6-91a4-4bcf-884e-032df3751086 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:21.898264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-678d39a6-91a4-4bcf-884e-032df3751086 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:21.913562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-678d39a6-91a4-4bcf-884e-032df3751086 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:21.914624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-678d39a6-91a4-4bcf-884e-032df3751086 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:21.916909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-678d39a6-91a4-4bcf-884e-032df3751086 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:21.917356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-678d39a6-91a4-4bcf-884e-032df3751086 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:22.176964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f69a3da9-b853-408b-b74b-ecb198aaaa82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:22.190612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f69a3da9-b853-408b-b74b-ecb198aaaa82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.691967 Jul 14 15:37:22.197188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 66/114] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:21 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 699 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:22.204446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-156bd547-a0d7-49a2-bbb1-467fafd5b785 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:22.207545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-156bd547-a0d7-49a2-bbb1-467fafd5b785 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:22.223768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-156bd547-a0d7-49a2-bbb1-467fafd5b785 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:22.226502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-156bd547-a0d7-49a2-bbb1-467fafd5b785 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:22.227368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-156bd547-a0d7-49a2-bbb1-467fafd5b785 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:22.228001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-156bd547-a0d7-49a2-bbb1-467fafd5b785 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:22.556659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-678d39a6-91a4-4bcf-884e-032df3751086 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:22.580914 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-678d39a6-91a4-4bcf-884e-032df3751086 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:22.586355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-678d39a6-91a4-4bcf-884e-032df3751086 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:22.591501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-678d39a6-91a4-4bcf-884e-032df3751086 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.708595 Jul 14 15:37:22.596668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 49/115] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:21 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 716 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:22.605295 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-156bd547-a0d7-49a2-bbb1-467fafd5b785 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:22.613660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-156bd547-a0d7-49a2-bbb1-467fafd5b785 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.414839 Jul 14 15:37:22.614855 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 67/116] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:22 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:22.886204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6e70fa4e-f37a-451d-8bd6-49e6732c5266 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:22.886914 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6e70fa4e-f37a-451d-8bd6-49e6732c5266 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:22.898170 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6e70fa4e-f37a-451d-8bd6-49e6732c5266 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:22.898813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6e70fa4e-f37a-451d-8bd6-49e6732c5266 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:22.899868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6e70fa4e-f37a-451d-8bd6-49e6732c5266 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:22.901341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6e70fa4e-f37a-451d-8bd6-49e6732c5266 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:23.076597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-e3be3bab-3db2-41d9-bf04-a521ae94b786 req-6660ca4a-60f5-453a-b600-25c62e6552c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d96a86-d045-44b2-b298-75df12f65c86", "tag": "c5725421-8115-49e0-9dc8-6b9ccd639dcd"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:23.082733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-e3be3bab-3db2-41d9-bf04-a521ae94b786 req-6660ca4a-60f5-453a-b600-25c62e6552c5 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:23.083291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-e3be3bab-3db2-41d9-bf04-a521ae94b786 req-6660ca4a-60f5-453a-b600-25c62e6552c5 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:23.104223 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-e3be3bab-3db2-41d9-bf04-a521ae94b786 req-6660ca4a-60f5-453a-b600-25c62e6552c5 service nova] Creating event network-changed:c5725421-8115-49e0-9dc8-6b9ccd639dcd for instance f3d96a86-d045-44b2-b298-75df12f65c86 on hv-cinder-82651 Jul 14 15:37:23.112290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-e3be3bab-3db2-41d9-bf04-a521ae94b786 req-6660ca4a-60f5-453a-b600-25c62e6552c5 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045901 Jul 14 15:37:23.113115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 68/117] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:37:23.157391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6e70fa4e-f37a-451d-8bd6-49e6732c5266 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:23.166683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6e70fa4e-f37a-451d-8bd6-49e6732c5266 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.286686 Jul 14 15:37:23.169066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 50/118] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:22 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:23.171835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-4c486d18-c2f8-4832-83e0-df921284e35c req-80195660-5cc1-465b-bb1a-7b945f2a217a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c8cb95-bde5-4c91-99de-27aa44a822bf", "tag": "daed7bb6-45ad-49c9-829a-e0e2a0eca7f9"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:23.182675 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-4c486d18-c2f8-4832-83e0-df921284e35c req-80195660-5cc1-465b-bb1a-7b945f2a217a service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:23.183133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-4c486d18-c2f8-4832-83e0-df921284e35c req-80195660-5cc1-465b-bb1a-7b945f2a217a service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:23.196016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-4c486d18-c2f8-4832-83e0-df921284e35c req-80195660-5cc1-465b-bb1a-7b945f2a217a service nova] Creating event network-changed:daed7bb6-45ad-49c9-829a-e0e2a0eca7f9 for instance e5c8cb95-bde5-4c91-99de-27aa44a822bf on hv-cinder-82651 Jul 14 15:37:23.201521 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-4c486d18-c2f8-4832-83e0-df921284e35c req-80195660-5cc1-465b-bb1a-7b945f2a217a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035799 Jul 14 15:37:23.203308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 69/119] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:23.215844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-83296c66-2826-4fde-8af4-f0acd7c968d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:23.216740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-83296c66-2826-4fde-8af4-f0acd7c968d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:23.223961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83296c66-2826-4fde-8af4-f0acd7c968d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:23.224417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83296c66-2826-4fde-8af4-f0acd7c968d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:23.225257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83296c66-2826-4fde-8af4-f0acd7c968d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:23.225697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83296c66-2826-4fde-8af4-f0acd7c968d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:23.262624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=8 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:23.450963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-83296c66-2826-4fde-8af4-f0acd7c968d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:23.459631 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-83296c66-2826-4fde-8af4-f0acd7c968d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.249107 Jul 14 15:37:23.460234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 51/120] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:23 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:23.615430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f2ecea0c-7f92-49ba-aac0-0869b10679d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:23.616182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f2ecea0c-7f92-49ba-aac0-0869b10679d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:23.622418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f2ecea0c-7f92-49ba-aac0-0869b10679d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:23.622870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f2ecea0c-7f92-49ba-aac0-0869b10679d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:23.623675 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f2ecea0c-7f92-49ba-aac0-0869b10679d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:23.624390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f2ecea0c-7f92-49ba-aac0-0869b10679d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:23.630475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c3343111-60af-4e66-a342-17f25b02ff37 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:23.631206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c3343111-60af-4e66-a342-17f25b02ff37 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:23.632951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:23.640673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3343111-60af-4e66-a342-17f25b02ff37 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:23.641122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3343111-60af-4e66-a342-17f25b02ff37 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:23.641888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3343111-60af-4e66-a342-17f25b02ff37 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:23.642331 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3343111-60af-4e66-a342-17f25b02ff37 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:23.774834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f2ecea0c-7f92-49ba-aac0-0869b10679d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:23.783477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f2ecea0c-7f92-49ba-aac0-0869b10679d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:23.785511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f2ecea0c-7f92-49ba-aac0-0869b10679d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:23.786735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f2ecea0c-7f92-49ba-aac0-0869b10679d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.175525 Jul 14 15:37:23.787695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 70/121] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:23 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:23.797462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c3343111-60af-4e66-a342-17f25b02ff37 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:23.805275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c3343111-60af-4e66-a342-17f25b02ff37 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.178828 Jul 14 15:37:23.806049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 52/122] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:23 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:24.185656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-83737318-9bff-4d53-a655-8a959995f113 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:24.186376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-83737318-9bff-4d53-a655-8a959995f113 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:24.194619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83737318-9bff-4d53-a655-8a959995f113 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:24.195067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83737318-9bff-4d53-a655-8a959995f113 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:24.195978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83737318-9bff-4d53-a655-8a959995f113 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:24.196420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83737318-9bff-4d53-a655-8a959995f113 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:24.335576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-83737318-9bff-4d53-a655-8a959995f113 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:24.343613 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-83737318-9bff-4d53-a655-8a959995f113 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.161431 Jul 14 15:37:24.344431 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 71/123] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:24 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:24.476756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a16a6877-8333-46fc-b577-3c2cc5b19284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:24.477372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a16a6877-8333-46fc-b577-3c2cc5b19284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:24.484049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a16a6877-8333-46fc-b577-3c2cc5b19284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:24.484750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a16a6877-8333-46fc-b577-3c2cc5b19284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:24.485267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a16a6877-8333-46fc-b577-3c2cc5b19284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:24.485751 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a16a6877-8333-46fc-b577-3c2cc5b19284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:24.635736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a16a6877-8333-46fc-b577-3c2cc5b19284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:24.643304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a16a6877-8333-46fc-b577-3c2cc5b19284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.170223 Jul 14 15:37:24.643905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 53/124] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:24 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:24.809627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4d986c9a-24b5-4ca7-ad70-f08b703b475f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:24.810239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4d986c9a-24b5-4ca7-ad70-f08b703b475f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:24.817831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4d986c9a-24b5-4ca7-ad70-f08b703b475f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:24.818293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4d986c9a-24b5-4ca7-ad70-f08b703b475f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:24.819097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4d986c9a-24b5-4ca7-ad70-f08b703b475f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:24.819622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4d986c9a-24b5-4ca7-ad70-f08b703b475f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:24.824294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6dc318e8-5e8c-472a-89d2-b75b50c4b318 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:24.824846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6dc318e8-5e8c-472a-89d2-b75b50c4b318 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:24.833904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6dc318e8-5e8c-472a-89d2-b75b50c4b318 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:24.834565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6dc318e8-5e8c-472a-89d2-b75b50c4b318 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:24.835756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6dc318e8-5e8c-472a-89d2-b75b50c4b318 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:24.836414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6dc318e8-5e8c-472a-89d2-b75b50c4b318 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:24.980884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4d986c9a-24b5-4ca7-ad70-f08b703b475f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:24.989936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4d986c9a-24b5-4ca7-ad70-f08b703b475f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:24.991433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4d986c9a-24b5-4ca7-ad70-f08b703b475f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:24.992597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4d986c9a-24b5-4ca7-ad70-f08b703b475f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.189999 Jul 14 15:37:25.002193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6dc318e8-5e8c-472a-89d2-b75b50c4b318 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:25.002403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 72/125] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:24 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:25.012061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6dc318e8-5e8c-472a-89d2-b75b50c4b318 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.192459 Jul 14 15:37:25.012639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 54/126] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:24 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:25.362316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f377da64-e894-4bb6-8bac-233898625b0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:25.362934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f377da64-e894-4bb6-8bac-233898625b0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:25.369264 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f377da64-e894-4bb6-8bac-233898625b0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:25.369715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f377da64-e894-4bb6-8bac-233898625b0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:25.370494 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f377da64-e894-4bb6-8bac-233898625b0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:25.370938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f377da64-e894-4bb6-8bac-233898625b0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:25.537633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f377da64-e894-4bb6-8bac-233898625b0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:25.545696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f377da64-e894-4bb6-8bac-233898625b0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.187187 Jul 14 15:37:25.547242 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 73/127] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:25 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:25.660147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-714a1610-4590-421b-9905-a012339de7c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:25.660762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-714a1610-4590-421b-9905-a012339de7c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:25.667686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-714a1610-4590-421b-9905-a012339de7c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:25.668309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-714a1610-4590-421b-9905-a012339de7c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:25.669332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-714a1610-4590-421b-9905-a012339de7c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:25.669772 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-714a1610-4590-421b-9905-a012339de7c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:25.918486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-714a1610-4590-421b-9905-a012339de7c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:25.943973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-714a1610-4590-421b-9905-a012339de7c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.287370 Jul 14 15:37:25.945809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 55/128] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:25 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:26.010619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6d3f29db-7b91-4921-a9ac-7eb3c2a2d340 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:26.011318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6d3f29db-7b91-4921-a9ac-7eb3c2a2d340 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:26.018107 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6d3f29db-7b91-4921-a9ac-7eb3c2a2d340 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:26.018550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6d3f29db-7b91-4921-a9ac-7eb3c2a2d340 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:26.019477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6d3f29db-7b91-4921-a9ac-7eb3c2a2d340 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:26.019943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6d3f29db-7b91-4921-a9ac-7eb3c2a2d340 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:26.039520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-25830a27-1c4d-4539-bc7c-ab837b611153 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:26.043446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-25830a27-1c4d-4539-bc7c-ab837b611153 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:26.059179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-25830a27-1c4d-4539-bc7c-ab837b611153 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:26.059862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-25830a27-1c4d-4539-bc7c-ab837b611153 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:26.060788 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-25830a27-1c4d-4539-bc7c-ab837b611153 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:26.061441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-25830a27-1c4d-4539-bc7c-ab837b611153 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:26.207980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6d3f29db-7b91-4921-a9ac-7eb3c2a2d340 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:26.216148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6d3f29db-7b91-4921-a9ac-7eb3c2a2d340 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:26.217986 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6d3f29db-7b91-4921-a9ac-7eb3c2a2d340 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:26.219144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-25830a27-1c4d-4539-bc7c-ab837b611153 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:26.219276 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6d3f29db-7b91-4921-a9ac-7eb3c2a2d340 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.212550 Jul 14 15:37:26.220154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 74/129] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:26 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:26.235584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-25830a27-1c4d-4539-bc7c-ab837b611153 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.200199 Jul 14 15:37:26.236420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 56/130] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:26 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:26.568564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cd808ee3-e45a-4271-9e9f-3c1a60d45ce1 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:26.569496 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cd808ee3-e45a-4271-9e9f-3c1a60d45ce1 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:26.582469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd808ee3-e45a-4271-9e9f-3c1a60d45ce1 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:26.582918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd808ee3-e45a-4271-9e9f-3c1a60d45ce1 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:26.583729 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd808ee3-e45a-4271-9e9f-3c1a60d45ce1 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:26.584189 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd808ee3-e45a-4271-9e9f-3c1a60d45ce1 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:26.744209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cd808ee3-e45a-4271-9e9f-3c1a60d45ce1 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:26.752947 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cd808ee3-e45a-4271-9e9f-3c1a60d45ce1 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.188177 Jul 14 15:37:26.753524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 75/131] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:26 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:26.963970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1f8bb1d9-c524-451b-961d-97926ae10f57 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:26.964516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1f8bb1d9-c524-451b-961d-97926ae10f57 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:26.971183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f8bb1d9-c524-451b-961d-97926ae10f57 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:26.971778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f8bb1d9-c524-451b-961d-97926ae10f57 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:26.972526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f8bb1d9-c524-451b-961d-97926ae10f57 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:26.972967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f8bb1d9-c524-451b-961d-97926ae10f57 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:27.115129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1f8bb1d9-c524-451b-961d-97926ae10f57 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:27.129068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1f8bb1d9-c524-451b-961d-97926ae10f57 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.168806 Jul 14 15:37:27.131400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 57/132] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:26 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:27.238718 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7a6e157d-cb8f-45bb-9a4a-bdb2918f1b1d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:27.239329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7a6e157d-cb8f-45bb-9a4a-bdb2918f1b1d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:27.245391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a6e157d-cb8f-45bb-9a4a-bdb2918f1b1d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:27.245834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a6e157d-cb8f-45bb-9a4a-bdb2918f1b1d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:27.247477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a6e157d-cb8f-45bb-9a4a-bdb2918f1b1d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:27.247477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a6e157d-cb8f-45bb-9a4a-bdb2918f1b1d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:27.254031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-abb896c3-7449-4b81-b27c-7b69f3e9e8cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:27.255196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-abb896c3-7449-4b81-b27c-7b69f3e9e8cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:27.262375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abb896c3-7449-4b81-b27c-7b69f3e9e8cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:27.262876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abb896c3-7449-4b81-b27c-7b69f3e9e8cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:27.263667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abb896c3-7449-4b81-b27c-7b69f3e9e8cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:27.264146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abb896c3-7449-4b81-b27c-7b69f3e9e8cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:27.401972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7a6e157d-cb8f-45bb-9a4a-bdb2918f1b1d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:27.410709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-abb896c3-7449-4b81-b27c-7b69f3e9e8cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:27.411907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7a6e157d-cb8f-45bb-9a4a-bdb2918f1b1d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:27.413823 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7a6e157d-cb8f-45bb-9a4a-bdb2918f1b1d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:27.415265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7a6e157d-cb8f-45bb-9a4a-bdb2918f1b1d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.181620 Jul 14 15:37:27.416145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 76/133] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:27.422973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-abb896c3-7449-4b81-b27c-7b69f3e9e8cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.173642 Jul 14 15:37:27.423684 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 58/134] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:27 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:27.770503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-aee7378b-fda7-4ec4-adb5-66804f6868a3 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:27.771695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-aee7378b-fda7-4ec4-adb5-66804f6868a3 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:27.785223 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aee7378b-fda7-4ec4-adb5-66804f6868a3 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:27.786797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aee7378b-fda7-4ec4-adb5-66804f6868a3 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:27.802077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aee7378b-fda7-4ec4-adb5-66804f6868a3 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:27.802549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aee7378b-fda7-4ec4-adb5-66804f6868a3 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:27.830136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:28.079638 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-9627ba2b-eee0-467f-9531-1bea38f087d6 req-a8fb1c17-3c88-49ea-b97a-f8dd1f4054d0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c97816-6d05-424a-832a-48500a73d87f", "name": "network-vif-plugged", "status": "completed", "tag": "ef1ba542-f905-48ed-ae96-28d22e39407f"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:28.094624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-9627ba2b-eee0-467f-9531-1bea38f087d6 req-a8fb1c17-3c88-49ea-b97a-f8dd1f4054d0 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:28.101246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-9627ba2b-eee0-467f-9531-1bea38f087d6 req-a8fb1c17-3c88-49ea-b97a-f8dd1f4054d0 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:28.153012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-9627ba2b-eee0-467f-9531-1bea38f087d6 req-a8fb1c17-3c88-49ea-b97a-f8dd1f4054d0 service nova] Creating event network-vif-plugged:ef1ba542-f905-48ed-ae96-28d22e39407f for instance 15c97816-6d05-424a-832a-48500a73d87f on hv-cinder-82651 Jul 14 15:37:28.166187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-9627ba2b-eee0-467f-9531-1bea38f087d6 req-a8fb1c17-3c88-49ea-b97a-f8dd1f4054d0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091208 Jul 14 15:37:28.166875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 59/135] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:37:28.181909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cc1c5ff8-a366-4427-8d04-1c46c933c923 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:28.183448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cc1c5ff8-a366-4427-8d04-1c46c933c923 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:28.208467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc1c5ff8-a366-4427-8d04-1c46c933c923 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:28.209256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc1c5ff8-a366-4427-8d04-1c46c933c923 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:28.210898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc1c5ff8-a366-4427-8d04-1c46c933c923 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:28.211768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc1c5ff8-a366-4427-8d04-1c46c933c923 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:28.300080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aee7378b-fda7-4ec4-adb5-66804f6868a3 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:28.325437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-aee7378b-fda7-4ec4-adb5-66804f6868a3 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.559330 Jul 14 15:37:28.328183 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 77/136] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:27 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:28.443320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cc1c5ff8-a366-4427-8d04-1c46c933c923 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:28.444478 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3c4a9493-f13c-4d3b-9134-5c6b8b079080 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:28.445267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3c4a9493-f13c-4d3b-9134-5c6b8b079080 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:28.457782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cc1c5ff8-a366-4427-8d04-1c46c933c923 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.287556 Jul 14 15:37:28.458065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c4a9493-f13c-4d3b-9134-5c6b8b079080 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:28.458649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c4a9493-f13c-4d3b-9134-5c6b8b079080 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:28.459675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 60/137] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:28 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:28.461708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c4a9493-f13c-4d3b-9134-5c6b8b079080 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:28.462158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c4a9493-f13c-4d3b-9134-5c6b8b079080 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:28.469430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-86a35ea4-e1c5-4689-bd66-ec0d52bc756b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:28.469782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-86a35ea4-e1c5-4689-bd66-ec0d52bc756b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:28.477524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-86a35ea4-e1c5-4689-bd66-ec0d52bc756b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:28.478257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-86a35ea4-e1c5-4689-bd66-ec0d52bc756b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:28.479399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-86a35ea4-e1c5-4689-bd66-ec0d52bc756b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:28.480029 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-86a35ea4-e1c5-4689-bd66-ec0d52bc756b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:28.700940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3c4a9493-f13c-4d3b-9134-5c6b8b079080 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:28.712248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3c4a9493-f13c-4d3b-9134-5c6b8b079080 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:28.714492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3c4a9493-f13c-4d3b-9134-5c6b8b079080 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:28.716256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3c4a9493-f13c-4d3b-9134-5c6b8b079080 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.277432 Jul 14 15:37:28.717319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 78/138] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:28 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:28.739748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-86a35ea4-e1c5-4689-bd66-ec0d52bc756b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:28.747869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-86a35ea4-e1c5-4689-bd66-ec0d52bc756b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.287181 Jul 14 15:37:28.748520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 61/139] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:28 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:29.345483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b1bb6132-aed0-4c1a-99c8-b015e8432fa5 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:29.346137 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b1bb6132-aed0-4c1a-99c8-b015e8432fa5 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:29.352227 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b1bb6132-aed0-4c1a-99c8-b015e8432fa5 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:29.352855 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b1bb6132-aed0-4c1a-99c8-b015e8432fa5 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:29.353926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b1bb6132-aed0-4c1a-99c8-b015e8432fa5 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:29.354511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b1bb6132-aed0-4c1a-99c8-b015e8432fa5 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:29.476846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b8128f6d-a825-45d6-abf2-32ca07cec79d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:29.478246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b8128f6d-a825-45d6-abf2-32ca07cec79d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:29.507063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8128f6d-a825-45d6-abf2-32ca07cec79d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:29.508024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8128f6d-a825-45d6-abf2-32ca07cec79d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:29.511972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8128f6d-a825-45d6-abf2-32ca07cec79d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:29.512841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8128f6d-a825-45d6-abf2-32ca07cec79d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:29.801986 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b1bb6132-aed0-4c1a-99c8-b015e8432fa5 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:29.815268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b1bb6132-aed0-4c1a-99c8-b015e8432fa5 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1315 microversion: 2.1 time: 0.474220 Jul 14 15:37:29.815898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 79/140] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:29 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1315 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:29.821284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b8128f6d-a825-45d6-abf2-32ca07cec79d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:29.831699 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b8128f6d-a825-45d6-abf2-32ca07cec79d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.358774 Jul 14 15:37:29.832862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-40fd2c77-e81f-4ddc-9c7a-5ea397c2d9ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:29.833201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 62/141] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:29 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:29.835079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-40fd2c77-e81f-4ddc-9c7a-5ea397c2d9ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:29.854240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40fd2c77-e81f-4ddc-9c7a-5ea397c2d9ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:29.854352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-70d43d4c-c897-451e-be42-676782e4d32d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:29.854445 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40fd2c77-e81f-4ddc-9c7a-5ea397c2d9ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:29.854564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40fd2c77-e81f-4ddc-9c7a-5ea397c2d9ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:29.855150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40fd2c77-e81f-4ddc-9c7a-5ea397c2d9ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:29.855905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-70d43d4c-c897-451e-be42-676782e4d32d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:29.865162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70d43d4c-c897-451e-be42-676782e4d32d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:29.865778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70d43d4c-c897-451e-be42-676782e4d32d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:29.866685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70d43d4c-c897-451e-be42-676782e4d32d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:29.867362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70d43d4c-c897-451e-be42-676782e4d32d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:29.873000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:30.080247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-70d43d4c-c897-451e-be42-676782e4d32d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:30.100292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-70d43d4c-c897-451e-be42-676782e4d32d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.265599 Jul 14 15:37:30.104079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 63/142] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:29 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:30.137046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-40fd2c77-e81f-4ddc-9c7a-5ea397c2d9ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:30.149640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-40fd2c77-e81f-4ddc-9c7a-5ea397c2d9ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:30.151990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-40fd2c77-e81f-4ddc-9c7a-5ea397c2d9ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:30.153719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-40fd2c77-e81f-4ddc-9c7a-5ea397c2d9ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.334548 Jul 14 15:37:30.154290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 80/143] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:29 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:30.210332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-3856f18e-b293-460b-83d5-9e9f0499cf8f req-5e9a7638-14c2-4581-93e9-76fa0e716a1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3264933c-e17b-494c-8d12-86fd9c3ad82d", "name": "network-vif-plugged", "status": "completed", "tag": "66177828-49fe-493d-8421-513610bbef0f"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:30.223435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-3856f18e-b293-460b-83d5-9e9f0499cf8f req-5e9a7638-14c2-4581-93e9-76fa0e716a1a service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:30.224211 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-3856f18e-b293-460b-83d5-9e9f0499cf8f req-5e9a7638-14c2-4581-93e9-76fa0e716a1a service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:30.237638 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-3856f18e-b293-460b-83d5-9e9f0499cf8f req-5e9a7638-14c2-4581-93e9-76fa0e716a1a service nova] Creating event network-vif-plugged:66177828-49fe-493d-8421-513610bbef0f for instance 3264933c-e17b-494c-8d12-86fd9c3ad82d on hv-cinder-82651 Jul 14 15:37:30.243257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-3856f18e-b293-460b-83d5-9e9f0499cf8f req-5e9a7638-14c2-4581-93e9-76fa0e716a1a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039131 Jul 14 15:37:30.244059 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 64/144] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:37:30.833251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-29d70e2c-4cf3-42c0-9804-d20a420ab7d0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:30.833881 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-29d70e2c-4cf3-42c0-9804-d20a420ab7d0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:30.845485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-29d70e2c-4cf3-42c0-9804-d20a420ab7d0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:30.845485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-29d70e2c-4cf3-42c0-9804-d20a420ab7d0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:30.845485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-29d70e2c-4cf3-42c0-9804-d20a420ab7d0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:30.845485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-29d70e2c-4cf3-42c0-9804-d20a420ab7d0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:30.852092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-59695153-615e-4ef7-8fb8-e35a53413d85 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:30.852936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-59695153-615e-4ef7-8fb8-e35a53413d85 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:30.860696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59695153-615e-4ef7-8fb8-e35a53413d85 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:30.861288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59695153-615e-4ef7-8fb8-e35a53413d85 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:30.862278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59695153-615e-4ef7-8fb8-e35a53413d85 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:30.865774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59695153-615e-4ef7-8fb8-e35a53413d85 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:31.007887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-29d70e2c-4cf3-42c0-9804-d20a420ab7d0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:31.020367 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-29d70e2c-4cf3-42c0-9804-d20a420ab7d0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1502 microversion: 2.1 time: 0.191251 Jul 14 15:37:31.024872 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 81/145] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:30 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1502 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:31.040564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-59695153-615e-4ef7-8fb8-e35a53413d85 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:31.052071 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-59695153-615e-4ef7-8fb8-e35a53413d85 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.204568 Jul 14 15:37:31.053307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 65/146] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:30 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:31.124583 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7a546adf-9793-457b-8983-8250dcadf00e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:31.125559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7a546adf-9793-457b-8983-8250dcadf00e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:31.132348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a546adf-9793-457b-8983-8250dcadf00e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:31.133086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a546adf-9793-457b-8983-8250dcadf00e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:31.134573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a546adf-9793-457b-8983-8250dcadf00e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:31.135221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a546adf-9793-457b-8983-8250dcadf00e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:31.180720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fe5134f3-ea6f-4264-809c-b4a2a8443e86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:31.181525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fe5134f3-ea6f-4264-809c-b4a2a8443e86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:31.194049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe5134f3-ea6f-4264-809c-b4a2a8443e86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:31.194975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe5134f3-ea6f-4264-809c-b4a2a8443e86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:31.196772 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe5134f3-ea6f-4264-809c-b4a2a8443e86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:31.197360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe5134f3-ea6f-4264-809c-b4a2a8443e86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:31.359712 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7a546adf-9793-457b-8983-8250dcadf00e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:31.370479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7a546adf-9793-457b-8983-8250dcadf00e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.251756 Jul 14 15:37:31.371137 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 82/147] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:31 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:31.405469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fe5134f3-ea6f-4264-809c-b4a2a8443e86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:31.416625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fe5134f3-ea6f-4264-809c-b4a2a8443e86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:31.418161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fe5134f3-ea6f-4264-809c-b4a2a8443e86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:31.419304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fe5134f3-ea6f-4264-809c-b4a2a8443e86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.250145 Jul 14 15:37:31.419893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 66/148] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:31 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:37:32.069628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-57e928c3-e0cb-4e34-92e0-5f481fe7d96e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:32.070795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-57e928c3-e0cb-4e34-92e0-5f481fe7d96e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:32.093229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-57e928c3-e0cb-4e34-92e0-5f481fe7d96e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:32.093948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-57e928c3-e0cb-4e34-92e0-5f481fe7d96e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:32.094900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-57e928c3-e0cb-4e34-92e0-5f481fe7d96e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:32.098273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-57e928c3-e0cb-4e34-92e0-5f481fe7d96e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:32.334702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-57e928c3-e0cb-4e34-92e0-5f481fe7d96e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:32.342451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-57e928c3-e0cb-4e34-92e0-5f481fe7d96e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.276538 Jul 14 15:37:32.343578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 83/149] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:32 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:32.391711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0ca7d214-32c0-42fd-b6bb-fa4c6ce807c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:32.393091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0ca7d214-32c0-42fd-b6bb-fa4c6ce807c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:32.413522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ca7d214-32c0-42fd-b6bb-fa4c6ce807c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:32.415424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ca7d214-32c0-42fd-b6bb-fa4c6ce807c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:32.417931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ca7d214-32c0-42fd-b6bb-fa4c6ce807c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:32.419145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ca7d214-32c0-42fd-b6bb-fa4c6ce807c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:32.438709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b3f5ae8d-df1d-45e3-beac-931611cec1ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:32.439341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b3f5ae8d-df1d-45e3-beac-931611cec1ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:32.446874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3f5ae8d-df1d-45e3-beac-931611cec1ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:32.447783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3f5ae8d-df1d-45e3-beac-931611cec1ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:32.448736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3f5ae8d-df1d-45e3-beac-931611cec1ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:32.449342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3f5ae8d-df1d-45e3-beac-931611cec1ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:32.635334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0ca7d214-32c0-42fd-b6bb-fa4c6ce807c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:32.644014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0ca7d214-32c0-42fd-b6bb-fa4c6ce807c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.259242 Jul 14 15:37:32.644593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 67/150] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:32 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:32.650868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-762aa29b-7274-48af-bd6a-a303c92dd4f6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9a4342b2-5fe4-41f2-976f-2aedcec2db26"}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:32.652197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-762aa29b-7274-48af-bd6a-a303c92dd4f6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:32.659416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-762aa29b-7274-48af-bd6a-a303c92dd4f6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:32.660304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-762aa29b-7274-48af-bd6a-a303c92dd4f6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:32.661373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-762aa29b-7274-48af-bd6a-a303c92dd4f6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:32.661960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-762aa29b-7274-48af-bd6a-a303c92dd4f6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:32.718067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b3f5ae8d-df1d-45e3-beac-931611cec1ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:32.731809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b3f5ae8d-df1d-45e3-beac-931611cec1ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:32.735331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b3f5ae8d-df1d-45e3-beac-931611cec1ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:32.737920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b3f5ae8d-df1d-45e3-beac-931611cec1ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.303795 Jul 14 15:37:32.738644 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 84/151] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:37:33.361372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fa4c92a5-9261-49f9-b12d-29357b20ef8d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:33.362013 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fa4c92a5-9261-49f9-b12d-29357b20ef8d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:33.369056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa4c92a5-9261-49f9-b12d-29357b20ef8d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:33.369505 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa4c92a5-9261-49f9-b12d-29357b20ef8d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:33.370267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa4c92a5-9261-49f9-b12d-29357b20ef8d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:33.370696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa4c92a5-9261-49f9-b12d-29357b20ef8d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:33.557574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fa4c92a5-9261-49f9-b12d-29357b20ef8d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:33.567547 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fa4c92a5-9261-49f9-b12d-29357b20ef8d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.210357 Jul 14 15:37:33.578541 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 85/152] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:33 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:33.662437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e620b1b3-1978-4dc8-8d3d-c6b3ad34f311 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:33.663650 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e620b1b3-1978-4dc8-8d3d-c6b3ad34f311 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:33.672188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e620b1b3-1978-4dc8-8d3d-c6b3ad34f311 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:33.673453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e620b1b3-1978-4dc8-8d3d-c6b3ad34f311 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:33.675296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e620b1b3-1978-4dc8-8d3d-c6b3ad34f311 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:33.676100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e620b1b3-1978-4dc8-8d3d-c6b3ad34f311 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:33.927073 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e620b1b3-1978-4dc8-8d3d-c6b3ad34f311 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:33.937945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e620b1b3-1978-4dc8-8d3d-c6b3ad34f311 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.279415 Jul 14 15:37:33.938709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 86/153] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:33 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:33.944178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ee497a7c-a34d-4d8b-8130-591aa6474e61 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:33.944787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ee497a7c-a34d-4d8b-8130-591aa6474e61 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:33.951628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ee497a7c-a34d-4d8b-8130-591aa6474e61 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:33.952687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ee497a7c-a34d-4d8b-8130-591aa6474e61 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:33.953605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ee497a7c-a34d-4d8b-8130-591aa6474e61 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:33.954058 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ee497a7c-a34d-4d8b-8130-591aa6474e61 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:34.186471 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ee497a7c-a34d-4d8b-8130-591aa6474e61 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:34.195140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ee497a7c-a34d-4d8b-8130-591aa6474e61 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:34.196881 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ee497a7c-a34d-4d8b-8130-591aa6474e61 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:34.198007 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ee497a7c-a34d-4d8b-8130-591aa6474e61 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.258486 Jul 14 15:37:34.198566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 87/154] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:33 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:34.584674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cb908886-0586-4334-99a6-6de9c910ea4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:34.585290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cb908886-0586-4334-99a6-6de9c910ea4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:34.603430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb908886-0586-4334-99a6-6de9c910ea4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:34.605436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb908886-0586-4334-99a6-6de9c910ea4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:34.607965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb908886-0586-4334-99a6-6de9c910ea4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:34.608521 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb908886-0586-4334-99a6-6de9c910ea4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:34.813747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cb908886-0586-4334-99a6-6de9c910ea4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:34.825167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cb908886-0586-4334-99a6-6de9c910ea4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.243972 Jul 14 15:37:34.826710 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 88/155] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:34 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:34.956542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-04d8a875-17d0-47d9-a8c4-1c7096c1550b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:34.957158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-04d8a875-17d0-47d9-a8c4-1c7096c1550b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:34.963080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04d8a875-17d0-47d9-a8c4-1c7096c1550b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:34.963535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04d8a875-17d0-47d9-a8c4-1c7096c1550b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:34.964351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04d8a875-17d0-47d9-a8c4-1c7096c1550b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:34.964786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04d8a875-17d0-47d9-a8c4-1c7096c1550b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:35.162073 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-04d8a875-17d0-47d9-a8c4-1c7096c1550b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:35.169564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-04d8a875-17d0-47d9-a8c4-1c7096c1550b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.218227 Jul 14 15:37:35.170139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 89/156] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:34 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:35.218517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-892f8706-ef6d-4ffd-aa51-ca2df7bbbf5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:35.219212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-892f8706-ef6d-4ffd-aa51-ca2df7bbbf5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:35.225280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-892f8706-ef6d-4ffd-aa51-ca2df7bbbf5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:35.225725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-892f8706-ef6d-4ffd-aa51-ca2df7bbbf5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:35.226478 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-892f8706-ef6d-4ffd-aa51-ca2df7bbbf5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:35.227066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-892f8706-ef6d-4ffd-aa51-ca2df7bbbf5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:35.377034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-892f8706-ef6d-4ffd-aa51-ca2df7bbbf5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:35.386694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-892f8706-ef6d-4ffd-aa51-ca2df7bbbf5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:35.388363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-892f8706-ef6d-4ffd-aa51-ca2df7bbbf5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:35.390501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-892f8706-ef6d-4ffd-aa51-ca2df7bbbf5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.176300 Jul 14 15:37:35.391076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 90/157] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:35 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:37:35.842783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1706cca5-63b5-4bfe-904a-deba83659982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:35.843810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1706cca5-63b5-4bfe-904a-deba83659982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:35.850185 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1706cca5-63b5-4bfe-904a-deba83659982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:35.850632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1706cca5-63b5-4bfe-904a-deba83659982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:35.851408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1706cca5-63b5-4bfe-904a-deba83659982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:35.851875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1706cca5-63b5-4bfe-904a-deba83659982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:36.001865 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1706cca5-63b5-4bfe-904a-deba83659982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:36.010727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1706cca5-63b5-4bfe-904a-deba83659982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.172231 Jul 14 15:37:36.011583 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 91/158] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:35 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:36.187802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1ac892b2-3f67-4e03-a1ee-fd70fed6dba3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:36.188401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1ac892b2-3f67-4e03-a1ee-fd70fed6dba3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:36.194658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1ac892b2-3f67-4e03-a1ee-fd70fed6dba3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:36.195113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1ac892b2-3f67-4e03-a1ee-fd70fed6dba3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:36.195932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1ac892b2-3f67-4e03-a1ee-fd70fed6dba3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:36.196369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1ac892b2-3f67-4e03-a1ee-fd70fed6dba3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:36.379105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1ac892b2-3f67-4e03-a1ee-fd70fed6dba3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:36.387044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1ac892b2-3f67-4e03-a1ee-fd70fed6dba3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.203674 Jul 14 15:37:36.387638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 92/159] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:36 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:36.409071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4adee4c1-e17f-4c6b-8331-f9fe0f505485 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:36.409718 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4adee4c1-e17f-4c6b-8331-f9fe0f505485 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:36.415804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4adee4c1-e17f-4c6b-8331-f9fe0f505485 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:36.416252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4adee4c1-e17f-4c6b-8331-f9fe0f505485 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:36.417001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4adee4c1-e17f-4c6b-8331-f9fe0f505485 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:36.417426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4adee4c1-e17f-4c6b-8331-f9fe0f505485 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:36.557288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4adee4c1-e17f-4c6b-8331-f9fe0f505485 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:36.566034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4adee4c1-e17f-4c6b-8331-f9fe0f505485 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:36.568017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4adee4c1-e17f-4c6b-8331-f9fe0f505485 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:36.569429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4adee4c1-e17f-4c6b-8331-f9fe0f505485 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.164680 Jul 14 15:37:36.570084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 93/160] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:36 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:37:37.028229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-144b6bf7-adb7-4546-bc7a-88dd17563d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:37.028902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-144b6bf7-adb7-4546-bc7a-88dd17563d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:37.035663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-144b6bf7-adb7-4546-bc7a-88dd17563d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:37.036118 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-144b6bf7-adb7-4546-bc7a-88dd17563d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:37.036884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-144b6bf7-adb7-4546-bc7a-88dd17563d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:37.037316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-144b6bf7-adb7-4546-bc7a-88dd17563d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:37.041535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:37.181813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-144b6bf7-adb7-4546-bc7a-88dd17563d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:37.190077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-144b6bf7-adb7-4546-bc7a-88dd17563d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.165733 Jul 14 15:37:37.190740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 94/161] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:37 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:37.408564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e880b445-f147-4dad-ac7c-ef08de5e06e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:37.409978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e880b445-f147-4dad-ac7c-ef08de5e06e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:37.416034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e880b445-f147-4dad-ac7c-ef08de5e06e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:37.416577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e880b445-f147-4dad-ac7c-ef08de5e06e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:37.417270 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e880b445-f147-4dad-ac7c-ef08de5e06e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:37.417700 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e880b445-f147-4dad-ac7c-ef08de5e06e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:37.550070 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e880b445-f147-4dad-ac7c-ef08de5e06e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:37.561021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e880b445-f147-4dad-ac7c-ef08de5e06e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.156338 Jul 14 15:37:37.561711 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 95/162] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:37 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:37.591672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8b36626e-518a-4332-89ff-fb1faf6d1623 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:37.593104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8b36626e-518a-4332-89ff-fb1faf6d1623 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:37.599190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8b36626e-518a-4332-89ff-fb1faf6d1623 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:37.599771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8b36626e-518a-4332-89ff-fb1faf6d1623 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:37.600785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8b36626e-518a-4332-89ff-fb1faf6d1623 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:37.601226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8b36626e-518a-4332-89ff-fb1faf6d1623 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:37.745470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8b36626e-518a-4332-89ff-fb1faf6d1623 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:37.753912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8b36626e-518a-4332-89ff-fb1faf6d1623 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:37.755350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8b36626e-518a-4332-89ff-fb1faf6d1623 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:37.756669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8b36626e-518a-4332-89ff-fb1faf6d1623 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.172913 Jul 14 15:37:37.757380 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 96/163] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:37 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:37:38.206816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d74360b2-1d21-43c6-a5c2-c1484eebce21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:38.207976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d74360b2-1d21-43c6-a5c2-c1484eebce21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:38.210111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:38.216713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d74360b2-1d21-43c6-a5c2-c1484eebce21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:38.217169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d74360b2-1d21-43c6-a5c2-c1484eebce21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:38.218624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d74360b2-1d21-43c6-a5c2-c1484eebce21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:38.219194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d74360b2-1d21-43c6-a5c2-c1484eebce21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:38.350862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d74360b2-1d21-43c6-a5c2-c1484eebce21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:38.359076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d74360b2-1d21-43c6-a5c2-c1484eebce21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.155710 Jul 14 15:37:38.359674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 97/164] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:38 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:38.578948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5e7d802f-60fd-4cc0-bf13-81bd0fcc2ff4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:38.581665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5e7d802f-60fd-4cc0-bf13-81bd0fcc2ff4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:38.590547 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5e7d802f-60fd-4cc0-bf13-81bd0fcc2ff4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:38.591068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5e7d802f-60fd-4cc0-bf13-81bd0fcc2ff4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:38.592412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5e7d802f-60fd-4cc0-bf13-81bd0fcc2ff4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:38.593062 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5e7d802f-60fd-4cc0-bf13-81bd0fcc2ff4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:38.740906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-762aa29b-7274-48af-bd6a-a303c92dd4f6 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "POST /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 6.093413 Jul 14 15:37:38.749319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 68/165] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 15:37:32 2022] POST /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac/os-volume_attachments => generated 194 bytes in 6101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:38.778406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8eceb1ac-f406-474f-b4b6-cef6d2af6f9f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:38.779118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8eceb1ac-f406-474f-b4b6-cef6d2af6f9f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:38.797256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8eceb1ac-f406-474f-b4b6-cef6d2af6f9f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:38.797707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8eceb1ac-f406-474f-b4b6-cef6d2af6f9f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:38.798476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8eceb1ac-f406-474f-b4b6-cef6d2af6f9f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:38.799405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8eceb1ac-f406-474f-b4b6-cef6d2af6f9f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:38.812851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5e7d802f-60fd-4cc0-bf13-81bd0fcc2ff4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:38.821836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5e7d802f-60fd-4cc0-bf13-81bd0fcc2ff4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.247959 Jul 14 15:37:38.829112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 98/166] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:38 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:38.970492 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8eceb1ac-f406-474f-b4b6-cef6d2af6f9f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:38.980214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8eceb1ac-f406-474f-b4b6-cef6d2af6f9f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:38.982069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8eceb1ac-f406-474f-b4b6-cef6d2af6f9f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:38.985683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8eceb1ac-f406-474f-b4b6-cef6d2af6f9f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.212325 Jul 14 15:37:38.985683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 69/167] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:39.379325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a09c1935-3c59-4de9-a863-434a00fae57b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:39.381103 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a09c1935-3c59-4de9-a863-434a00fae57b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:39.388066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a09c1935-3c59-4de9-a863-434a00fae57b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:39.388691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a09c1935-3c59-4de9-a863-434a00fae57b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:39.390361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a09c1935-3c59-4de9-a863-434a00fae57b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:39.391064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a09c1935-3c59-4de9-a863-434a00fae57b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:39.555234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a09c1935-3c59-4de9-a863-434a00fae57b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:39.564548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a09c1935-3c59-4de9-a863-434a00fae57b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.190961 Jul 14 15:37:39.565179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 99/168] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:39 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:39.846987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ddfabd81-12df-49ff-a10e-94b973c0c8cb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:39.847985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ddfabd81-12df-49ff-a10e-94b973c0c8cb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:39.855028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddfabd81-12df-49ff-a10e-94b973c0c8cb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:39.855567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddfabd81-12df-49ff-a10e-94b973c0c8cb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:39.856364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddfabd81-12df-49ff-a10e-94b973c0c8cb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:39.856801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddfabd81-12df-49ff-a10e-94b973c0c8cb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:39.990035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ddfabd81-12df-49ff-a10e-94b973c0c8cb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:39.997529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ddfabd81-12df-49ff-a10e-94b973c0c8cb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.155983 Jul 14 15:37:39.999682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 70/169] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:39 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:40.003390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-115c1c3c-0c06-43c6-882a-0e53d7e755db tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:40.004063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-115c1c3c-0c06-43c6-882a-0e53d7e755db tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:40.010134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-115c1c3c-0c06-43c6-882a-0e53d7e755db tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:40.010699 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-115c1c3c-0c06-43c6-882a-0e53d7e755db tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:40.011464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-115c1c3c-0c06-43c6-882a-0e53d7e755db tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:40.012397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-115c1c3c-0c06-43c6-882a-0e53d7e755db tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:40.144640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-115c1c3c-0c06-43c6-882a-0e53d7e755db tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:40.152906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-115c1c3c-0c06-43c6-882a-0e53d7e755db tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:40.154415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-115c1c3c-0c06-43c6-882a-0e53d7e755db tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:40.156069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-115c1c3c-0c06-43c6-882a-0e53d7e755db tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.156708 Jul 14 15:37:40.156712 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 100/170] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:39 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:37:40.582896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a8386bc7-53e9-4f76-8c8b-9bb245ed3d09 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:40.583505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a8386bc7-53e9-4f76-8c8b-9bb245ed3d09 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:40.593333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8386bc7-53e9-4f76-8c8b-9bb245ed3d09 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:40.594207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8386bc7-53e9-4f76-8c8b-9bb245ed3d09 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:40.595518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8386bc7-53e9-4f76-8c8b-9bb245ed3d09 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:40.596089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8386bc7-53e9-4f76-8c8b-9bb245ed3d09 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:40.730375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a8386bc7-53e9-4f76-8c8b-9bb245ed3d09 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:40.738568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a8386bc7-53e9-4f76-8c8b-9bb245ed3d09 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.159525 Jul 14 15:37:40.739146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 71/171] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:40 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:41.014342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a8db10f7-534d-4f4a-aabe-f44a49ce5a47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:41.015087 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a8db10f7-534d-4f4a-aabe-f44a49ce5a47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:41.021401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8db10f7-534d-4f4a-aabe-f44a49ce5a47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:41.021854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8db10f7-534d-4f4a-aabe-f44a49ce5a47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:41.022612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8db10f7-534d-4f4a-aabe-f44a49ce5a47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:41.023052 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8db10f7-534d-4f4a-aabe-f44a49ce5a47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:41.152319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a8db10f7-534d-4f4a-aabe-f44a49ce5a47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:41.160799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a8db10f7-534d-4f4a-aabe-f44a49ce5a47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.149884 Jul 14 15:37:41.161017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 101/172] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:41 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:41.176431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1a1b2038-1ec8-4951-a993-e8fc1c8e540b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:41.177042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1a1b2038-1ec8-4951-a993-e8fc1c8e540b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:41.185567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a1b2038-1ec8-4951-a993-e8fc1c8e540b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:41.186333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a1b2038-1ec8-4951-a993-e8fc1c8e540b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:41.187821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a1b2038-1ec8-4951-a993-e8fc1c8e540b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:41.188275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a1b2038-1ec8-4951-a993-e8fc1c8e540b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:41.331805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1a1b2038-1ec8-4951-a993-e8fc1c8e540b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:41.339971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1a1b2038-1ec8-4951-a993-e8fc1c8e540b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:41.341474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1a1b2038-1ec8-4951-a993-e8fc1c8e540b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:41.343242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1a1b2038-1ec8-4951-a993-e8fc1c8e540b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.172201 Jul 14 15:37:41.344021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 72/173] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:41 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:41.755037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b455b2a3-10d2-4b85-8868-3b0559cfa876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:41.755562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b455b2a3-10d2-4b85-8868-3b0559cfa876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:41.761871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b455b2a3-10d2-4b85-8868-3b0559cfa876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:41.762313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b455b2a3-10d2-4b85-8868-3b0559cfa876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:41.763131 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b455b2a3-10d2-4b85-8868-3b0559cfa876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:41.763502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b455b2a3-10d2-4b85-8868-3b0559cfa876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:41.898116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b455b2a3-10d2-4b85-8868-3b0559cfa876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:41.905464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b455b2a3-10d2-4b85-8868-3b0559cfa876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.154313 Jul 14 15:37:41.906024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 102/174] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:41 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:42.177805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2eca6b24-1537-4ae1-8a8b-25565e156d01 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:42.178615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2eca6b24-1537-4ae1-8a8b-25565e156d01 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:42.185117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2eca6b24-1537-4ae1-8a8b-25565e156d01 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:42.185570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2eca6b24-1537-4ae1-8a8b-25565e156d01 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:42.186992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2eca6b24-1537-4ae1-8a8b-25565e156d01 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:42.187429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2eca6b24-1537-4ae1-8a8b-25565e156d01 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:42.318525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2eca6b24-1537-4ae1-8a8b-25565e156d01 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:42.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2eca6b24-1537-4ae1-8a8b-25565e156d01 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.152074 Jul 14 15:37:42.326598 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 73/175] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:42 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:42.361326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c8f1b285-9d6f-4e1c-b985-59ec7d4008b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:42.361933 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c8f1b285-9d6f-4e1c-b985-59ec7d4008b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:42.367979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c8f1b285-9d6f-4e1c-b985-59ec7d4008b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:42.368427 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c8f1b285-9d6f-4e1c-b985-59ec7d4008b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:42.369183 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c8f1b285-9d6f-4e1c-b985-59ec7d4008b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:42.369615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c8f1b285-9d6f-4e1c-b985-59ec7d4008b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:42.496764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c8f1b285-9d6f-4e1c-b985-59ec7d4008b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:42.506180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c8f1b285-9d6f-4e1c-b985-59ec7d4008b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:42.507712 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c8f1b285-9d6f-4e1c-b985-59ec7d4008b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:42.508834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c8f1b285-9d6f-4e1c-b985-59ec7d4008b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.151896 Jul 14 15:37:42.519838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 103/176] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:42 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:42.613003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-5b625b07-8d5c-4330-a9db-c9405027e897 req-639f262e-d80c-4816-9fba-e32950430898 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c8cb95-bde5-4c91-99de-27aa44a822bf", "name": "network-vif-plugged", "status": "completed", "tag": "daed7bb6-45ad-49c9-829a-e0e2a0eca7f9"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:42.622057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-5b625b07-8d5c-4330-a9db-c9405027e897 req-639f262e-d80c-4816-9fba-e32950430898 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:42.622596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-5b625b07-8d5c-4330-a9db-c9405027e897 req-639f262e-d80c-4816-9fba-e32950430898 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:42.637224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-5b625b07-8d5c-4330-a9db-c9405027e897 req-639f262e-d80c-4816-9fba-e32950430898 service nova] Creating event network-vif-plugged:daed7bb6-45ad-49c9-829a-e0e2a0eca7f9 for instance e5c8cb95-bde5-4c91-99de-27aa44a822bf on hv-cinder-82651 Jul 14 15:37:42.643451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-5b625b07-8d5c-4330-a9db-c9405027e897 req-639f262e-d80c-4816-9fba-e32950430898 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034659 Jul 14 15:37:42.644138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 74/177] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:42.922287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0fd6d2fc-a431-4503-8ab6-42a49fac3ec0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:42.922892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0fd6d2fc-a431-4503-8ab6-42a49fac3ec0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:42.928958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0fd6d2fc-a431-4503-8ab6-42a49fac3ec0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:42.929418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0fd6d2fc-a431-4503-8ab6-42a49fac3ec0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:42.930212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0fd6d2fc-a431-4503-8ab6-42a49fac3ec0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:42.930652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0fd6d2fc-a431-4503-8ab6-42a49fac3ec0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:43.062748 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0fd6d2fc-a431-4503-8ab6-42a49fac3ec0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:43.070101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0fd6d2fc-a431-4503-8ab6-42a49fac3ec0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.152321 Jul 14 15:37:43.070666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 104/178] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:42 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:43.345264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-810cfacb-acdb-442d-b7a1-d4fd7f7bc10b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:43.345877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-810cfacb-acdb-442d-b7a1-d4fd7f7bc10b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:43.352633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-810cfacb-acdb-442d-b7a1-d4fd7f7bc10b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:43.353076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-810cfacb-acdb-442d-b7a1-d4fd7f7bc10b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:43.353826 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-810cfacb-acdb-442d-b7a1-d4fd7f7bc10b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:43.354255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-810cfacb-acdb-442d-b7a1-d4fd7f7bc10b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:43.487191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-810cfacb-acdb-442d-b7a1-d4fd7f7bc10b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:43.494699 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-810cfacb-acdb-442d-b7a1-d4fd7f7bc10b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.154706 Jul 14 15:37:43.495278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 75/179] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:43 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:43.526582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-32c61c1d-60ef-4bf7-984b-d0352a6b6760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:43.527257 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-32c61c1d-60ef-4bf7-984b-d0352a6b6760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:43.534067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32c61c1d-60ef-4bf7-984b-d0352a6b6760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:43.534817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32c61c1d-60ef-4bf7-984b-d0352a6b6760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:43.535304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32c61c1d-60ef-4bf7-984b-d0352a6b6760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:43.535775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32c61c1d-60ef-4bf7-984b-d0352a6b6760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:43.674759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-32c61c1d-60ef-4bf7-984b-d0352a6b6760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:43.682604 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-32c61c1d-60ef-4bf7-984b-d0352a6b6760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:43.684117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-32c61c1d-60ef-4bf7-984b-d0352a6b6760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:43.685208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-32c61c1d-60ef-4bf7-984b-d0352a6b6760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.162579 Jul 14 15:37:43.685990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 105/180] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:43 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:44.086245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c3c5959e-99cf-4abc-8df0-23d69a79830c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:44.086969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c3c5959e-99cf-4abc-8df0-23d69a79830c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:44.093178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3c5959e-99cf-4abc-8df0-23d69a79830c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:44.093506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3c5959e-99cf-4abc-8df0-23d69a79830c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:44.095903 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3c5959e-99cf-4abc-8df0-23d69a79830c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:44.095903 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3c5959e-99cf-4abc-8df0-23d69a79830c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:44.228077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c3c5959e-99cf-4abc-8df0-23d69a79830c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:44.235470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c3c5959e-99cf-4abc-8df0-23d69a79830c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.153090 Jul 14 15:37:44.236089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 76/181] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:44 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:44.514463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7caf5899-7240-4fd5-b1ce-de4a0ad60848 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:44.515555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7caf5899-7240-4fd5-b1ce-de4a0ad60848 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:44.534017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7caf5899-7240-4fd5-b1ce-de4a0ad60848 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:44.534620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7caf5899-7240-4fd5-b1ce-de4a0ad60848 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:44.535694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7caf5899-7240-4fd5-b1ce-de4a0ad60848 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:44.536237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7caf5899-7240-4fd5-b1ce-de4a0ad60848 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:44.704573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-665e894d-84e5-4cdb-8e79-b01dc66b7366 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:44.705803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-665e894d-84e5-4cdb-8e79-b01dc66b7366 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:44.716867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7caf5899-7240-4fd5-b1ce-de4a0ad60848 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:44.730273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7caf5899-7240-4fd5-b1ce-de4a0ad60848 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.222653 Jul 14 15:37:44.730872 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 106/182] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:44 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:44.733610 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-665e894d-84e5-4cdb-8e79-b01dc66b7366 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:44.734601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-665e894d-84e5-4cdb-8e79-b01dc66b7366 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:44.735236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-665e894d-84e5-4cdb-8e79-b01dc66b7366 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:44.735683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-665e894d-84e5-4cdb-8e79-b01dc66b7366 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:44.892687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-665e894d-84e5-4cdb-8e79-b01dc66b7366 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:44.902288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-665e894d-84e5-4cdb-8e79-b01dc66b7366 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:44.903837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-665e894d-84e5-4cdb-8e79-b01dc66b7366 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:44.905067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-665e894d-84e5-4cdb-8e79-b01dc66b7366 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.205414 Jul 14 15:37:44.906045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 77/183] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:37:45.253663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b0ade337-b79f-4868-a082-251e9c8396a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:45.254808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b0ade337-b79f-4868-a082-251e9c8396a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:45.263811 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0ade337-b79f-4868-a082-251e9c8396a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:45.265287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0ade337-b79f-4868-a082-251e9c8396a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:45.266267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0ade337-b79f-4868-a082-251e9c8396a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:45.266698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0ade337-b79f-4868-a082-251e9c8396a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:45.399151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b0ade337-b79f-4868-a082-251e9c8396a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:45.407850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b0ade337-b79f-4868-a082-251e9c8396a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1321 microversion: 2.1 time: 0.160425 Jul 14 15:37:45.408420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 107/184] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:45 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1321 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:45.746839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b38f6f36-652e-4161-830f-04ffa7d8c101 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:45.747444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b38f6f36-652e-4161-830f-04ffa7d8c101 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:45.754832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b38f6f36-652e-4161-830f-04ffa7d8c101 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:45.755279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b38f6f36-652e-4161-830f-04ffa7d8c101 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:45.756057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b38f6f36-652e-4161-830f-04ffa7d8c101 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:45.756495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b38f6f36-652e-4161-830f-04ffa7d8c101 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:45.894816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b38f6f36-652e-4161-830f-04ffa7d8c101 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:45.903563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b38f6f36-652e-4161-830f-04ffa7d8c101 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.160552 Jul 14 15:37:45.904356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 78/185] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:45 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:45.925097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-47734fb7-c98a-4384-8afe-e55f45a344c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:45.925703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-47734fb7-c98a-4384-8afe-e55f45a344c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:45.931733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-47734fb7-c98a-4384-8afe-e55f45a344c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:45.932178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-47734fb7-c98a-4384-8afe-e55f45a344c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:45.932932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-47734fb7-c98a-4384-8afe-e55f45a344c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:45.933364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-47734fb7-c98a-4384-8afe-e55f45a344c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:46.078008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-47734fb7-c98a-4384-8afe-e55f45a344c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:46.090781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-47734fb7-c98a-4384-8afe-e55f45a344c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:46.092421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-47734fb7-c98a-4384-8afe-e55f45a344c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:46.093633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-47734fb7-c98a-4384-8afe-e55f45a344c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.174313 Jul 14 15:37:46.094566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 108/186] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:45 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:46.305906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-e5015c9f-a0f5-4b6e-9490-aa960e4186c5 req-e8d060f2-5b58-4e4e-a786-41f35c9c3bfd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d96a86-d045-44b2-b298-75df12f65c86", "name": "network-vif-plugged", "status": "completed", "tag": "c5725421-8115-49e0-9dc8-6b9ccd639dcd"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:46.318756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-e5015c9f-a0f5-4b6e-9490-aa960e4186c5 req-e8d060f2-5b58-4e4e-a786-41f35c9c3bfd service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:46.319436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-e5015c9f-a0f5-4b6e-9490-aa960e4186c5 req-e8d060f2-5b58-4e4e-a786-41f35c9c3bfd service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:46.343916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-e5015c9f-a0f5-4b6e-9490-aa960e4186c5 req-e8d060f2-5b58-4e4e-a786-41f35c9c3bfd service nova] Creating event network-vif-plugged:c5725421-8115-49e0-9dc8-6b9ccd639dcd for instance f3d96a86-d045-44b2-b298-75df12f65c86 on hv-cinder-82651 Jul 14 15:37:46.348937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-e5015c9f-a0f5-4b6e-9490-aa960e4186c5 req-e8d060f2-5b58-4e4e-a786-41f35c9c3bfd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047976 Jul 14 15:37:46.350079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 79/187] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:37:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:37:46.425324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0e63bdef-97ce-41c7-9eb5-04bd01de3086 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:46.425873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0e63bdef-97ce-41c7-9eb5-04bd01de3086 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:46.435628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0e63bdef-97ce-41c7-9eb5-04bd01de3086 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:46.436821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0e63bdef-97ce-41c7-9eb5-04bd01de3086 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:46.438357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0e63bdef-97ce-41c7-9eb5-04bd01de3086 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:46.438755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0e63bdef-97ce-41c7-9eb5-04bd01de3086 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:46.595571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0e63bdef-97ce-41c7-9eb5-04bd01de3086 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:46.604384 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0e63bdef-97ce-41c7-9eb5-04bd01de3086 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1516 microversion: 2.1 time: 0.182933 Jul 14 15:37:46.604940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 109/188] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:46 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1516 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:46.633095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2aaaf649-1b26-428e-b00e-4d94192c91e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:37:46.634468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2aaaf649-1b26-428e-b00e-4d94192c91e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:46.641344 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2aaaf649-1b26-428e-b00e-4d94192c91e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:46.641861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2aaaf649-1b26-428e-b00e-4d94192c91e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:46.642958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2aaaf649-1b26-428e-b00e-4d94192c91e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:46.643448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2aaaf649-1b26-428e-b00e-4d94192c91e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:46.658371 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:46.671534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-2aaaf649-1b26-428e-b00e-4d94192c91e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'flavor' on Instance uuid 3264933c-e17b-494c-8d12-86fd9c3ad82d {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:37:46.793898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2aaaf649-1b26-428e-b00e-4d94192c91e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "POST /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d/action" status: 200 len: 32 microversion: 2.1 time: 0.174399 Jul 14 15:37:46.794577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 80/189] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 15:37:46 2022] POST /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d/action => generated 32 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:37:46.804098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e03758da-6fb2-420a-bebf-8cef19738149 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:46.804712 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e03758da-6fb2-420a-bebf-8cef19738149 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:46.810798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e03758da-6fb2-420a-bebf-8cef19738149 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:46.811906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e03758da-6fb2-420a-bebf-8cef19738149 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:46.812821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e03758da-6fb2-420a-bebf-8cef19738149 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:46.813265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e03758da-6fb2-420a-bebf-8cef19738149 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:46.921656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bbed8ccb-9f09-493f-b895-0e8c6e9e3fdd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:46.922499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bbed8ccb-9f09-493f-b895-0e8c6e9e3fdd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:46.930031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bbed8ccb-9f09-493f-b895-0e8c6e9e3fdd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:46.930532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bbed8ccb-9f09-493f-b895-0e8c6e9e3fdd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:46.931986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bbed8ccb-9f09-493f-b895-0e8c6e9e3fdd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:46.932512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bbed8ccb-9f09-493f-b895-0e8c6e9e3fdd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:46.981792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e03758da-6fb2-420a-bebf-8cef19738149 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:46.986054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:46.990934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e03758da-6fb2-420a-bebf-8cef19738149 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.190655 Jul 14 15:37:46.991514 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 110/190] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:46 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:47.069621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bbed8ccb-9f09-493f-b895-0e8c6e9e3fdd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:47.077245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bbed8ccb-9f09-493f-b895-0e8c6e9e3fdd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.160623 Jul 14 15:37:47.077825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 81/191] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:46 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:47.113380 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a99f3c97-5341-4dfa-8b88-39df0f92de45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:47.114057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a99f3c97-5341-4dfa-8b88-39df0f92de45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:47.120667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a99f3c97-5341-4dfa-8b88-39df0f92de45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:47.121120 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a99f3c97-5341-4dfa-8b88-39df0f92de45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:47.121886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a99f3c97-5341-4dfa-8b88-39df0f92de45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:47.122325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a99f3c97-5341-4dfa-8b88-39df0f92de45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:47.256002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a99f3c97-5341-4dfa-8b88-39df0f92de45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:47.264391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a99f3c97-5341-4dfa-8b88-39df0f92de45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:47.266005 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a99f3c97-5341-4dfa-8b88-39df0f92de45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:47.267206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a99f3c97-5341-4dfa-8b88-39df0f92de45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.158953 Jul 14 15:37:47.267893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 111/192] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:47 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:48.008122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5f6729d5-4748-450d-91ce-58622de6d65f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:48.008748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5f6729d5-4748-450d-91ce-58622de6d65f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:48.015948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f6729d5-4748-450d-91ce-58622de6d65f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:48.016405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f6729d5-4748-450d-91ce-58622de6d65f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:48.017173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f6729d5-4748-450d-91ce-58622de6d65f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:48.017616 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f6729d5-4748-450d-91ce-58622de6d65f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:48.093261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-80c543e3-9061-4f29-9c98-c53a13f5e944 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:48.093887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-80c543e3-9061-4f29-9c98-c53a13f5e944 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:48.100084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80c543e3-9061-4f29-9c98-c53a13f5e944 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:48.100543 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80c543e3-9061-4f29-9c98-c53a13f5e944 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:48.101310 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80c543e3-9061-4f29-9c98-c53a13f5e944 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:48.101751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80c543e3-9061-4f29-9c98-c53a13f5e944 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:48.157146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5f6729d5-4748-450d-91ce-58622de6d65f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:48.164754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5f6729d5-4748-450d-91ce-58622de6d65f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.160501 Jul 14 15:37:48.165338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 82/193] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:48 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:48.235306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-80c543e3-9061-4f29-9c98-c53a13f5e944 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:48.242828 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-80c543e3-9061-4f29-9c98-c53a13f5e944 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.153476 Jul 14 15:37:48.243390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 112/194] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:48 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:48.285804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3249ba75-cb39-455e-a905-eddc8ab35634 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:48.286332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3249ba75-cb39-455e-a905-eddc8ab35634 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:48.292265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3249ba75-cb39-455e-a905-eddc8ab35634 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:48.292704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3249ba75-cb39-455e-a905-eddc8ab35634 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:48.293441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3249ba75-cb39-455e-a905-eddc8ab35634 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:48.293873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3249ba75-cb39-455e-a905-eddc8ab35634 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:48.425839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3249ba75-cb39-455e-a905-eddc8ab35634 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:48.433684 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3249ba75-cb39-455e-a905-eddc8ab35634 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:48.435142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3249ba75-cb39-455e-a905-eddc8ab35634 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:48.436822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3249ba75-cb39-455e-a905-eddc8ab35634 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.154356 Jul 14 15:37:48.438355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 83/195] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:48 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:49.182647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fd436a5f-9086-43db-b540-c1b27b11b0db tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:49.183267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fd436a5f-9086-43db-b540-c1b27b11b0db tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:49.189972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd436a5f-9086-43db-b540-c1b27b11b0db tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:49.190431 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd436a5f-9086-43db-b540-c1b27b11b0db tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:49.191196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd436a5f-9086-43db-b540-c1b27b11b0db tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:49.191662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd436a5f-9086-43db-b540-c1b27b11b0db tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:49.260087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f0dedfda-af1b-47e5-b29a-38558ead1a98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:49.260621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f0dedfda-af1b-47e5-b29a-38558ead1a98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:49.267886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f0dedfda-af1b-47e5-b29a-38558ead1a98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:49.268340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f0dedfda-af1b-47e5-b29a-38558ead1a98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:49.269117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f0dedfda-af1b-47e5-b29a-38558ead1a98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:49.269557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f0dedfda-af1b-47e5-b29a-38558ead1a98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:49.328930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fd436a5f-9086-43db-b540-c1b27b11b0db tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:49.336448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fd436a5f-9086-43db-b540-c1b27b11b0db tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.157978 Jul 14 15:37:49.337020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 113/196] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:49 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:49.401236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f0dedfda-af1b-47e5-b29a-38558ead1a98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:49.408980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f0dedfda-af1b-47e5-b29a-38558ead1a98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.152775 Jul 14 15:37:49.409550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 84/197] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:49 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:49.455064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-35baeba3-cbce-4ec1-a02b-4d10a5c0a727 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:49.457347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-35baeba3-cbce-4ec1-a02b-4d10a5c0a727 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:49.463794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35baeba3-cbce-4ec1-a02b-4d10a5c0a727 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:49.464250 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35baeba3-cbce-4ec1-a02b-4d10a5c0a727 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:49.465010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35baeba3-cbce-4ec1-a02b-4d10a5c0a727 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:49.465647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35baeba3-cbce-4ec1-a02b-4d10a5c0a727 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:49.602828 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-35baeba3-cbce-4ec1-a02b-4d10a5c0a727 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:49.612189 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-35baeba3-cbce-4ec1-a02b-4d10a5c0a727 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:49.613677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-35baeba3-cbce-4ec1-a02b-4d10a5c0a727 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:49.614774 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-35baeba3-cbce-4ec1-a02b-4d10a5c0a727 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.164462 Jul 14 15:37:49.615321 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 114/198] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:49 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:50.354053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-947b04ea-c594-43c3-8c84-699a9a7a57a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:50.354656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-947b04ea-c594-43c3-8c84-699a9a7a57a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:50.361394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-947b04ea-c594-43c3-8c84-699a9a7a57a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:50.361831 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-947b04ea-c594-43c3-8c84-699a9a7a57a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:50.362579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-947b04ea-c594-43c3-8c84-699a9a7a57a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:50.363010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-947b04ea-c594-43c3-8c84-699a9a7a57a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:50.426000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-523bd4cb-3231-4a0a-935c-4a87634dab60 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:50.426737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-523bd4cb-3231-4a0a-935c-4a87634dab60 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:50.432912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-523bd4cb-3231-4a0a-935c-4a87634dab60 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:50.433434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-523bd4cb-3231-4a0a-935c-4a87634dab60 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:50.434191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-523bd4cb-3231-4a0a-935c-4a87634dab60 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:50.434625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-523bd4cb-3231-4a0a-935c-4a87634dab60 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:50.496909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-947b04ea-c594-43c3-8c84-699a9a7a57a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:50.505243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-947b04ea-c594-43c3-8c84-699a9a7a57a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.154936 Jul 14 15:37:50.506178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 85/199] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:50 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:50.588614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-523bd4cb-3231-4a0a-935c-4a87634dab60 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:50.597026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-523bd4cb-3231-4a0a-935c-4a87634dab60 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.174930 Jul 14 15:37:50.597591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 115/200] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:50 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:50.632429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-131f50b3-e93f-44ff-8428-4b7177eb0197 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:50.632967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-131f50b3-e93f-44ff-8428-4b7177eb0197 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:50.638923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-131f50b3-e93f-44ff-8428-4b7177eb0197 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:50.639935 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-131f50b3-e93f-44ff-8428-4b7177eb0197 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:50.640782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-131f50b3-e93f-44ff-8428-4b7177eb0197 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:50.641221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-131f50b3-e93f-44ff-8428-4b7177eb0197 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:50.772789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-131f50b3-e93f-44ff-8428-4b7177eb0197 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:50.780732 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-131f50b3-e93f-44ff-8428-4b7177eb0197 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:50.782220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-131f50b3-e93f-44ff-8428-4b7177eb0197 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:50.783308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-131f50b3-e93f-44ff-8428-4b7177eb0197 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.154852 Jul 14 15:37:50.783909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 86/201] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:50 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:51.524748 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2ea448ec-6d5b-4786-b2eb-d0e0481d9c8e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:51.525451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2ea448ec-6d5b-4786-b2eb-d0e0481d9c8e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:51.534523 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2ea448ec-6d5b-4786-b2eb-d0e0481d9c8e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:51.535165 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2ea448ec-6d5b-4786-b2eb-d0e0481d9c8e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:51.536090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2ea448ec-6d5b-4786-b2eb-d0e0481d9c8e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:51.536641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2ea448ec-6d5b-4786-b2eb-d0e0481d9c8e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:51.614657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-37e615b8-cf4e-49c4-a363-3b4230e73e66 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:51.615277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-37e615b8-cf4e-49c4-a363-3b4230e73e66 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:51.621799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37e615b8-cf4e-49c4-a363-3b4230e73e66 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:51.622729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37e615b8-cf4e-49c4-a363-3b4230e73e66 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:51.623786 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37e615b8-cf4e-49c4-a363-3b4230e73e66 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:51.624780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37e615b8-cf4e-49c4-a363-3b4230e73e66 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:51.677103 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2ea448ec-6d5b-4786-b2eb-d0e0481d9c8e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:51.684718 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2ea448ec-6d5b-4786-b2eb-d0e0481d9c8e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.164466 Jul 14 15:37:51.685292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 116/202] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:51 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:51.766458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37e615b8-cf4e-49c4-a363-3b4230e73e66 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:51.775113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-37e615b8-cf4e-49c4-a363-3b4230e73e66 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.163909 Jul 14 15:37:51.775573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 87/203] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:51 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:51.800885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f4b12ae9-dba0-44dc-b476-d0bd89d4eb6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:51.801492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f4b12ae9-dba0-44dc-b476-d0bd89d4eb6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:51.807742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4b12ae9-dba0-44dc-b476-d0bd89d4eb6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:51.809175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4b12ae9-dba0-44dc-b476-d0bd89d4eb6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:51.809943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4b12ae9-dba0-44dc-b476-d0bd89d4eb6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:51.810382 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4b12ae9-dba0-44dc-b476-d0bd89d4eb6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:51.956603 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f4b12ae9-dba0-44dc-b476-d0bd89d4eb6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:51.964804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f4b12ae9-dba0-44dc-b476-d0bd89d4eb6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:51.966318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f4b12ae9-dba0-44dc-b476-d0bd89d4eb6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:51.968909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f4b12ae9-dba0-44dc-b476-d0bd89d4eb6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.170671 Jul 14 15:37:51.968909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 117/204] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:51 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:52.704076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6059d3d6-91fe-4da8-8b80-4e15886d9555 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:52.704076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6059d3d6-91fe-4da8-8b80-4e15886d9555 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:52.710487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6059d3d6-91fe-4da8-8b80-4e15886d9555 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:52.710937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6059d3d6-91fe-4da8-8b80-4e15886d9555 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:52.711731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6059d3d6-91fe-4da8-8b80-4e15886d9555 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:52.712164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6059d3d6-91fe-4da8-8b80-4e15886d9555 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:52.792431 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e3caa32a-17bf-4580-8d7d-76bf42941fa9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:52.793146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e3caa32a-17bf-4580-8d7d-76bf42941fa9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:52.801234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e3caa32a-17bf-4580-8d7d-76bf42941fa9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:52.801737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e3caa32a-17bf-4580-8d7d-76bf42941fa9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:52.802586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e3caa32a-17bf-4580-8d7d-76bf42941fa9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:52.803145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e3caa32a-17bf-4580-8d7d-76bf42941fa9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:52.896296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6059d3d6-91fe-4da8-8b80-4e15886d9555 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:52.904124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6059d3d6-91fe-4da8-8b80-4e15886d9555 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.204951 Jul 14 15:37:52.912198 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 88/205] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:52 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:52.981679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e3caa32a-17bf-4580-8d7d-76bf42941fa9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:52.990017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e3caa32a-17bf-4580-8d7d-76bf42941fa9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.201396 Jul 14 15:37:52.990598 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 118/206] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:52 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:53.006907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-975f4cbd-f910-46d5-8097-18151466f23b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:53.007532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-975f4cbd-f910-46d5-8097-18151466f23b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:53.018765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-975f4cbd-f910-46d5-8097-18151466f23b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:53.019087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-975f4cbd-f910-46d5-8097-18151466f23b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:53.019975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-975f4cbd-f910-46d5-8097-18151466f23b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:53.020414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-975f4cbd-f910-46d5-8097-18151466f23b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:53.177438 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-975f4cbd-f910-46d5-8097-18151466f23b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:53.193567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-975f4cbd-f910-46d5-8097-18151466f23b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:53.195206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-975f4cbd-f910-46d5-8097-18151466f23b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:53.196251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-975f4cbd-f910-46d5-8097-18151466f23b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.214700 Jul 14 15:37:53.196802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 89/207] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:52 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:37:53.923992 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2e8f0110-3655-4114-91de-1ac91273012a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:53.924698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2e8f0110-3655-4114-91de-1ac91273012a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:53.930842 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2e8f0110-3655-4114-91de-1ac91273012a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:53.931292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2e8f0110-3655-4114-91de-1ac91273012a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:53.932107 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2e8f0110-3655-4114-91de-1ac91273012a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:53.932544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2e8f0110-3655-4114-91de-1ac91273012a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:54.008134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fb334df5-86fb-45da-9c9a-440bc02ad8f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:54.008747 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fb334df5-86fb-45da-9c9a-440bc02ad8f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:54.011214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=76 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:54.019529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb334df5-86fb-45da-9c9a-440bc02ad8f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:54.020007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb334df5-86fb-45da-9c9a-440bc02ad8f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:54.020796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb334df5-86fb-45da-9c9a-440bc02ad8f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:54.021483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb334df5-86fb-45da-9c9a-440bc02ad8f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:54.092134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2e8f0110-3655-4114-91de-1ac91273012a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:54.100585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2e8f0110-3655-4114-91de-1ac91273012a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.181399 Jul 14 15:37:54.112513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 119/208] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:53 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:54.198357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fb334df5-86fb-45da-9c9a-440bc02ad8f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:54.208757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fb334df5-86fb-45da-9c9a-440bc02ad8f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.204129 Jul 14 15:37:54.209985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 90/209] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:54 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:54.235769 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d49323e1-b8d7-4525-a836-31890c82dbd1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:54.236950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d49323e1-b8d7-4525-a836-31890c82dbd1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:54.248737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d49323e1-b8d7-4525-a836-31890c82dbd1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:54.250608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d49323e1-b8d7-4525-a836-31890c82dbd1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:54.252238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d49323e1-b8d7-4525-a836-31890c82dbd1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:54.253213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d49323e1-b8d7-4525-a836-31890c82dbd1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:54.427140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d49323e1-b8d7-4525-a836-31890c82dbd1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:54.435244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d49323e1-b8d7-4525-a836-31890c82dbd1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:54.437510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d49323e1-b8d7-4525-a836-31890c82dbd1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:54.438628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d49323e1-b8d7-4525-a836-31890c82dbd1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.216480 Jul 14 15:37:54.439194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 120/210] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:54 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:37:55.119801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fa6ef473-0fce-433f-8033-dabb84b8e002 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:55.120446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fa6ef473-0fce-433f-8033-dabb84b8e002 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:55.128124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa6ef473-0fce-433f-8033-dabb84b8e002 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:55.128587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa6ef473-0fce-433f-8033-dabb84b8e002 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:55.129365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa6ef473-0fce-433f-8033-dabb84b8e002 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:55.129801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa6ef473-0fce-433f-8033-dabb84b8e002 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:55.234917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1349d1e1-4065-4324-b0a9-d193870c8263 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:55.235526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1349d1e1-4065-4324-b0a9-d193870c8263 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:55.243162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1349d1e1-4065-4324-b0a9-d193870c8263 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:55.243904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1349d1e1-4065-4324-b0a9-d193870c8263 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:55.245617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1349d1e1-4065-4324-b0a9-d193870c8263 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:55.246393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1349d1e1-4065-4324-b0a9-d193870c8263 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:55.278395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fa6ef473-0fce-433f-8033-dabb84b8e002 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:55.289278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fa6ef473-0fce-433f-8033-dabb84b8e002 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.173304 Jul 14 15:37:55.291010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 91/211] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:55 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:55.419208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1349d1e1-4065-4324-b0a9-d193870c8263 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:55.427726 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1349d1e1-4065-4324-b0a9-d193870c8263 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.197171 Jul 14 15:37:55.428650 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 121/212] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:55 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:55.457824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7a30f4fc-b62a-4ac4-a737-a8cf8fc73efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:55.458727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7a30f4fc-b62a-4ac4-a737-a8cf8fc73efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:55.465306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a30f4fc-b62a-4ac4-a737-a8cf8fc73efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:55.465761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a30f4fc-b62a-4ac4-a737-a8cf8fc73efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:55.466528 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a30f4fc-b62a-4ac4-a737-a8cf8fc73efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:55.466969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a30f4fc-b62a-4ac4-a737-a8cf8fc73efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:55.603567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7a30f4fc-b62a-4ac4-a737-a8cf8fc73efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:55.613825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7a30f4fc-b62a-4ac4-a737-a8cf8fc73efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:55.615745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7a30f4fc-b62a-4ac4-a737-a8cf8fc73efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:55.616984 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7a30f4fc-b62a-4ac4-a737-a8cf8fc73efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.163289 Jul 14 15:37:55.617625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 92/213] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:55 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:37:56.307202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c62fa96c-0e05-43e4-94ba-80ee37f29858 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:56.307970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c62fa96c-0e05-43e4-94ba-80ee37f29858 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:56.316948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c62fa96c-0e05-43e4-94ba-80ee37f29858 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:56.317552 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c62fa96c-0e05-43e4-94ba-80ee37f29858 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:56.318488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c62fa96c-0e05-43e4-94ba-80ee37f29858 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:56.319204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c62fa96c-0e05-43e4-94ba-80ee37f29858 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:56.451712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b8338e4c-6ab9-4251-9f07-828ed54807e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:56.455168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b8338e4c-6ab9-4251-9f07-828ed54807e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:56.463840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8338e4c-6ab9-4251-9f07-828ed54807e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:56.464294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8338e4c-6ab9-4251-9f07-828ed54807e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:56.465775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8338e4c-6ab9-4251-9f07-828ed54807e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:56.466543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8338e4c-6ab9-4251-9f07-828ed54807e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:56.473315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c62fa96c-0e05-43e4-94ba-80ee37f29858 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:56.481605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c62fa96c-0e05-43e4-94ba-80ee37f29858 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.179091 Jul 14 15:37:56.482188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 122/214] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:56 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:56.630509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b8338e4c-6ab9-4251-9f07-828ed54807e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:56.635540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-452ed4b7-1a03-4252-9c27-cf9ded1c92c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:56.636241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-452ed4b7-1a03-4252-9c27-cf9ded1c92c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:56.638477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b8338e4c-6ab9-4251-9f07-828ed54807e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.195840 Jul 14 15:37:56.639136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 93/215] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:56 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:56.647701 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-452ed4b7-1a03-4252-9c27-cf9ded1c92c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:56.648152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-452ed4b7-1a03-4252-9c27-cf9ded1c92c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:56.648917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-452ed4b7-1a03-4252-9c27-cf9ded1c92c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:56.649542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-452ed4b7-1a03-4252-9c27-cf9ded1c92c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:56.985416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-452ed4b7-1a03-4252-9c27-cf9ded1c92c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:56.997459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-452ed4b7-1a03-4252-9c27-cf9ded1c92c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:56.999077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-452ed4b7-1a03-4252-9c27-cf9ded1c92c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:57.001442 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-452ed4b7-1a03-4252-9c27-cf9ded1c92c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.369302 Jul 14 15:37:57.002022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 123/216] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:56 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:57.499172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ddf8e028-6fa9-4f32-86bb-14b67d07065d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:57.499873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ddf8e028-6fa9-4f32-86bb-14b67d07065d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:57.506432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddf8e028-6fa9-4f32-86bb-14b67d07065d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:57.506877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddf8e028-6fa9-4f32-86bb-14b67d07065d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:57.507682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddf8e028-6fa9-4f32-86bb-14b67d07065d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:57.508114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddf8e028-6fa9-4f32-86bb-14b67d07065d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:57.645868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ddf8e028-6fa9-4f32-86bb-14b67d07065d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:57.654770 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ddf8e028-6fa9-4f32-86bb-14b67d07065d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.159284 Jul 14 15:37:57.656866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 94/217] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:57 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:57.657352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1811823d-862f-4136-97cd-18c7e1cc8ca5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:57.658002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1811823d-862f-4136-97cd-18c7e1cc8ca5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:57.664065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1811823d-862f-4136-97cd-18c7e1cc8ca5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:57.664993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1811823d-862f-4136-97cd-18c7e1cc8ca5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:57.665768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1811823d-862f-4136-97cd-18c7e1cc8ca5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:57.666207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1811823d-862f-4136-97cd-18c7e1cc8ca5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:57.805563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1811823d-862f-4136-97cd-18c7e1cc8ca5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:57.813629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1811823d-862f-4136-97cd-18c7e1cc8ca5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.160975 Jul 14 15:37:57.814186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 124/218] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:57 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:58.019116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-61e34cc6-da57-46eb-b786-329244158fcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:58.019767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-61e34cc6-da57-46eb-b786-329244158fcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:58.026002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61e34cc6-da57-46eb-b786-329244158fcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:58.026452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61e34cc6-da57-46eb-b786-329244158fcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:58.027205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61e34cc6-da57-46eb-b786-329244158fcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:58.027661 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61e34cc6-da57-46eb-b786-329244158fcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:58.033856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:37:58.168400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-61e34cc6-da57-46eb-b786-329244158fcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:58.177538 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-61e34cc6-da57-46eb-b786-329244158fcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:58.179084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-61e34cc6-da57-46eb-b786-329244158fcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:58.180697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-61e34cc6-da57-46eb-b786-329244158fcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1405 microversion: 2.20 time: 0.166261 Jul 14 15:37:58.181307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 95/219] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:58 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1405 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:58.674163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3afd127c-f431-49df-a87d-62aff0e49e5f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:58.674890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3afd127c-f431-49df-a87d-62aff0e49e5f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:58.681055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3afd127c-f431-49df-a87d-62aff0e49e5f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:58.681507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3afd127c-f431-49df-a87d-62aff0e49e5f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:58.682276 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3afd127c-f431-49df-a87d-62aff0e49e5f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:58.682789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3afd127c-f431-49df-a87d-62aff0e49e5f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:58.818990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3afd127c-f431-49df-a87d-62aff0e49e5f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:58.827148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3afd127c-f431-49df-a87d-62aff0e49e5f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.158091 Jul 14 15:37:58.828434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 125/220] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:58 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:37:58.831138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d9dcacba-286d-4762-bcc6-6e99632cf56c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:58.831879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d9dcacba-286d-4762-bcc6-6e99632cf56c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:58.838340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d9dcacba-286d-4762-bcc6-6e99632cf56c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:58.838788 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d9dcacba-286d-4762-bcc6-6e99632cf56c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:58.839562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d9dcacba-286d-4762-bcc6-6e99632cf56c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:58.840023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d9dcacba-286d-4762-bcc6-6e99632cf56c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:59.032119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d9dcacba-286d-4762-bcc6-6e99632cf56c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:59.040165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d9dcacba-286d-4762-bcc6-6e99632cf56c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.213683 Jul 14 15:37:59.041353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 96/221] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:58 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:37:59.199736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-83a71107-e213-43ef-b848-3937cd5fc382 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:59.200256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-83a71107-e213-43ef-b848-3937cd5fc382 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:59.207360 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83a71107-e213-43ef-b848-3937cd5fc382 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:59.207847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83a71107-e213-43ef-b848-3937cd5fc382 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:59.208797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83a71107-e213-43ef-b848-3937cd5fc382 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:59.209228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83a71107-e213-43ef-b848-3937cd5fc382 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:59.350283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-83a71107-e213-43ef-b848-3937cd5fc382 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:59.358559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-83a71107-e213-43ef-b848-3937cd5fc382 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:59.361143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-83a71107-e213-43ef-b848-3937cd5fc382 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:37:59.362037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-83a71107-e213-43ef-b848-3937cd5fc382 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1597 microversion: 2.20 time: 0.166275 Jul 14 15:37:59.362591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 126/222] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:37:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1597 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:37:59.380632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-75560101-e238-48fa-917d-f19a7cbc85e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:59.381124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-75560101-e238-48fa-917d-f19a7cbc85e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:59.387094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-75560101-e238-48fa-917d-f19a7cbc85e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:59.387553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-75560101-e238-48fa-917d-f19a7cbc85e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:59.389252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-75560101-e238-48fa-917d-f19a7cbc85e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:59.389252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-75560101-e238-48fa-917d-f19a7cbc85e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:59.488002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-75560101-e238-48fa-917d-f19a7cbc85e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111371 Jul 14 15:37:59.489003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 97/223] 10.222.0.99 () {60 vars in 1315 bytes} [Thu Jul 14 15:37:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:37:59.846371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9309350c-01b8-4476-bac2-056f9bca347e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:37:59.846995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9309350c-01b8-4476-bac2-056f9bca347e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:37:59.860986 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9309350c-01b8-4476-bac2-056f9bca347e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:59.861448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9309350c-01b8-4476-bac2-056f9bca347e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:59.862196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9309350c-01b8-4476-bac2-056f9bca347e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:37:59.862634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9309350c-01b8-4476-bac2-056f9bca347e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:37:59.882532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:00.015451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9309350c-01b8-4476-bac2-056f9bca347e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:00.023716 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9309350c-01b8-4476-bac2-056f9bca347e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.181779 Jul 14 15:38:00.024422 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 127/224] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:37:59 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:00.060674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-abfaa420-b588-46b3-9db2-dd73dffda463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:00.061297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-abfaa420-b588-46b3-9db2-dd73dffda463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:00.074077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abfaa420-b588-46b3-9db2-dd73dffda463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:00.074544 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abfaa420-b588-46b3-9db2-dd73dffda463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:00.075319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abfaa420-b588-46b3-9db2-dd73dffda463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:00.075791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abfaa420-b588-46b3-9db2-dd73dffda463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:00.446080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-abfaa420-b588-46b3-9db2-dd73dffda463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:00.457134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-abfaa420-b588-46b3-9db2-dd73dffda463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.400202 Jul 14 15:38:00.458187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 98/225] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:00 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:01.043427 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-227a9b62-6bcb-4e77-9d16-c0a53be4bce8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:01.044711 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-227a9b62-6bcb-4e77-9d16-c0a53be4bce8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:01.059749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-227a9b62-6bcb-4e77-9d16-c0a53be4bce8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:01.061087 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-227a9b62-6bcb-4e77-9d16-c0a53be4bce8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:01.061899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-227a9b62-6bcb-4e77-9d16-c0a53be4bce8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:01.069803 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-227a9b62-6bcb-4e77-9d16-c0a53be4bce8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:01.328411 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-227a9b62-6bcb-4e77-9d16-c0a53be4bce8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:01.339500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-227a9b62-6bcb-4e77-9d16-c0a53be4bce8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.301010 Jul 14 15:38:01.340775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 128/226] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:01 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:01.364281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-21e0748d-e35d-4431-a633-17bff8563a0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:01.364788 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-21e0748d-e35d-4431-a633-17bff8563a0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:01.377397 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-21e0748d-e35d-4431-a633-17bff8563a0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:01.377858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-21e0748d-e35d-4431-a633-17bff8563a0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:01.380903 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-21e0748d-e35d-4431-a633-17bff8563a0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:01.381358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-21e0748d-e35d-4431-a633-17bff8563a0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:01.390228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-21025bbd-960f-47e8-a007-bb51ecb84769 req-fa4d0206-1934-40ad-a903-41cc21a8a23f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e5c8cb95-bde5-4c91-99de-27aa44a822bf", "tag": "daed7bb6-45ad-49c9-829a-e0e2a0eca7f9"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:01.408563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-21025bbd-960f-47e8-a007-bb51ecb84769 req-fa4d0206-1934-40ad-a903-41cc21a8a23f service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:01.409068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-21025bbd-960f-47e8-a007-bb51ecb84769 req-fa4d0206-1934-40ad-a903-41cc21a8a23f service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:01.436294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-21025bbd-960f-47e8-a007-bb51ecb84769 req-fa4d0206-1934-40ad-a903-41cc21a8a23f service nova] Creating event network-changed:daed7bb6-45ad-49c9-829a-e0e2a0eca7f9 for instance e5c8cb95-bde5-4c91-99de-27aa44a822bf on hv-cinder-82651 Jul 14 15:38:01.445518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-21e0748d-e35d-4431-a633-17bff8563a0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Going to try to terminate instance {{(pid=124503) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:38:01.451912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-21025bbd-960f-47e8-a007-bb51ecb84769 req-fa4d0206-1934-40ad-a903-41cc21a8a23f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.061248 Jul 14 15:38:01.453425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 129/227] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:38:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:38:01.476030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3259c251-309a-457f-96d3-cec66042c4b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:01.476903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3259c251-309a-457f-96d3-cec66042c4b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:01.484934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3259c251-309a-457f-96d3-cec66042c4b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:01.485652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3259c251-309a-457f-96d3-cec66042c4b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:01.486596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3259c251-309a-457f-96d3-cec66042c4b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:01.487363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3259c251-309a-457f-96d3-cec66042c4b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:01.600358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-21e0748d-e35d-4431-a633-17bff8563a0c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "DELETE /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 204 len: 0 microversion: 2.1 time: 0.242380 Jul 14 15:38:01.601083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 99/228] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 15:38:01 2022] DELETE /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 0 bytes in 244 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:38:01.609809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-45fe0309-3ca5-4e15-ba32-4fe007498514 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:01.610659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-45fe0309-3ca5-4e15-ba32-4fe007498514 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:01.616832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45fe0309-3ca5-4e15-ba32-4fe007498514 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:01.617461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45fe0309-3ca5-4e15-ba32-4fe007498514 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:01.618399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45fe0309-3ca5-4e15-ba32-4fe007498514 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:01.618975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45fe0309-3ca5-4e15-ba32-4fe007498514 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:01.681373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3259c251-309a-457f-96d3-cec66042c4b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:01.690103 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3259c251-309a-457f-96d3-cec66042c4b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.218885 Jul 14 15:38:01.691024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 130/229] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:01 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:01.778332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-45fe0309-3ca5-4e15-ba32-4fe007498514 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:01.788392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-45fe0309-3ca5-4e15-ba32-4fe007498514 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1554 microversion: 2.1 time: 0.183003 Jul 14 15:38:01.792661 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 100/230] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:01 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1554 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:02.357708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f4052dae-3d80-403d-8f3f-0d1b81c53266 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:02.358555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f4052dae-3d80-403d-8f3f-0d1b81c53266 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:02.365123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4052dae-3d80-403d-8f3f-0d1b81c53266 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:02.365846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4052dae-3d80-403d-8f3f-0d1b81c53266 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:02.366614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4052dae-3d80-403d-8f3f-0d1b81c53266 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:02.367230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4052dae-3d80-403d-8f3f-0d1b81c53266 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:02.533977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f4052dae-3d80-403d-8f3f-0d1b81c53266 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:02.542468 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f4052dae-3d80-403d-8f3f-0d1b81c53266 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.189006 Jul 14 15:38:02.543066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 131/231] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:02 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:02.707100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-852657ce-c909-49dc-ad13-46f6183a77e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:02.707928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-852657ce-c909-49dc-ad13-46f6183a77e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:02.715087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-852657ce-c909-49dc-ad13-46f6183a77e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:02.715862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-852657ce-c909-49dc-ad13-46f6183a77e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:02.716812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-852657ce-c909-49dc-ad13-46f6183a77e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:02.717415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-852657ce-c909-49dc-ad13-46f6183a77e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:02.805679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7b7e53c9-ff79-436a-ba35-5a4d95ee5e00 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:02.806438 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7b7e53c9-ff79-436a-ba35-5a4d95ee5e00 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:02.818000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b7e53c9-ff79-436a-ba35-5a4d95ee5e00 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:02.818714 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b7e53c9-ff79-436a-ba35-5a4d95ee5e00 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:02.819531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b7e53c9-ff79-436a-ba35-5a4d95ee5e00 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:02.820125 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b7e53c9-ff79-436a-ba35-5a4d95ee5e00 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:02.877582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-852657ce-c909-49dc-ad13-46f6183a77e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:02.885442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-852657ce-c909-49dc-ad13-46f6183a77e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1363 microversion: 2.1 time: 0.182987 Jul 14 15:38:02.886256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 101/232] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:02 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1363 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:02.980896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7b7e53c9-ff79-436a-ba35-5a4d95ee5e00 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:02.996018 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7b7e53c9-ff79-436a-ba35-5a4d95ee5e00 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1554 microversion: 2.1 time: 0.194139 Jul 14 15:38:03.000682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 132/233] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:02 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:03.561004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-69ae14d7-70e6-4d76-b6e1-ac02f44d62f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:03.561560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-69ae14d7-70e6-4d76-b6e1-ac02f44d62f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:03.569122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69ae14d7-70e6-4d76-b6e1-ac02f44d62f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:03.569486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69ae14d7-70e6-4d76-b6e1-ac02f44d62f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:03.570461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69ae14d7-70e6-4d76-b6e1-ac02f44d62f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:03.571056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69ae14d7-70e6-4d76-b6e1-ac02f44d62f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:03.712573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-69ae14d7-70e6-4d76-b6e1-ac02f44d62f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:03.720123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-69ae14d7-70e6-4d76-b6e1-ac02f44d62f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.163624 Jul 14 15:38:03.720695 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 102/234] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:03 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:03.902717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fa6b1e64-4c45-44ed-8b16-c68101166de4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:03.903329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fa6b1e64-4c45-44ed-8b16-c68101166de4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:03.910150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa6b1e64-4c45-44ed-8b16-c68101166de4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:03.910591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa6b1e64-4c45-44ed-8b16-c68101166de4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:03.911341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa6b1e64-4c45-44ed-8b16-c68101166de4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:03.911851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa6b1e64-4c45-44ed-8b16-c68101166de4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:04.017086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5ae62f46-66d8-479d-adee-34362dbda9ca tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:04.017699 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5ae62f46-66d8-479d-adee-34362dbda9ca tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:04.024512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ae62f46-66d8-479d-adee-34362dbda9ca tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:04.024961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ae62f46-66d8-479d-adee-34362dbda9ca tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:04.025725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ae62f46-66d8-479d-adee-34362dbda9ca tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:04.026165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ae62f46-66d8-479d-adee-34362dbda9ca tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:04.046094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fa6b1e64-4c45-44ed-8b16-c68101166de4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:04.054075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fa6b1e64-4c45-44ed-8b16-c68101166de4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1548 microversion: 2.1 time: 0.155294 Jul 14 15:38:04.054658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 133/235] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:03 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1548 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:04.071725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cc5b5517-8f12-45af-a2ab-626f51a93e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:04.072308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cc5b5517-8f12-45af-a2ab-626f51a93e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:04.078827 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc5b5517-8f12-45af-a2ab-626f51a93e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:04.079691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc5b5517-8f12-45af-a2ab-626f51a93e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:04.080608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc5b5517-8f12-45af-a2ab-626f51a93e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:04.081293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc5b5517-8f12-45af-a2ab-626f51a93e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:04.171940 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5ae62f46-66d8-479d-adee-34362dbda9ca tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:04.180949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5ae62f46-66d8-479d-adee-34362dbda9ca tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1554 microversion: 2.1 time: 0.167826 Jul 14 15:38:04.181531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 103/236] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:04 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1554 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:04.201133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cc5b5517-8f12-45af-a2ab-626f51a93e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.133294 Jul 14 15:38:04.201768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 134/237] 10.222.0.99 () {58 vars in 1274 bytes} [Thu Jul 14 15:38:04 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-interface => generated 284 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:38:04.736954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1b56d312-ae05-41d1-8ae4-d67a77e9e876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:04.737513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1b56d312-ae05-41d1-8ae4-d67a77e9e876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:04.743658 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b56d312-ae05-41d1-8ae4-d67a77e9e876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:04.744113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b56d312-ae05-41d1-8ae4-d67a77e9e876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:04.745007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b56d312-ae05-41d1-8ae4-d67a77e9e876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:04.745448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b56d312-ae05-41d1-8ae4-d67a77e9e876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:04.881533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1b56d312-ae05-41d1-8ae4-d67a77e9e876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:04.889569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1b56d312-ae05-41d1-8ae4-d67a77e9e876 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.156536 Jul 14 15:38:04.890685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 104/238] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:04 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:05.199542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-55b3ab10-4ed1-42f2-8d89-0057b2f34b59 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:05.200295 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-55b3ab10-4ed1-42f2-8d89-0057b2f34b59 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:05.207534 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55b3ab10-4ed1-42f2-8d89-0057b2f34b59 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:05.208129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55b3ab10-4ed1-42f2-8d89-0057b2f34b59 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:05.208971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55b3ab10-4ed1-42f2-8d89-0057b2f34b59 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:05.209479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55b3ab10-4ed1-42f2-8d89-0057b2f34b59 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:05.445900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-55b3ab10-4ed1-42f2-8d89-0057b2f34b59 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:05.454296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-55b3ab10-4ed1-42f2-8d89-0057b2f34b59 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1554 microversion: 2.1 time: 0.258672 Jul 14 15:38:05.454866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 135/239] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:05 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1554 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:05.612464 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-f6ff23ca-7708-4c47-983e-79675d53211f req-04f48383-a1f0-4d3f-b39c-167462144935 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f3d96a86-d045-44b2-b298-75df12f65c86", "tag": "c5725421-8115-49e0-9dc8-6b9ccd639dcd"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:05.620994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-f6ff23ca-7708-4c47-983e-79675d53211f req-04f48383-a1f0-4d3f-b39c-167462144935 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:05.621428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-f6ff23ca-7708-4c47-983e-79675d53211f req-04f48383-a1f0-4d3f-b39c-167462144935 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:05.632254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-f6ff23ca-7708-4c47-983e-79675d53211f req-04f48383-a1f0-4d3f-b39c-167462144935 service nova] Creating event network-changed:c5725421-8115-49e0-9dc8-6b9ccd639dcd for instance f3d96a86-d045-44b2-b298-75df12f65c86 on hv-cinder-82651 Jul 14 15:38:05.637435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-f6ff23ca-7708-4c47-983e-79675d53211f req-04f48383-a1f0-4d3f-b39c-167462144935 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028522 Jul 14 15:38:05.638042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 105/240] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:38:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:38:05.908480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-54ac1f7c-d8d0-4aac-9522-55eeff4e6993 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:05.909099 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-54ac1f7c-d8d0-4aac-9522-55eeff4e6993 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:05.915325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-54ac1f7c-d8d0-4aac-9522-55eeff4e6993 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:05.915807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-54ac1f7c-d8d0-4aac-9522-55eeff4e6993 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:05.916579 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-54ac1f7c-d8d0-4aac-9522-55eeff4e6993 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:05.917020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-54ac1f7c-d8d0-4aac-9522-55eeff4e6993 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:06.049607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-54ac1f7c-d8d0-4aac-9522-55eeff4e6993 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:06.057110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-54ac1f7c-d8d0-4aac-9522-55eeff4e6993 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.153189 Jul 14 15:38:06.057681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 136/241] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:05 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:06.472385 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f580b825-1ae4-4fce-abaa-d403c8214781 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:06.473083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f580b825-1ae4-4fce-abaa-d403c8214781 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:06.479340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f580b825-1ae4-4fce-abaa-d403c8214781 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:06.479842 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f580b825-1ae4-4fce-abaa-d403c8214781 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:06.480603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f580b825-1ae4-4fce-abaa-d403c8214781 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:06.481036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f580b825-1ae4-4fce-abaa-d403c8214781 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:06.618350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f580b825-1ae4-4fce-abaa-d403c8214781 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:06.627005 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f580b825-1ae4-4fce-abaa-d403c8214781 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1554 microversion: 2.1 time: 0.159221 Jul 14 15:38:06.627811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 106/242] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:06 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:07.074392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cf0ed55e-b487-40d2-80af-3dffd178b4d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:07.075202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cf0ed55e-b487-40d2-80af-3dffd178b4d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:07.082540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf0ed55e-b487-40d2-80af-3dffd178b4d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:07.083240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf0ed55e-b487-40d2-80af-3dffd178b4d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:07.084653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf0ed55e-b487-40d2-80af-3dffd178b4d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:07.085546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf0ed55e-b487-40d2-80af-3dffd178b4d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:07.236207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cf0ed55e-b487-40d2-80af-3dffd178b4d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:07.246818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cf0ed55e-b487-40d2-80af-3dffd178b4d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.176220 Jul 14 15:38:07.247402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 137/243] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:07 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:07.644327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-597b2698-105c-46da-bc10-d68ad26db449 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:07.644964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-597b2698-105c-46da-bc10-d68ad26db449 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:07.651575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-597b2698-105c-46da-bc10-d68ad26db449 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:07.652043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-597b2698-105c-46da-bc10-d68ad26db449 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:07.652791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-597b2698-105c-46da-bc10-d68ad26db449 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:07.653215 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-597b2698-105c-46da-bc10-d68ad26db449 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:07.792262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-597b2698-105c-46da-bc10-d68ad26db449 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:07.800774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-597b2698-105c-46da-bc10-d68ad26db449 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1554 microversion: 2.1 time: 0.160637 Jul 14 15:38:07.801633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 107/244] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:07 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:08.265153 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7dbdde64-21e3-4785-9ef6-48a19e2cc878 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:08.265753 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7dbdde64-21e3-4785-9ef6-48a19e2cc878 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:08.267875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=82 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:08.273940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7dbdde64-21e3-4785-9ef6-48a19e2cc878 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:08.274394 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7dbdde64-21e3-4785-9ef6-48a19e2cc878 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:08.275168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7dbdde64-21e3-4785-9ef6-48a19e2cc878 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:08.275625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7dbdde64-21e3-4785-9ef6-48a19e2cc878 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:08.419663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7dbdde64-21e3-4785-9ef6-48a19e2cc878 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:08.426816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7dbdde64-21e3-4785-9ef6-48a19e2cc878 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.165926 Jul 14 15:38:08.430926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 138/245] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:08 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:08.819558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b54d36ae-813c-4be7-b5dc-f7a81262b778 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:08.820167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b54d36ae-813c-4be7-b5dc-f7a81262b778 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:08.827070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b54d36ae-813c-4be7-b5dc-f7a81262b778 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:08.827585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b54d36ae-813c-4be7-b5dc-f7a81262b778 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:08.829145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b54d36ae-813c-4be7-b5dc-f7a81262b778 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:08.829682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b54d36ae-813c-4be7-b5dc-f7a81262b778 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:08.981302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b54d36ae-813c-4be7-b5dc-f7a81262b778 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:08.990308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b54d36ae-813c-4be7-b5dc-f7a81262b778 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1554 microversion: 2.1 time: 0.174963 Jul 14 15:38:08.990891 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 108/246] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:08 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1554 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:09.445457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-babc99ab-036a-4cf0-855e-d9a3f58fb794 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:09.446256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-babc99ab-036a-4cf0-855e-d9a3f58fb794 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:09.453208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-babc99ab-036a-4cf0-855e-d9a3f58fb794 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:09.454285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-babc99ab-036a-4cf0-855e-d9a3f58fb794 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:09.455133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-babc99ab-036a-4cf0-855e-d9a3f58fb794 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:09.455576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-babc99ab-036a-4cf0-855e-d9a3f58fb794 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:09.597416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-babc99ab-036a-4cf0-855e-d9a3f58fb794 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:09.605379 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-babc99ab-036a-4cf0-855e-d9a3f58fb794 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.163737 Jul 14 15:38:09.605962 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 139/247] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:09 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:10.008648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f4fa910b-5c4e-4f6d-9fcf-f04ce40bf505 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:10.009279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f4fa910b-5c4e-4f6d-9fcf-f04ce40bf505 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:10.015759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4fa910b-5c4e-4f6d-9fcf-f04ce40bf505 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:10.016956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4fa910b-5c4e-4f6d-9fcf-f04ce40bf505 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:10.017933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4fa910b-5c4e-4f6d-9fcf-f04ce40bf505 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:10.018458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4fa910b-5c4e-4f6d-9fcf-f04ce40bf505 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:10.304022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f4fa910b-5c4e-4f6d-9fcf-f04ce40bf505 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:10.316068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f4fa910b-5c4e-4f6d-9fcf-f04ce40bf505 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1554 microversion: 2.1 time: 0.311436 Jul 14 15:38:10.316653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 109/248] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:10 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1554 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:10.623011 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-874c0b25-bc66-4c95-a738-b491e9446d25 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:10.623882 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-874c0b25-bc66-4c95-a738-b491e9446d25 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:10.631854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-874c0b25-bc66-4c95-a738-b491e9446d25 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:10.632305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-874c0b25-bc66-4c95-a738-b491e9446d25 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:10.633072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-874c0b25-bc66-4c95-a738-b491e9446d25 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:10.633562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-874c0b25-bc66-4c95-a738-b491e9446d25 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:10.929115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-874c0b25-bc66-4c95-a738-b491e9446d25 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:10.964181 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-874c0b25-bc66-4c95-a738-b491e9446d25 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.344949 Jul 14 15:38:10.966805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 140/249] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:10 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:11.334073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-296cdc6d-5ac7-44a6-a309-f76b221dbac4 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:11.335319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-296cdc6d-5ac7-44a6-a309-f76b221dbac4 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:11.346583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-296cdc6d-5ac7-44a6-a309-f76b221dbac4 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:11.348348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-296cdc6d-5ac7-44a6-a309-f76b221dbac4 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:11.349067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-296cdc6d-5ac7-44a6-a309-f76b221dbac4 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:11.349853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-296cdc6d-5ac7-44a6-a309-f76b221dbac4 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:11.729470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-296cdc6d-5ac7-44a6-a309-f76b221dbac4 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:11.738870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-296cdc6d-5ac7-44a6-a309-f76b221dbac4 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1554 microversion: 2.1 time: 0.410234 Jul 14 15:38:11.740428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 110/250] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:11 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1554 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:11.783088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-d1d961da-e87d-4fb7-8224-9ab689402c62 req-83f6845c-af60-4a8d-959b-d413f7562f5c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac", "name": "network-vif-deleted", "tag": "6c2e9773-4369-4a54-ae35-882ccbb7222a"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:11.805824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-d1d961da-e87d-4fb7-8224-9ab689402c62 req-83f6845c-af60-4a8d-959b-d413f7562f5c service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:11.807151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-d1d961da-e87d-4fb7-8224-9ab689402c62 req-83f6845c-af60-4a8d-959b-d413f7562f5c service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:11.837489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-d1d961da-e87d-4fb7-8224-9ab689402c62 req-83f6845c-af60-4a8d-959b-d413f7562f5c service nova] Creating event network-vif-deleted:6c2e9773-4369-4a54-ae35-882ccbb7222a for instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac on hv-cinder-82651 Jul 14 15:38:11.845775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-d1d961da-e87d-4fb7-8224-9ab689402c62 req-83f6845c-af60-4a8d-959b-d413f7562f5c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.070060 Jul 14 15:38:11.846510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 141/251] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:38:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:38:11.988102 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-276e308c-5bf2-4e31-8f29-3a44fc91bd63 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:11.989118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-276e308c-5bf2-4e31-8f29-3a44fc91bd63 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:11.999343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-276e308c-5bf2-4e31-8f29-3a44fc91bd63 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:12.000152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-276e308c-5bf2-4e31-8f29-3a44fc91bd63 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:12.001138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-276e308c-5bf2-4e31-8f29-3a44fc91bd63 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:12.001584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-276e308c-5bf2-4e31-8f29-3a44fc91bd63 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:12.006540 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:12.218709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-276e308c-5bf2-4e31-8f29-3a44fc91bd63 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:12.227303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-276e308c-5bf2-4e31-8f29-3a44fc91bd63 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.245235 Jul 14 15:38:12.229774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 111/252] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:11 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:12.769474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3beebafb-e208-4d8a-a12d-48aac89c4e4c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:12.779365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3beebafb-e208-4d8a-a12d-48aac89c4e4c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:12.788823 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3beebafb-e208-4d8a-a12d-48aac89c4e4c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:12.789487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3beebafb-e208-4d8a-a12d-48aac89c4e4c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:12.793909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3beebafb-e208-4d8a-a12d-48aac89c4e4c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:12.796006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3beebafb-e208-4d8a-a12d-48aac89c4e4c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:12.849840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3beebafb-e208-4d8a-a12d-48aac89c4e4c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:12.850392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3beebafb-e208-4d8a-a12d-48aac89c4e4c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:12.850983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-3beebafb-e208-4d8a-a12d-48aac89c4e4c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lazy-loading 'fault' on Instance uuid cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:38:12.906241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3beebafb-e208-4d8a-a12d-48aac89c4e4c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '3db7ba60a24747efb55601b6e2401983', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b9490b542a1f4c78aef9015ecb97dabd', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:12.915581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3beebafb-e208-4d8a-a12d-48aac89c4e4c tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 200 len: 1351 microversion: 2.1 time: 0.152050 Jul 14 15:38:12.916359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 142/253] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:12 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 1351 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:13.246535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-273057d2-c648-4d38-8177-00855f793392 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:13.247991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-273057d2-c648-4d38-8177-00855f793392 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:13.256820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-273057d2-c648-4d38-8177-00855f793392 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:13.257421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-273057d2-c648-4d38-8177-00855f793392 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:13.258198 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-273057d2-c648-4d38-8177-00855f793392 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:13.259522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-273057d2-c648-4d38-8177-00855f793392 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:13.424045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-273057d2-c648-4d38-8177-00855f793392 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:13.433951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-273057d2-c648-4d38-8177-00855f793392 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.191617 Jul 14 15:38:13.434926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 112/254] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:13 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:13.934016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-96418a19-f428-49a8-8f79-5b2a09bee4dd tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:13.934628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-96418a19-f428-49a8-8f79-5b2a09bee4dd tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:13.943904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96418a19-f428-49a8-8f79-5b2a09bee4dd tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:13.944360 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96418a19-f428-49a8-8f79-5b2a09bee4dd tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:13.945525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96418a19-f428-49a8-8f79-5b2a09bee4dd tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:13.945961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96418a19-f428-49a8-8f79-5b2a09bee4dd tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:13.962354 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-96418a19-f428-49a8-8f79-5b2a09bee4dd tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] HTTP exception thrown: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-96418a19-f428-49a8-8f79-5b2a09bee4dd tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Request method failure captured: Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac HTTP/1.1 Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgD5wUM3nH6v4-_b472nSjhNmlynNFfDp-_D7XqJE4pgn2BumXKJ7YLU6Aynvus59WI0kL35D8OD30aGlxvDotHfcjYgKjOinWZundMhMNO0u7aZ-i5znpzu_GXOt6B-AqQgCBLwfXqQYomz75XR1-HC7QZEApQMueQ8URyIJm3Bis Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: b9490b542a1f4c78aef9015ecb97dabd Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-DeleteServersTestJSON-1386895168 Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:38:13.968139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:38:13.970348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:38:13.970348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-DeleteServersTestJSON-1386895168 Jul 14 15:38:13.970348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: b9490b542a1f4c78aef9015ecb97dabd Jul 14 15:38:13.970348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-DeleteServersTestJSON-1386895168 Jul 14 15:38:13.970348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-DeleteServersTestJSON-1386895168-project Jul 14 15:38:13.970348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:38:13.970348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:38:13.970348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 3db7ba60a24747efb55601b6e2401983 Jul 14 15:38:13.970348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-DeleteServersTestJSON-1386895168-project Jul 14 15:38:13.970348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 15:38:13.970348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:13.970348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac'} Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:38:13.971180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:13.972573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:38:13.973747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-96418a19-f428-49a8-8f79-5b2a09bee4dd tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Returning 404 to user: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:38:13.973747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-96418a19-f428-49a8-8f79-5b2a09bee4dd tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 404 len: 111 microversion: 2.1 time: 0.039641 Jul 14 15:38:13.973747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 143/255] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:13 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:38:14.109974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f9ef7658-7fa8-449b-9314-2ea38f427565 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:14.112186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f9ef7658-7fa8-449b-9314-2ea38f427565 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:14.123087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9ef7658-7fa8-449b-9314-2ea38f427565 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:14.124093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9ef7658-7fa8-449b-9314-2ea38f427565 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:14.126052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9ef7658-7fa8-449b-9314-2ea38f427565 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:14.127696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9ef7658-7fa8-449b-9314-2ea38f427565 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:14.153279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-f9ef7658-7fa8-449b-9314-2ea38f427565 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] HTTP exception thrown: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f9ef7658-7fa8-449b-9314-2ea38f427565 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Request method failure captured: Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac/os-volume_attachments HTTP/1.1 Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgD5wUM3nH6v4-_b472nSjhNmlynNFfDp-_D7XqJE4pgn2BumXKJ7YLU6Aynvus59WI0kL35D8OD30aGlxvDotHfcjYgKjOinWZundMhMNO0u7aZ-i5znpzu_GXOt6B-AqQgCBLwfXqQYomz75XR1-HC7QZEApQMueQ8URyIJm3Bis Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: b9490b542a1f4c78aef9015ecb97dabd Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-DeleteServersTestJSON-1386895168 Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 15:38:14.162502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 15:38:14.164007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:38:14.164007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-DeleteServersTestJSON-1386895168 Jul 14 15:38:14.164007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: b9490b542a1f4c78aef9015ecb97dabd Jul 14 15:38:14.164007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-DeleteServersTestJSON-1386895168 Jul 14 15:38:14.164007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-DeleteServersTestJSON-1386895168-project Jul 14 15:38:14.164007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 15:38:14.164007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 15:38:14.164007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 3db7ba60a24747efb55601b6e2401983 Jul 14 15:38:14.164007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-DeleteServersTestJSON-1386895168-project Jul 14 15:38:14.164007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 15:38:14.164007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:14.164007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'server_id': 'cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac'} Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:38:14.164915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:14.166329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:38:14.167665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f9ef7658-7fa8-449b-9314-2ea38f427565 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Returning 404 to user: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:38:14.167665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f9ef7658-7fa8-449b-9314-2ea38f427565 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.062860 Jul 14 15:38:14.167665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 113/256] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 15:38:14 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac/os-volume_attachments => generated 111 bytes in 65 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:38:14.451935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5975e6c9-4c4e-472f-8777-64d3eafc04bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:14.452491 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5975e6c9-4c4e-472f-8777-64d3eafc04bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:14.458369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5975e6c9-4c4e-472f-8777-64d3eafc04bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:14.458813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5975e6c9-4c4e-472f-8777-64d3eafc04bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:14.459556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5975e6c9-4c4e-472f-8777-64d3eafc04bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:14.460010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5975e6c9-4c4e-472f-8777-64d3eafc04bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:14.592985 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5975e6c9-4c4e-472f-8777-64d3eafc04bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:14.600782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5975e6c9-4c4e-472f-8777-64d3eafc04bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.153299 Jul 14 15:38:14.601354 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 144/257] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:14 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:15.386307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ec9ec585-e0e3-4970-9fb4-ea2de32c3ade tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:15.386826 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ec9ec585-e0e3-4970-9fb4-ea2de32c3ade tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:15.393456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec9ec585-e0e3-4970-9fb4-ea2de32c3ade tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:15.393931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec9ec585-e0e3-4970-9fb4-ea2de32c3ade tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:15.394685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec9ec585-e0e3-4970-9fb4-ea2de32c3ade tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:15.395116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec9ec585-e0e3-4970-9fb4-ea2de32c3ade tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:15.410135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-ec9ec585-e0e3-4970-9fb4-ea2de32c3ade tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] HTTP exception thrown: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ec9ec585-e0e3-4970-9fb4-ea2de32c3ade tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Request method failure captured: Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac HTTP/1.1 Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgD5wUM3nH6v4-_b472nSjhNmlynNFfDp-_D7XqJE4pgn2BumXKJ7YLU6Aynvus59WI0kL35D8OD30aGlxvDotHfcjYgKjOinWZundMhMNO0u7aZ-i5znpzu_GXOt6B-AqQgCBLwfXqQYomz75XR1-HC7QZEApQMueQ8URyIJm3Bis Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: b9490b542a1f4c78aef9015ecb97dabd Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-DeleteServersTestJSON-1386895168 Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 15:38:15.412693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 15:38:15.414147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:38:15.414147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-DeleteServersTestJSON-1386895168 Jul 14 15:38:15.414147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: b9490b542a1f4c78aef9015ecb97dabd Jul 14 15:38:15.414147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-DeleteServersTestJSON-1386895168 Jul 14 15:38:15.414147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-DeleteServersTestJSON-1386895168-project Jul 14 15:38:15.414147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 15:38:15.414147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 15:38:15.414147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 3db7ba60a24747efb55601b6e2401983 Jul 14 15:38:15.414147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-DeleteServersTestJSON-1386895168-project Jul 14 15:38:15.414147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 15:38:15.414147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:15.414147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': 'cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac'} Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:38:15.414880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:15.415967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:38:15.417369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ec9ec585-e0e3-4970-9fb4-ea2de32c3ade tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Returning 404 to user: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:38:15.417369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ec9ec585-e0e3-4970-9fb4-ea2de32c3ade tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "DELETE /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 404 len: 111 microversion: 2.1 time: 0.032115 Jul 14 15:38:15.417369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 114/258] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 15:38:15 2022] DELETE /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:38:15.428975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7624d6d-86ae-47fe-884e-e3b906646de0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:15.429661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d7624d6d-86ae-47fe-884e-e3b906646de0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] [instance: cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:15.435713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7624d6d-86ae-47fe-884e-e3b906646de0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:15.436126 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7624d6d-86ae-47fe-884e-e3b906646de0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:15.437070 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7624d6d-86ae-47fe-884e-e3b906646de0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:15.437563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7624d6d-86ae-47fe-884e-e3b906646de0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:15.456752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-d7624d6d-86ae-47fe-884e-e3b906646de0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] HTTP exception thrown: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7624d6d-86ae-47fe-884e-e3b906646de0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Request method failure captured: Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac HTTP/1.1 Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgD5wUM3nH6v4-_b472nSjhNmlynNFfDp-_D7XqJE4pgn2BumXKJ7YLU6Aynvus59WI0kL35D8OD30aGlxvDotHfcjYgKjOinWZundMhMNO0u7aZ-i5znpzu_GXOt6B-AqQgCBLwfXqQYomz75XR1-HC7QZEApQMueQ8URyIJm3Bis Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: b9490b542a1f4c78aef9015ecb97dabd Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-DeleteServersTestJSON-1386895168 Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:38:15.458294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:38:15.459815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/b9490b542a1f4c78aef9015ecb97dabd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:38:15.459815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-DeleteServersTestJSON-1386895168 Jul 14 15:38:15.459815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: b9490b542a1f4c78aef9015ecb97dabd Jul 14 15:38:15.459815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-DeleteServersTestJSON-1386895168 Jul 14 15:38:15.459815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-DeleteServersTestJSON-1386895168-project Jul 14 15:38:15.459815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:38:15.459815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:38:15.459815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 3db7ba60a24747efb55601b6e2401983 Jul 14 15:38:15.459815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-DeleteServersTestJSON-1386895168-project Jul 14 15:38:15.459815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 15:38:15.459815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:15.459815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac'} Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:38:15.460607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. Jul 14 15:38:15.461868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:38:15.463019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7624d6d-86ae-47fe-884e-e3b906646de0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] Returning 404 to user: Instance cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:38:15.463019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d7624d6d-86ae-47fe-884e-e3b906646de0 tempest-DeleteServersTestJSON-1386895168 tempest-DeleteServersTestJSON-1386895168-project] 10.222.0.99 "GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac" status: 404 len: 111 microversion: 2.1 time: 0.036142 Jul 14 15:38:15.463019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 145/259] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:15 2022] GET /compute/v2.1/servers/cee3d22b-fc6b-4ccd-9ea5-19ea4b1c5aac => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:38:15.618235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2a2ee239-5aa0-4f51-b92d-a3662d650043 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:15.618753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2a2ee239-5aa0-4f51-b92d-a3662d650043 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:15.625228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a2ee239-5aa0-4f51-b92d-a3662d650043 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:15.625672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a2ee239-5aa0-4f51-b92d-a3662d650043 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:15.627170 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a2ee239-5aa0-4f51-b92d-a3662d650043 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:15.627981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a2ee239-5aa0-4f51-b92d-a3662d650043 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:15.874902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2a2ee239-5aa0-4f51-b92d-a3662d650043 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:15.882668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2a2ee239-5aa0-4f51-b92d-a3662d650043 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.268473 Jul 14 15:38:15.883232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 115/260] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:15 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:16.899956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0a032431-3575-425c-8e23-b67addd0b8e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:16.900681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0a032431-3575-425c-8e23-b67addd0b8e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:16.907505 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a032431-3575-425c-8e23-b67addd0b8e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:16.908161 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a032431-3575-425c-8e23-b67addd0b8e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:16.909075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a032431-3575-425c-8e23-b67addd0b8e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:16.909513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a032431-3575-425c-8e23-b67addd0b8e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:17.041910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0a032431-3575-425c-8e23-b67addd0b8e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:17.045444 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:17.051054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0a032431-3575-425c-8e23-b67addd0b8e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.155184 Jul 14 15:38:17.051655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 146/261] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:16 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:18.078994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e301a682-801d-4504-8a54-f48240e02443 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:18.080920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e301a682-801d-4504-8a54-f48240e02443 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:18.088317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e301a682-801d-4504-8a54-f48240e02443 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:18.088986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e301a682-801d-4504-8a54-f48240e02443 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:18.089933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e301a682-801d-4504-8a54-f48240e02443 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:18.090513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e301a682-801d-4504-8a54-f48240e02443 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:18.351502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e301a682-801d-4504-8a54-f48240e02443 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:18.360318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e301a682-801d-4504-8a54-f48240e02443 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.294800 Jul 14 15:38:18.360929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 116/262] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:18 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:19.379074 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8e6d164a-2e22-44ff-bb6f-7e1b3933f8cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:19.379743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8e6d164a-2e22-44ff-bb6f-7e1b3933f8cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:19.385915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e6d164a-2e22-44ff-bb6f-7e1b3933f8cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:19.386363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e6d164a-2e22-44ff-bb6f-7e1b3933f8cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:19.387139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e6d164a-2e22-44ff-bb6f-7e1b3933f8cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:19.387566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e6d164a-2e22-44ff-bb6f-7e1b3933f8cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:19.543774 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8e6d164a-2e22-44ff-bb6f-7e1b3933f8cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:19.552081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8e6d164a-2e22-44ff-bb6f-7e1b3933f8cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.178226 Jul 14 15:38:19.552817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 147/263] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:19 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:20.571100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9425afeb-4fb1-4f67-90a5-0371ce8b9124 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:20.571739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9425afeb-4fb1-4f67-90a5-0371ce8b9124 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:20.578223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9425afeb-4fb1-4f67-90a5-0371ce8b9124 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:20.578731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9425afeb-4fb1-4f67-90a5-0371ce8b9124 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:20.579564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9425afeb-4fb1-4f67-90a5-0371ce8b9124 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:20.580012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9425afeb-4fb1-4f67-90a5-0371ce8b9124 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:20.719306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9425afeb-4fb1-4f67-90a5-0371ce8b9124 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:20.728246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9425afeb-4fb1-4f67-90a5-0371ce8b9124 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.161854 Jul 14 15:38:20.728989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 117/264] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:20 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:21.746116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-400cbb84-5b66-4e15-8879-84334e151d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:21.747103 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-400cbb84-5b66-4e15-8879-84334e151d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:21.753182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-400cbb84-5b66-4e15-8879-84334e151d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:21.753631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-400cbb84-5b66-4e15-8879-84334e151d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:21.754465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-400cbb84-5b66-4e15-8879-84334e151d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:21.755100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-400cbb84-5b66-4e15-8879-84334e151d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:21.929485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-400cbb84-5b66-4e15-8879-84334e151d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:21.937034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-400cbb84-5b66-4e15-8879-84334e151d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.194961 Jul 14 15:38:21.937606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 148/265] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:21 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:22.955251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7d10b954-95f2-4a2a-b365-8d133cabb547 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:22.956011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7d10b954-95f2-4a2a-b365-8d133cabb547 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:22.964444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d10b954-95f2-4a2a-b365-8d133cabb547 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:22.965248 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d10b954-95f2-4a2a-b365-8d133cabb547 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:22.966468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d10b954-95f2-4a2a-b365-8d133cabb547 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:22.967065 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d10b954-95f2-4a2a-b365-8d133cabb547 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:23.330496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7d10b954-95f2-4a2a-b365-8d133cabb547 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:23.337938 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7d10b954-95f2-4a2a-b365-8d133cabb547 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.387021 Jul 14 15:38:23.338507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 118/266] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:22 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:24.355782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-189e5002-299e-445e-9565-7cfe81d04b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:24.356394 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-189e5002-299e-445e-9565-7cfe81d04b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:24.363779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-189e5002-299e-445e-9565-7cfe81d04b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:24.364230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-189e5002-299e-445e-9565-7cfe81d04b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:24.365002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-189e5002-299e-445e-9565-7cfe81d04b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:24.365440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-189e5002-299e-445e-9565-7cfe81d04b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:24.497891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-189e5002-299e-445e-9565-7cfe81d04b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:24.505498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-189e5002-299e-445e-9565-7cfe81d04b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.153773 Jul 14 15:38:24.506068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 149/267] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:24 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:25.522757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-38619fef-5750-48b0-93a2-87d68347fff2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:25.524128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-38619fef-5750-48b0-93a2-87d68347fff2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:25.528083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:25.535033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38619fef-5750-48b0-93a2-87d68347fff2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:25.535745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38619fef-5750-48b0-93a2-87d68347fff2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:25.536877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38619fef-5750-48b0-93a2-87d68347fff2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:25.537653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38619fef-5750-48b0-93a2-87d68347fff2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:25.864342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-38619fef-5750-48b0-93a2-87d68347fff2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:25.872384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-38619fef-5750-48b0-93a2-87d68347fff2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.353729 Jul 14 15:38:25.873020 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 119/268] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:25 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:26.892236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-59e0801e-f746-40d3-a8d1-02c1ef8bd2fc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:26.893699 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-59e0801e-f746-40d3-a8d1-02c1ef8bd2fc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:26.905522 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-59e0801e-f746-40d3-a8d1-02c1ef8bd2fc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:26.905984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-59e0801e-f746-40d3-a8d1-02c1ef8bd2fc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:26.906813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-59e0801e-f746-40d3-a8d1-02c1ef8bd2fc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:26.907382 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-59e0801e-f746-40d3-a8d1-02c1ef8bd2fc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:27.123244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-59e0801e-f746-40d3-a8d1-02c1ef8bd2fc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:27.132520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-59e0801e-f746-40d3-a8d1-02c1ef8bd2fc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.245860 Jul 14 15:38:27.133549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 150/269] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:26 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:28.152267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cb71825b-765a-40ac-9658-8f7247fdd87f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:28.152883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cb71825b-765a-40ac-9658-8f7247fdd87f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:28.168734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cb71825b-765a-40ac-9658-8f7247fdd87f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:28.177736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cb71825b-765a-40ac-9658-8f7247fdd87f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:28.178915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cb71825b-765a-40ac-9658-8f7247fdd87f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:28.179578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cb71825b-765a-40ac-9658-8f7247fdd87f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:28.342346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cb71825b-765a-40ac-9658-8f7247fdd87f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:28.351125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cb71825b-765a-40ac-9658-8f7247fdd87f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.202801 Jul 14 15:38:28.351816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 120/270] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:28 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:29.367931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2719c8de-f630-4605-a1e2-4edf7abde200 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:29.368582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2719c8de-f630-4605-a1e2-4edf7abde200 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:29.374970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2719c8de-f630-4605-a1e2-4edf7abde200 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:29.375429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2719c8de-f630-4605-a1e2-4edf7abde200 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:29.376238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2719c8de-f630-4605-a1e2-4edf7abde200 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:29.377441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2719c8de-f630-4605-a1e2-4edf7abde200 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:29.528397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2719c8de-f630-4605-a1e2-4edf7abde200 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:29.543342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2719c8de-f630-4605-a1e2-4edf7abde200 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.179071 Jul 14 15:38:29.544103 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 151/271] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:29 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:30.562449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4f1701d4-94e6-49d1-8b6b-f8e2dc6c88ba tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:30.563165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4f1701d4-94e6-49d1-8b6b-f8e2dc6c88ba tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:30.569846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f1701d4-94e6-49d1-8b6b-f8e2dc6c88ba tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:30.570418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f1701d4-94e6-49d1-8b6b-f8e2dc6c88ba tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:30.571279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f1701d4-94e6-49d1-8b6b-f8e2dc6c88ba tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:30.571830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f1701d4-94e6-49d1-8b6b-f8e2dc6c88ba tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:30.719336 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4f1701d4-94e6-49d1-8b6b-f8e2dc6c88ba tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:30.728468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4f1701d4-94e6-49d1-8b6b-f8e2dc6c88ba tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.170632 Jul 14 15:38:30.729217 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 121/272] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:30 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:31.746212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7da9231b-0d6f-46c1-ada3-fff36a4af0e6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:31.747094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7da9231b-0d6f-46c1-ada3-fff36a4af0e6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:31.753216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7da9231b-0d6f-46c1-ada3-fff36a4af0e6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:31.753701 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7da9231b-0d6f-46c1-ada3-fff36a4af0e6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:31.754486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7da9231b-0d6f-46c1-ada3-fff36a4af0e6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:31.754929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7da9231b-0d6f-46c1-ada3-fff36a4af0e6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:31.894822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7da9231b-0d6f-46c1-ada3-fff36a4af0e6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:31.903019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7da9231b-0d6f-46c1-ada3-fff36a4af0e6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.160909 Jul 14 15:38:31.903612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 152/273] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:31 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:32.919989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-22bf4216-f922-44a8-946e-2d00779f2355 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:32.920594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-22bf4216-f922-44a8-946e-2d00779f2355 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:32.927952 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22bf4216-f922-44a8-946e-2d00779f2355 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:32.928429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22bf4216-f922-44a8-946e-2d00779f2355 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:32.929214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22bf4216-f922-44a8-946e-2d00779f2355 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:32.929652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22bf4216-f922-44a8-946e-2d00779f2355 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:33.071163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-22bf4216-f922-44a8-946e-2d00779f2355 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:33.078674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-22bf4216-f922-44a8-946e-2d00779f2355 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.162488 Jul 14 15:38:33.079231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 122/274] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:32 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:34.098529 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-62b09ae3-71b8-4753-9c99-0531e1529415 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:34.099350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-62b09ae3-71b8-4753-9c99-0531e1529415 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:34.106006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62b09ae3-71b8-4753-9c99-0531e1529415 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:34.106532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62b09ae3-71b8-4753-9c99-0531e1529415 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:34.107398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62b09ae3-71b8-4753-9c99-0531e1529415 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:34.108051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62b09ae3-71b8-4753-9c99-0531e1529415 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:34.257125 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-62b09ae3-71b8-4753-9c99-0531e1529415 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:34.264664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-62b09ae3-71b8-4753-9c99-0531e1529415 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.172045 Jul 14 15:38:34.265224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 153/275] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:34 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:35.282341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-94931951-11eb-47eb-9d0e-c819a24b8994 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:35.284010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-94931951-11eb-47eb-9d0e-c819a24b8994 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:35.291432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-94931951-11eb-47eb-9d0e-c819a24b8994 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:35.292892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-94931951-11eb-47eb-9d0e-c819a24b8994 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:35.294128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-94931951-11eb-47eb-9d0e-c819a24b8994 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:35.294760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-94931951-11eb-47eb-9d0e-c819a24b8994 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:35.461187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-94931951-11eb-47eb-9d0e-c819a24b8994 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:35.469035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-94931951-11eb-47eb-9d0e-c819a24b8994 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.190714 Jul 14 15:38:35.469691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 123/276] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:35 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:36.488338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d741e7f0-a475-4210-8434-e1dc3c39547b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:36.488970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d741e7f0-a475-4210-8434-e1dc3c39547b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:36.506076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d741e7f0-a475-4210-8434-e1dc3c39547b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:36.506600 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d741e7f0-a475-4210-8434-e1dc3c39547b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:36.507578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d741e7f0-a475-4210-8434-e1dc3c39547b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:36.508147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d741e7f0-a475-4210-8434-e1dc3c39547b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:36.691724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d741e7f0-a475-4210-8434-e1dc3c39547b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:36.709197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d741e7f0-a475-4210-8434-e1dc3c39547b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.225865 Jul 14 15:38:36.721135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 154/277] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:36 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:37.727553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-61fb9129-3261-4161-b11a-ac66662b7fdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:37.729612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-61fb9129-3261-4161-b11a-ac66662b7fdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:37.741194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61fb9129-3261-4161-b11a-ac66662b7fdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:37.741765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61fb9129-3261-4161-b11a-ac66662b7fdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:37.742662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61fb9129-3261-4161-b11a-ac66662b7fdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:37.743073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61fb9129-3261-4161-b11a-ac66662b7fdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:37.953336 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-61fb9129-3261-4161-b11a-ac66662b7fdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:37.977414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-61fb9129-3261-4161-b11a-ac66662b7fdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.253813 Jul 14 15:38:37.978041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 124/278] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:37 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:38.995250 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8493a38b-ff9b-45ba-b540-480283eece1c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:38.996500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8493a38b-ff9b-45ba-b540-480283eece1c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:39.003464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=36 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:39.005432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8493a38b-ff9b-45ba-b540-480283eece1c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:39.005947 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8493a38b-ff9b-45ba-b540-480283eece1c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:39.006833 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8493a38b-ff9b-45ba-b540-480283eece1c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:39.007465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8493a38b-ff9b-45ba-b540-480283eece1c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:39.200860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8493a38b-ff9b-45ba-b540-480283eece1c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:39.211253 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8493a38b-ff9b-45ba-b540-480283eece1c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.220457 Jul 14 15:38:39.212607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 155/279] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:38 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:40.230651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-06936960-3842-43ed-8cfb-35b4bf0bdf6b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:40.231448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-06936960-3842-43ed-8cfb-35b4bf0bdf6b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:40.238345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06936960-3842-43ed-8cfb-35b4bf0bdf6b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:40.239039 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06936960-3842-43ed-8cfb-35b4bf0bdf6b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:40.239999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06936960-3842-43ed-8cfb-35b4bf0bdf6b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:40.240613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06936960-3842-43ed-8cfb-35b4bf0bdf6b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:40.413770 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-06936960-3842-43ed-8cfb-35b4bf0bdf6b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:40.421734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-06936960-3842-43ed-8cfb-35b4bf0bdf6b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.195000 Jul 14 15:38:40.422713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 125/280] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:40 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:40.578118 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-640325681", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "networks": [{"uuid": "258b9bba-4eb1-4783-8230-c7499f78cf5e"}]}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:40.640495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.network.neutron [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] validate_networks() for [('258b9bba-4eb1-4783-8230-c7499f78cf5e', None, None, None, None, None)] {{(pid=124502) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:38:41.306541 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Flavor limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:38:41.307261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Image limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:38:41.308112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Flavor pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:38:41.308609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Image pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:38:41.309495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:38:41.319982 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:41.320680 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:41.321704 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:41.322152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:41.347008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Getting quotas for project 858bb49b6e1e48568e2055eacc1ee7e5. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:38:41.351895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Getting quotas for user 71bc270c6253426baa4f79638d466b20 and project 858bb49b6e1e48568e2055eacc1ee7e5. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:38:41.365042 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Going to run 1 instances... {{(pid=124502) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:38:41.367666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124502) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:38:41.429320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a09f21ea-749b-4316-a6a9-8d88d68f4c14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.855675 Jul 14 15:38:41.430219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 156/281] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 15:38:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 857 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:38:41.441007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4f856244-97e8-45b6-9fec-5879fe430c13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:41.441627 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4f856244-97e8-45b6-9fec-5879fe430c13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:41.447322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c00719e5-e19f-4518-8ef9-c5084195d7e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:41.448912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c00719e5-e19f-4518-8ef9-c5084195d7e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:41.459891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c00719e5-e19f-4518-8ef9-c5084195d7e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:41.460361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c00719e5-e19f-4518-8ef9-c5084195d7e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:41.461317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c00719e5-e19f-4518-8ef9-c5084195d7e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:41.462044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c00719e5-e19f-4518-8ef9-c5084195d7e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:41.527758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4f856244-97e8-45b6-9fec-5879fe430c13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:41.535565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4f856244-97e8-45b6-9fec-5879fe430c13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1218 microversion: 2.1 time: 0.099318 Jul 14 15:38:41.536196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 126/282] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:41 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:41.678001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c00719e5-e19f-4518-8ef9-c5084195d7e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:41.686426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c00719e5-e19f-4518-8ef9-c5084195d7e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.249965 Jul 14 15:38:41.696740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 157/283] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:41 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:42.552998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-83092669-e42a-473c-8ec0-24f6d6d5b621 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:42.553719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-83092669-e42a-473c-8ec0-24f6d6d5b621 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:42.562452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83092669-e42a-473c-8ec0-24f6d6d5b621 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:42.562895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83092669-e42a-473c-8ec0-24f6d6d5b621 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:42.564715 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83092669-e42a-473c-8ec0-24f6d6d5b621 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:42.565068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83092669-e42a-473c-8ec0-24f6d6d5b621 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:42.569208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=82 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:42.632911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-83092669-e42a-473c-8ec0-24f6d6d5b621 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:42.641132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-83092669-e42a-473c-8ec0-24f6d6d5b621 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1270 microversion: 2.1 time: 0.092562 Jul 14 15:38:42.641936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 127/284] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:42 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1270 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:42.707209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-56cad2f1-4f7c-49e7-bc27-2d6f4d7c50c2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:42.707958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-56cad2f1-4f7c-49e7-bc27-2d6f4d7c50c2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:42.716011 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-56cad2f1-4f7c-49e7-bc27-2d6f4d7c50c2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:42.716653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-56cad2f1-4f7c-49e7-bc27-2d6f4d7c50c2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:42.718213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-56cad2f1-4f7c-49e7-bc27-2d6f4d7c50c2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:42.718765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-56cad2f1-4f7c-49e7-bc27-2d6f4d7c50c2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:42.904942 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-56cad2f1-4f7c-49e7-bc27-2d6f4d7c50c2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:42.916635 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-56cad2f1-4f7c-49e7-bc27-2d6f4d7c50c2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.215591 Jul 14 15:38:42.920041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 158/285] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:42 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:43.660608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ec0a543d-2fa0-40d3-bd08-15cc1bc9106e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:43.661300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ec0a543d-2fa0-40d3-bd08-15cc1bc9106e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:43.676841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec0a543d-2fa0-40d3-bd08-15cc1bc9106e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:43.677487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec0a543d-2fa0-40d3-bd08-15cc1bc9106e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:43.678563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec0a543d-2fa0-40d3-bd08-15cc1bc9106e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:43.679187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec0a543d-2fa0-40d3-bd08-15cc1bc9106e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:43.935779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-348ac53e-9689-4896-881e-22800129583a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:43.936492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-348ac53e-9689-4896-881e-22800129583a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:43.943251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-348ac53e-9689-4896-881e-22800129583a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:43.943832 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-348ac53e-9689-4896-881e-22800129583a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:43.944614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-348ac53e-9689-4896-881e-22800129583a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:43.945054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-348ac53e-9689-4896-881e-22800129583a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:43.950024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ec0a543d-2fa0-40d3-bd08-15cc1bc9106e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:43.959308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ec0a543d-2fa0-40d3-bd08-15cc1bc9106e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1318 microversion: 2.1 time: 0.303553 Jul 14 15:38:43.960025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 128/286] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:43 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1318 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:44.092426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-348ac53e-9689-4896-881e-22800129583a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:44.101246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-348ac53e-9689-4896-881e-22800129583a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.169744 Jul 14 15:38:44.101831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 159/287] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:43 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:44.377197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-9f460bd5-838c-4dd5-afad-2748caf19f25 req-3edd75dc-a091-4b58-8619-30fa7f3a6a09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7", "tag": "cd5d78dd-d14b-4a46-802a-66a92af42839"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:44.387712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-9f460bd5-838c-4dd5-afad-2748caf19f25 req-3edd75dc-a091-4b58-8619-30fa7f3a6a09 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:44.388372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-9f460bd5-838c-4dd5-afad-2748caf19f25 req-3edd75dc-a091-4b58-8619-30fa7f3a6a09 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:44.402614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-9f460bd5-838c-4dd5-afad-2748caf19f25 req-3edd75dc-a091-4b58-8619-30fa7f3a6a09 service nova] Creating event network-changed:cd5d78dd-d14b-4a46-802a-66a92af42839 for instance eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 on hv-cinder-82651 Jul 14 15:38:44.409242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-9f460bd5-838c-4dd5-afad-2748caf19f25 req-3edd75dc-a091-4b58-8619-30fa7f3a6a09 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036457 Jul 14 15:38:44.409989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 129/288] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:38:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:38:44.976789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0d859a75-ab22-4146-b99a-325d4ee78d25 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:44.977499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0d859a75-ab22-4146-b99a-325d4ee78d25 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:44.983606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d859a75-ab22-4146-b99a-325d4ee78d25 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:44.984077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d859a75-ab22-4146-b99a-325d4ee78d25 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:44.984839 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d859a75-ab22-4146-b99a-325d4ee78d25 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:44.985275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d859a75-ab22-4146-b99a-325d4ee78d25 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:45.120067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1d8e70cd-0134-4c6d-b89e-4ac6221ba24b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:45.121567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1d8e70cd-0134-4c6d-b89e-4ac6221ba24b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:45.122164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0d859a75-ab22-4146-b99a-325d4ee78d25 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:45.128705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d8e70cd-0134-4c6d-b89e-4ac6221ba24b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:45.129664 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d8e70cd-0134-4c6d-b89e-4ac6221ba24b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:45.130608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d8e70cd-0134-4c6d-b89e-4ac6221ba24b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:45.131367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d8e70cd-0134-4c6d-b89e-4ac6221ba24b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:45.134439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0d859a75-ab22-4146-b99a-325d4ee78d25 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1318 microversion: 2.1 time: 0.161481 Jul 14 15:38:45.135028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 160/289] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:44 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:45.275152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1d8e70cd-0134-4c6d-b89e-4ac6221ba24b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:45.284918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1d8e70cd-0134-4c6d-b89e-4ac6221ba24b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.170130 Jul 14 15:38:45.291682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 130/290] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:45 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:46.152660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b21fc4a6-04d6-4cc1-8882-547485ee3790 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:46.153272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b21fc4a6-04d6-4cc1-8882-547485ee3790 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:46.159586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b21fc4a6-04d6-4cc1-8882-547485ee3790 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:46.160069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b21fc4a6-04d6-4cc1-8882-547485ee3790 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:46.160864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b21fc4a6-04d6-4cc1-8882-547485ee3790 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:46.161306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b21fc4a6-04d6-4cc1-8882-547485ee3790 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:46.303133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d3f4ee1e-e095-4454-a2fb-735327c9d397 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:46.304486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d3f4ee1e-e095-4454-a2fb-735327c9d397 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:46.313056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b21fc4a6-04d6-4cc1-8882-547485ee3790 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:46.313428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d3f4ee1e-e095-4454-a2fb-735327c9d397 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:46.314724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d3f4ee1e-e095-4454-a2fb-735327c9d397 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:46.315520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d3f4ee1e-e095-4454-a2fb-735327c9d397 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:46.316238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d3f4ee1e-e095-4454-a2fb-735327c9d397 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:46.325496 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b21fc4a6-04d6-4cc1-8882-547485ee3790 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1318 microversion: 2.1 time: 0.175843 Jul 14 15:38:46.337424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 161/291] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:46 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1318 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:46.474203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d3f4ee1e-e095-4454-a2fb-735327c9d397 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:46.483720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d3f4ee1e-e095-4454-a2fb-735327c9d397 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.185391 Jul 14 15:38:46.485179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 131/292] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:46 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:47.344476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-65535bfa-9d30-4a59-b16e-0a866be23b6b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:47.346147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-65535bfa-9d30-4a59-b16e-0a866be23b6b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:47.352370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65535bfa-9d30-4a59-b16e-0a866be23b6b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:47.352822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65535bfa-9d30-4a59-b16e-0a866be23b6b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:47.353583 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65535bfa-9d30-4a59-b16e-0a866be23b6b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:47.354019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65535bfa-9d30-4a59-b16e-0a866be23b6b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:47.485038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-65535bfa-9d30-4a59-b16e-0a866be23b6b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:47.492430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-65535bfa-9d30-4a59-b16e-0a866be23b6b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1318 microversion: 2.1 time: 0.151859 Jul 14 15:38:47.492995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 162/293] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:47 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:47.500380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-70c743ba-7d4b-4c07-933a-1e67bf12eb1a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:47.501133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-70c743ba-7d4b-4c07-933a-1e67bf12eb1a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:47.507714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70c743ba-7d4b-4c07-933a-1e67bf12eb1a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:47.508266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70c743ba-7d4b-4c07-933a-1e67bf12eb1a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:47.509394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70c743ba-7d4b-4c07-933a-1e67bf12eb1a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:47.509833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70c743ba-7d4b-4c07-933a-1e67bf12eb1a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:47.640230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-70c743ba-7d4b-4c07-933a-1e67bf12eb1a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:47.649049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-70c743ba-7d4b-4c07-933a-1e67bf12eb1a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.152424 Jul 14 15:38:47.649629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 132/294] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:47 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:48.509458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-58f60213-54ec-4713-ae03-ca2037c1ae7f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:48.510077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-58f60213-54ec-4713-ae03-ca2037c1ae7f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:48.525570 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58f60213-54ec-4713-ae03-ca2037c1ae7f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:48.526619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58f60213-54ec-4713-ae03-ca2037c1ae7f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:48.528450 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58f60213-54ec-4713-ae03-ca2037c1ae7f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:48.529681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58f60213-54ec-4713-ae03-ca2037c1ae7f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:48.666376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d55ae296-9893-4690-b6d3-0fcc002a5c64 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:48.667243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d55ae296-9893-4690-b6d3-0fcc002a5c64 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:48.675815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d55ae296-9893-4690-b6d3-0fcc002a5c64 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:48.676659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d55ae296-9893-4690-b6d3-0fcc002a5c64 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:48.677811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d55ae296-9893-4690-b6d3-0fcc002a5c64 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:48.678779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d55ae296-9893-4690-b6d3-0fcc002a5c64 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:48.757069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-58f60213-54ec-4713-ae03-ca2037c1ae7f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:48.768681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-58f60213-54ec-4713-ae03-ca2037c1ae7f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1318 microversion: 2.1 time: 0.263020 Jul 14 15:38:48.769449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 163/295] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:48 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1318 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:48.893674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d55ae296-9893-4690-b6d3-0fcc002a5c64 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:48.907259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d55ae296-9893-4690-b6d3-0fcc002a5c64 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.244660 Jul 14 15:38:48.910296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 133/296] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:48 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:49.786828 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d06891be-9e2b-4e32-bde9-6823133cc0d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:49.787724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d06891be-9e2b-4e32-bde9-6823133cc0d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:49.796743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d06891be-9e2b-4e32-bde9-6823133cc0d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:49.797369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d06891be-9e2b-4e32-bde9-6823133cc0d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:49.798452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d06891be-9e2b-4e32-bde9-6823133cc0d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:49.798938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d06891be-9e2b-4e32-bde9-6823133cc0d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:49.804555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=99 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:49.927564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-863ffd8d-ca4d-4b7c-b88c-86b8453b9493 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:49.928205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-863ffd8d-ca4d-4b7c-b88c-86b8453b9493 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:49.944063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-863ffd8d-ca4d-4b7c-b88c-86b8453b9493 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:49.945764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-863ffd8d-ca4d-4b7c-b88c-86b8453b9493 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:49.947371 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-863ffd8d-ca4d-4b7c-b88c-86b8453b9493 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:49.948771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-863ffd8d-ca4d-4b7c-b88c-86b8453b9493 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:50.008214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d06891be-9e2b-4e32-bde9-6823133cc0d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:50.018556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d06891be-9e2b-4e32-bde9-6823133cc0d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1318 microversion: 2.1 time: 0.236104 Jul 14 15:38:50.019514 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 164/297] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:49 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1318 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:50.231430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-863ffd8d-ca4d-4b7c-b88c-86b8453b9493 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:50.242387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-863ffd8d-ca4d-4b7c-b88c-86b8453b9493 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.317709 Jul 14 15:38:50.242387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 134/298] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:49 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:50.603853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-ce58aaa0-8bc7-4ed0-b0f6-b260ae5dd9da req-994e7c2f-92b1-4320-9af1-36109e922633 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7", "name": "network-vif-plugged", "status": "completed", "tag": "cd5d78dd-d14b-4a46-802a-66a92af42839"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:50.615031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-ce58aaa0-8bc7-4ed0-b0f6-b260ae5dd9da req-994e7c2f-92b1-4320-9af1-36109e922633 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:50.615768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-ce58aaa0-8bc7-4ed0-b0f6-b260ae5dd9da req-994e7c2f-92b1-4320-9af1-36109e922633 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:50.629669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-ce58aaa0-8bc7-4ed0-b0f6-b260ae5dd9da req-994e7c2f-92b1-4320-9af1-36109e922633 service nova] Creating event network-vif-plugged:cd5d78dd-d14b-4a46-802a-66a92af42839 for instance eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 on hv-cinder-82651 Jul 14 15:38:50.635891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-ce58aaa0-8bc7-4ed0-b0f6-b260ae5dd9da req-994e7c2f-92b1-4320-9af1-36109e922633 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037996 Jul 14 15:38:50.637034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 165/299] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:38:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:38:51.037003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d9961dbb-f5c1-477a-9124-fc55eefe2197 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:51.038303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d9961dbb-f5c1-477a-9124-fc55eefe2197 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:51.046059 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d9961dbb-f5c1-477a-9124-fc55eefe2197 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:51.047309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d9961dbb-f5c1-477a-9124-fc55eefe2197 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:51.051630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d9961dbb-f5c1-477a-9124-fc55eefe2197 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:51.052942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d9961dbb-f5c1-477a-9124-fc55eefe2197 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:51.213541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d9961dbb-f5c1-477a-9124-fc55eefe2197 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:51.221643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d9961dbb-f5c1-477a-9124-fc55eefe2197 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1318 microversion: 2.1 time: 0.189704 Jul 14 15:38:51.222254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 135/300] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:51 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:51.258447 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-351cb3af-ec69-42c4-b506-8649ccf793f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:51.258808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-351cb3af-ec69-42c4-b506-8649ccf793f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:51.265156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-351cb3af-ec69-42c4-b506-8649ccf793f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:51.265647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-351cb3af-ec69-42c4-b506-8649ccf793f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:51.266455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-351cb3af-ec69-42c4-b506-8649ccf793f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:51.266973 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-351cb3af-ec69-42c4-b506-8649ccf793f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:51.335428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:51.359941 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=6 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:51.425660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-351cb3af-ec69-42c4-b506-8649ccf793f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:51.433377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-351cb3af-ec69-42c4-b506-8649ccf793f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.179693 Jul 14 15:38:51.433956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 166/301] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:51 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:52.239230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4f54cfb3-a8df-489a-9a42-73be8c130e3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:52.240076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4f54cfb3-a8df-489a-9a42-73be8c130e3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:52.242463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:52.251567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f54cfb3-a8df-489a-9a42-73be8c130e3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:52.252054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f54cfb3-a8df-489a-9a42-73be8c130e3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:52.252840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f54cfb3-a8df-489a-9a42-73be8c130e3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:52.253279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f54cfb3-a8df-489a-9a42-73be8c130e3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:52.398081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4f54cfb3-a8df-489a-9a42-73be8c130e3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:52.406597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4f54cfb3-a8df-489a-9a42-73be8c130e3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1318 microversion: 2.1 time: 0.172182 Jul 14 15:38:52.408707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 136/302] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:52 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1318 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:52.450265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ecb0d41d-cf2f-4335-93dc-d7a13edd45c3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:52.451003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ecb0d41d-cf2f-4335-93dc-d7a13edd45c3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:52.457990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ecb0d41d-cf2f-4335-93dc-d7a13edd45c3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:52.458498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ecb0d41d-cf2f-4335-93dc-d7a13edd45c3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:52.459266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ecb0d41d-cf2f-4335-93dc-d7a13edd45c3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:52.459719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ecb0d41d-cf2f-4335-93dc-d7a13edd45c3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:52.617936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ecb0d41d-cf2f-4335-93dc-d7a13edd45c3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:52.629662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ecb0d41d-cf2f-4335-93dc-d7a13edd45c3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.183025 Jul 14 15:38:52.630550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 167/303] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:52 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:53.423686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-226b77cd-c37a-4671-9262-18659e9d2f5b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:53.424386 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-226b77cd-c37a-4671-9262-18659e9d2f5b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:53.431211 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-226b77cd-c37a-4671-9262-18659e9d2f5b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:53.431707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-226b77cd-c37a-4671-9262-18659e9d2f5b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:53.432488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-226b77cd-c37a-4671-9262-18659e9d2f5b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:53.432945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-226b77cd-c37a-4671-9262-18659e9d2f5b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:53.573820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-226b77cd-c37a-4671-9262-18659e9d2f5b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:53.581780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-226b77cd-c37a-4671-9262-18659e9d2f5b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1318 microversion: 2.1 time: 0.162132 Jul 14 15:38:53.582356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 137/304] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:53 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:53.648578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-30d92a0d-c6bf-457b-8a26-10015a60a6cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:53.649310 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-30d92a0d-c6bf-457b-8a26-10015a60a6cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:53.655344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30d92a0d-c6bf-457b-8a26-10015a60a6cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:53.656076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30d92a0d-c6bf-457b-8a26-10015a60a6cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:53.656679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30d92a0d-c6bf-457b-8a26-10015a60a6cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:53.657019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30d92a0d-c6bf-457b-8a26-10015a60a6cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:53.785560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-30d92a0d-c6bf-457b-8a26-10015a60a6cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:53.793321 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-30d92a0d-c6bf-457b-8a26-10015a60a6cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.149328 Jul 14 15:38:53.793888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 168/305] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:53 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:54.598876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-08cfe7c2-7f83-4f22-b043-0707d681c297 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:54.599500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-08cfe7c2-7f83-4f22-b043-0707d681c297 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:54.605478 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08cfe7c2-7f83-4f22-b043-0707d681c297 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:54.605914 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08cfe7c2-7f83-4f22-b043-0707d681c297 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:54.606674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08cfe7c2-7f83-4f22-b043-0707d681c297 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:54.607107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08cfe7c2-7f83-4f22-b043-0707d681c297 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:54.738324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-08cfe7c2-7f83-4f22-b043-0707d681c297 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:54.745976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-08cfe7c2-7f83-4f22-b043-0707d681c297 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1318 microversion: 2.1 time: 0.151567 Jul 14 15:38:54.746543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 138/306] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:54 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:54.810081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-eb9676dd-87e2-4228-9296-cd776628281f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:54.810609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-eb9676dd-87e2-4228-9296-cd776628281f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:54.817767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eb9676dd-87e2-4228-9296-cd776628281f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:54.818218 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eb9676dd-87e2-4228-9296-cd776628281f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:54.818981 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eb9676dd-87e2-4228-9296-cd776628281f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:54.819416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eb9676dd-87e2-4228-9296-cd776628281f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:54.949565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-eb9676dd-87e2-4228-9296-cd776628281f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:54.958115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-eb9676dd-87e2-4228-9296-cd776628281f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.151912 Jul 14 15:38:54.958684 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 169/307] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:54 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:55.764125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-31f4486e-9b70-44a7-89a1-9d4b81c6cae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:55.764741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-31f4486e-9b70-44a7-89a1-9d4b81c6cae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:55.767190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=42 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:55.772710 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-31f4486e-9b70-44a7-89a1-9d4b81c6cae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:55.773156 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-31f4486e-9b70-44a7-89a1-9d4b81c6cae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:55.773912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-31f4486e-9b70-44a7-89a1-9d4b81c6cae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:55.774345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-31f4486e-9b70-44a7-89a1-9d4b81c6cae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:55.845836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1451058250", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "networks": [{"uuid": "d93154e9-8290-48a7-9afe-cb7d3d5763ae"}]}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:55.905011 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.network.neutron [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] validate_networks() for [('d93154e9-8290-48a7-9afe-cb7d3d5763ae', None, None, None, None, None)] {{(pid=124502) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:38:55.921291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-31f4486e-9b70-44a7-89a1-9d4b81c6cae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:55.930437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-31f4486e-9b70-44a7-89a1-9d4b81c6cae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1318 microversion: 2.1 time: 0.170335 Jul 14 15:38:55.931105 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 139/308] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:55 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:55.975240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-89df5ca2-06b5-4f11-9a5f-616821938da9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:55.976037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-89df5ca2-06b5-4f11-9a5f-616821938da9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:55.982269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89df5ca2-06b5-4f11-9a5f-616821938da9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:55.982725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89df5ca2-06b5-4f11-9a5f-616821938da9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:55.983491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89df5ca2-06b5-4f11-9a5f-616821938da9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:55.983963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89df5ca2-06b5-4f11-9a5f-616821938da9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:56.119110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-89df5ca2-06b5-4f11-9a5f-616821938da9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:56.127487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-89df5ca2-06b5-4f11-9a5f-616821938da9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1522 microversion: 2.1 time: 0.155965 Jul 14 15:38:56.128090 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 140/309] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:55 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:56.279849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Flavor limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:38:56.280478 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Image limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:38:56.281036 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Flavor pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:38:56.281655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Image pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:38:56.282082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:38:56.291099 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:56.291585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:56.292409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:56.292849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:56.311775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Getting quotas for project 2345d49f9fee4842826a396c43132a33. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:38:56.316512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Getting quotas for user 1f3411c8a7454203a4fbd748f1f3031a and project 2345d49f9fee4842826a396c43132a33. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:38:56.327493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Going to run 1 instances... {{(pid=124502) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:38:56.330449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124502) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:38:56.378017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2cf3ddb1-2ba5-4afd-993e-400e56809f3b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.536197 Jul 14 15:38:56.383395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 170/310] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 15:38:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 538 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 15:38:56.388485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-92542d2f-b497-4beb-a39f-6168d7b0fe3e tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:56.389165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-92542d2f-b497-4beb-a39f-6168d7b0fe3e tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:56.462834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-92542d2f-b497-4beb-a39f-6168d7b0fe3e tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:56.471455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-92542d2f-b497-4beb-a39f-6168d7b0fe3e tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1214 microversion: 2.1 time: 0.086720 Jul 14 15:38:56.472192 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 141/311] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:56 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1214 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:56.948889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d3f7c583-f97b-4b29-ba6b-61d32c7b83d2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:56.949511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d3f7c583-f97b-4b29-ba6b-61d32c7b83d2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:56.957002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d3f7c583-f97b-4b29-ba6b-61d32c7b83d2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:56.957707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d3f7c583-f97b-4b29-ba6b-61d32c7b83d2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:56.958772 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d3f7c583-f97b-4b29-ba6b-61d32c7b83d2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:56.959368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d3f7c583-f97b-4b29-ba6b-61d32c7b83d2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:57.144351 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9fa7df62-a380-41fa-a135-dc86ce057e67 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:57.145672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9fa7df62-a380-41fa-a135-dc86ce057e67 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:57.153460 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9fa7df62-a380-41fa-a135-dc86ce057e67 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:57.154093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9fa7df62-a380-41fa-a135-dc86ce057e67 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:57.155058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9fa7df62-a380-41fa-a135-dc86ce057e67 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:57.155674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9fa7df62-a380-41fa-a135-dc86ce057e67 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:57.163124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d3f7c583-f97b-4b29-ba6b-61d32c7b83d2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:57.172620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d3f7c583-f97b-4b29-ba6b-61d32c7b83d2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1318 microversion: 2.1 time: 0.228046 Jul 14 15:38:57.182388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 171/312] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:56 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1318 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:57.340660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9fa7df62-a380-41fa-a135-dc86ce057e67 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:57.351815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9fa7df62-a380-41fa-a135-dc86ce057e67 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1502 microversion: 2.1 time: 0.211813 Jul 14 15:38:57.352658 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 142/313] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:57 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1502 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:57.368741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-acd3bb5f-54cd-4c00-a55b-6339c252c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:57.369364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-acd3bb5f-54cd-4c00-a55b-6339c252c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:57.385248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-acd3bb5f-54cd-4c00-a55b-6339c252c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:57.385740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-acd3bb5f-54cd-4c00-a55b-6339c252c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:57.386536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-acd3bb5f-54cd-4c00-a55b-6339c252c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:57.386978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-acd3bb5f-54cd-4c00-a55b-6339c252c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:57.488051 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-589236f7-55b8-4349-bcbe-13e23117d0c6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:57.488654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-589236f7-55b8-4349-bcbe-13e23117d0c6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:57.494768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-589236f7-55b8-4349-bcbe-13e23117d0c6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:57.495208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-589236f7-55b8-4349-bcbe-13e23117d0c6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:57.496194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-589236f7-55b8-4349-bcbe-13e23117d0c6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:57.496629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-589236f7-55b8-4349-bcbe-13e23117d0c6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:57.536271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-acd3bb5f-54cd-4c00-a55b-6339c252c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:57.545942 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-acd3bb5f-54cd-4c00-a55b-6339c252c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1516 microversion: 2.1 time: 0.181269 Jul 14 15:38:57.546540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 172/314] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:57 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1516 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:57.565243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-589236f7-55b8-4349-bcbe-13e23117d0c6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:57.572994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-589236f7-55b8-4349-bcbe-13e23117d0c6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1266 microversion: 2.1 time: 0.089126 Jul 14 15:38:57.573738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 143/315] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:57 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:58.189236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d315a9d7-cab7-49fb-95df-14938c5b5ff8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:58.189858 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d315a9d7-cab7-49fb-95df-14938c5b5ff8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:58.198728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d315a9d7-cab7-49fb-95df-14938c5b5ff8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:58.199188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d315a9d7-cab7-49fb-95df-14938c5b5ff8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:58.199990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d315a9d7-cab7-49fb-95df-14938c5b5ff8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:58.200565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d315a9d7-cab7-49fb-95df-14938c5b5ff8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:58.342341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d315a9d7-cab7-49fb-95df-14938c5b5ff8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:58.350457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d315a9d7-cab7-49fb-95df-14938c5b5ff8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1507 microversion: 2.1 time: 0.165348 Jul 14 15:38:58.351134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 173/316] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:58 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1507 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:58.591449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-91c92a29-4ed6-4ae8-aa3d-a516cf87e3ac tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:58.592745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-91c92a29-4ed6-4ae8-aa3d-a516cf87e3ac tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:58.600703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91c92a29-4ed6-4ae8-aa3d-a516cf87e3ac tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:58.601370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91c92a29-4ed6-4ae8-aa3d-a516cf87e3ac tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:58.602170 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91c92a29-4ed6-4ae8-aa3d-a516cf87e3ac tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:58.602586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91c92a29-4ed6-4ae8-aa3d-a516cf87e3ac tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:58.686343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-91c92a29-4ed6-4ae8-aa3d-a516cf87e3ac tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:58.696529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-91c92a29-4ed6-4ae8-aa3d-a516cf87e3ac tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1274 microversion: 2.1 time: 0.109649 Jul 14 15:38:58.697108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 144/317] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:58 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1274 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:38:58.979979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fb7be460-1595-4c7e-b3b8-b21235739eb3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:38:58.981146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fb7be460-1595-4c7e-b3b8-b21235739eb3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:58.998203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb7be460-1595-4c7e-b3b8-b21235739eb3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:58.998758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb7be460-1595-4c7e-b3b8-b21235739eb3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:58.999628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb7be460-1595-4c7e-b3b8-b21235739eb3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:59.000358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb7be460-1595-4c7e-b3b8-b21235739eb3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:59.035418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-fb7be460-1595-4c7e-b3b8-b21235739eb3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'flavor' on Instance uuid 15c97816-6d05-424a-832a-48500a73d87f {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:38:59.177923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fb7be460-1595-4c7e-b3b8-b21235739eb3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "POST /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f/action" status: 200 len: 32 microversion: 2.1 time: 0.202035 Jul 14 15:38:59.183318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 174/318] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 15:38:58 2022] POST /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f/action => generated 32 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:38:59.193153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f538f4a5-ff90-499a-8e59-b393cd1320c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:59.193922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f538f4a5-ff90-499a-8e59-b393cd1320c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:59.201439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f538f4a5-ff90-499a-8e59-b393cd1320c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:59.202010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f538f4a5-ff90-499a-8e59-b393cd1320c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:59.202912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f538f4a5-ff90-499a-8e59-b393cd1320c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:59.203628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f538f4a5-ff90-499a-8e59-b393cd1320c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:59.248857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:38:59.518511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f538f4a5-ff90-499a-8e59-b393cd1320c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:38:59.528950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f538f4a5-ff90-499a-8e59-b393cd1320c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.343938 Jul 14 15:38:59.529701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 145/319] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:59 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:38:59.714651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fe5b6f12-2deb-4c3a-b130-4695f6ba03fd tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:38:59.716215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fe5b6f12-2deb-4c3a-b130-4695f6ba03fd tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:38:59.727758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe5b6f12-2deb-4c3a-b130-4695f6ba03fd tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:59.728453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe5b6f12-2deb-4c3a-b130-4695f6ba03fd tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:38:59.729450 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe5b6f12-2deb-4c3a-b130-4695f6ba03fd tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:38:59.730938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe5b6f12-2deb-4c3a-b130-4695f6ba03fd tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:00.131721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fe5b6f12-2deb-4c3a-b130-4695f6ba03fd tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:00.143531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fe5b6f12-2deb-4c3a-b130-4695f6ba03fd tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1314 microversion: 2.1 time: 0.433047 Jul 14 15:39:00.144575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 175/320] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:38:59 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1314 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:00.550058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9b746544-b2e9-4a63-9c32-c12ffef85845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:00.551391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9b746544-b2e9-4a63-9c32-c12ffef85845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:00.567861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b746544-b2e9-4a63-9c32-c12ffef85845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:00.569948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b746544-b2e9-4a63-9c32-c12ffef85845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:00.571367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b746544-b2e9-4a63-9c32-c12ffef85845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:00.572451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b746544-b2e9-4a63-9c32-c12ffef85845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:00.950767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9b746544-b2e9-4a63-9c32-c12ffef85845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:00.963362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9b746544-b2e9-4a63-9c32-c12ffef85845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.418731 Jul 14 15:39:00.966876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 146/321] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:00 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:01.117198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-bb09be20-0375-4589-b6e5-208347785833 req-500731ea-e518-40a6-8007-b41d7422595c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7", "tag": "bf0f6faf-1d33-495c-a1a0-f228c9e57587"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:01.151541 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-bb09be20-0375-4589-b6e5-208347785833 req-500731ea-e518-40a6-8007-b41d7422595c service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:01.152013 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-bb09be20-0375-4589-b6e5-208347785833 req-500731ea-e518-40a6-8007-b41d7422595c service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:01.162059 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1ba7078e-d9fa-4776-a728-79c457e6c8a9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:01.163119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1ba7078e-d9fa-4776-a728-79c457e6c8a9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:01.171587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1ba7078e-d9fa-4776-a728-79c457e6c8a9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:01.177459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1ba7078e-d9fa-4776-a728-79c457e6c8a9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:01.178379 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1ba7078e-d9fa-4776-a728-79c457e6c8a9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:01.178699 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1ba7078e-d9fa-4776-a728-79c457e6c8a9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:01.182396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-bb09be20-0375-4589-b6e5-208347785833 req-500731ea-e518-40a6-8007-b41d7422595c service nova] Creating event network-changed:bf0f6faf-1d33-495c-a1a0-f228c9e57587 for instance 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 on hv-cinder-82651 Jul 14 15:39:01.191635 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-bb09be20-0375-4589-b6e5-208347785833 req-500731ea-e518-40a6-8007-b41d7422595c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084376 Jul 14 15:39:01.192437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 176/322] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:01.442281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1ba7078e-d9fa-4776-a728-79c457e6c8a9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:01.451522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1ba7078e-d9fa-4776-a728-79c457e6c8a9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1314 microversion: 2.1 time: 0.293094 Jul 14 15:39:01.453353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 147/323] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:01 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:01.990338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9b47e6e7-2141-4ec5-ad79-d3ae6c38054e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:01.991298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9b47e6e7-2141-4ec5-ad79-d3ae6c38054e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:01.998808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b47e6e7-2141-4ec5-ad79-d3ae6c38054e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:01.999263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b47e6e7-2141-4ec5-ad79-d3ae6c38054e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:02.000622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b47e6e7-2141-4ec5-ad79-d3ae6c38054e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:02.000622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b47e6e7-2141-4ec5-ad79-d3ae6c38054e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:02.243202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9b47e6e7-2141-4ec5-ad79-d3ae6c38054e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:02.254146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9b47e6e7-2141-4ec5-ad79-d3ae6c38054e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.269290 Jul 14 15:39:02.264390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 177/324] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:01 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:02.471527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0f55c0a5-eaf2-4fbf-8904-fe8838ae0243 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:02.473040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0f55c0a5-eaf2-4fbf-8904-fe8838ae0243 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:02.480838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f55c0a5-eaf2-4fbf-8904-fe8838ae0243 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:02.481200 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f55c0a5-eaf2-4fbf-8904-fe8838ae0243 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:02.482009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f55c0a5-eaf2-4fbf-8904-fe8838ae0243 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:02.482579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f55c0a5-eaf2-4fbf-8904-fe8838ae0243 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:02.727799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0f55c0a5-eaf2-4fbf-8904-fe8838ae0243 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:02.736747 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0f55c0a5-eaf2-4fbf-8904-fe8838ae0243 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1314 microversion: 2.1 time: 0.269997 Jul 14 15:39:02.739669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 148/325] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:02 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:03.274317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9bdbf6c9-67f1-4769-89ae-4594e523c2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:03.275149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9bdbf6c9-67f1-4769-89ae-4594e523c2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:03.282655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9bdbf6c9-67f1-4769-89ae-4594e523c2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:03.283393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9bdbf6c9-67f1-4769-89ae-4594e523c2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:03.284293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9bdbf6c9-67f1-4769-89ae-4594e523c2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:03.284780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9bdbf6c9-67f1-4769-89ae-4594e523c2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:03.503493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9bdbf6c9-67f1-4769-89ae-4594e523c2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:03.511324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9bdbf6c9-67f1-4769-89ae-4594e523c2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.241959 Jul 14 15:39:03.511996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 178/326] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:03 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:03.755564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c0a6555e-b7c7-468f-a9d2-793502186a63 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:03.757242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c0a6555e-b7c7-468f-a9d2-793502186a63 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:03.773756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0a6555e-b7c7-468f-a9d2-793502186a63 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:03.774490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0a6555e-b7c7-468f-a9d2-793502186a63 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:03.775422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0a6555e-b7c7-468f-a9d2-793502186a63 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:03.776068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0a6555e-b7c7-468f-a9d2-793502186a63 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:04.088689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c0a6555e-b7c7-468f-a9d2-793502186a63 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:04.096664 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c0a6555e-b7c7-468f-a9d2-793502186a63 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1314 microversion: 2.1 time: 0.346421 Jul 14 15:39:04.106411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 149/327] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:03 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1314 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:04.529353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-30d710a6-145c-4411-a6d0-b27e00631ee9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:04.530056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-30d710a6-145c-4411-a6d0-b27e00631ee9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:04.537437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30d710a6-145c-4411-a6d0-b27e00631ee9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:04.538265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30d710a6-145c-4411-a6d0-b27e00631ee9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:04.539216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30d710a6-145c-4411-a6d0-b27e00631ee9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:04.539762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30d710a6-145c-4411-a6d0-b27e00631ee9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:05.019837 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-30d710a6-145c-4411-a6d0-b27e00631ee9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:05.028298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-30d710a6-145c-4411-a6d0-b27e00631ee9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.502990 Jul 14 15:39:05.029081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 179/328] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:04 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:05.114210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9e696faf-398f-4719-adfe-30f7ffe43c8b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:05.114846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9e696faf-398f-4719-adfe-30f7ffe43c8b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:05.121427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e696faf-398f-4719-adfe-30f7ffe43c8b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:05.124901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e696faf-398f-4719-adfe-30f7ffe43c8b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:05.125805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e696faf-398f-4719-adfe-30f7ffe43c8b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:05.126538 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e696faf-398f-4719-adfe-30f7ffe43c8b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:05.360864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9e696faf-398f-4719-adfe-30f7ffe43c8b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:05.372530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9e696faf-398f-4719-adfe-30f7ffe43c8b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1314 microversion: 2.1 time: 0.262836 Jul 14 15:39:05.373287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 150/329] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:05 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1314 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:06.049397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8931588a-2dd1-40db-9673-95016348c3bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:06.050014 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8931588a-2dd1-40db-9673-95016348c3bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:06.056149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8931588a-2dd1-40db-9673-95016348c3bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:06.056595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8931588a-2dd1-40db-9673-95016348c3bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:06.057392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8931588a-2dd1-40db-9673-95016348c3bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:06.057827 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8931588a-2dd1-40db-9673-95016348c3bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:06.231516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8931588a-2dd1-40db-9673-95016348c3bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:06.238669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:06.242130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8931588a-2dd1-40db-9673-95016348c3bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.198602 Jul 14 15:39:06.242729 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 180/330] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:06 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:06.392626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0db7e119-28f3-41da-bafd-00f5db9c0e38 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:06.394166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0db7e119-28f3-41da-bafd-00f5db9c0e38 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:06.404203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0db7e119-28f3-41da-bafd-00f5db9c0e38 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:06.405261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0db7e119-28f3-41da-bafd-00f5db9c0e38 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:06.406782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0db7e119-28f3-41da-bafd-00f5db9c0e38 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:06.407371 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0db7e119-28f3-41da-bafd-00f5db9c0e38 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:06.469151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:06.694602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0db7e119-28f3-41da-bafd-00f5db9c0e38 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:06.702194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0db7e119-28f3-41da-bafd-00f5db9c0e38 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1314 microversion: 2.1 time: 0.315533 Jul 14 15:39:06.711946 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 151/331] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:06 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1314 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:07.270597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-95b8f949-3a97-4613-a7fa-2267df7a9398 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:07.271331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-95b8f949-3a97-4613-a7fa-2267df7a9398 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:07.280371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:07.281229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=6 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:07.304240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-95b8f949-3a97-4613-a7fa-2267df7a9398 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:07.306226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-95b8f949-3a97-4613-a7fa-2267df7a9398 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:07.307156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-95b8f949-3a97-4613-a7fa-2267df7a9398 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:07.308718 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-95b8f949-3a97-4613-a7fa-2267df7a9398 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:07.429854 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-3c0fcef1-bbaa-4ee5-b949-17c8b644739c req-41472545-d98a-4b03-b837-99fdaa90ba30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7", "name": "network-vif-plugged", "status": "completed", "tag": "bf0f6faf-1d33-495c-a1a0-f228c9e57587"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:07.455300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-3c0fcef1-bbaa-4ee5-b949-17c8b644739c req-41472545-d98a-4b03-b837-99fdaa90ba30 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:07.456188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-3c0fcef1-bbaa-4ee5-b949-17c8b644739c req-41472545-d98a-4b03-b837-99fdaa90ba30 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:07.481673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-3c0fcef1-bbaa-4ee5-b949-17c8b644739c req-41472545-d98a-4b03-b837-99fdaa90ba30 service nova] Creating event network-vif-plugged:bf0f6faf-1d33-495c-a1a0-f228c9e57587 for instance 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 on hv-cinder-82651 Jul 14 15:39:07.499853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-3c0fcef1-bbaa-4ee5-b949-17c8b644739c req-41472545-d98a-4b03-b837-99fdaa90ba30 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.073254 Jul 14 15:39:07.501771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 152/332] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:07.540560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-95b8f949-3a97-4613-a7fa-2267df7a9398 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:07.552874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-95b8f949-3a97-4613-a7fa-2267df7a9398 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.294732 Jul 14 15:39:07.554414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 181/333] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:07 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:07.719408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-71e82952-65bf-4aca-8a01-b1710e75b8ba tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:07.720892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-71e82952-65bf-4aca-8a01-b1710e75b8ba tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:07.729934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-71e82952-65bf-4aca-8a01-b1710e75b8ba tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:07.730837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-71e82952-65bf-4aca-8a01-b1710e75b8ba tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:07.732210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-71e82952-65bf-4aca-8a01-b1710e75b8ba tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:07.732912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-71e82952-65bf-4aca-8a01-b1710e75b8ba tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:08.192252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-71e82952-65bf-4aca-8a01-b1710e75b8ba tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:08.213164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-71e82952-65bf-4aca-8a01-b1710e75b8ba tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1314 microversion: 2.1 time: 0.498008 Jul 14 15:39:08.215117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 153/334] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:07 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1314 bytes in 500 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:08.572617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f028f2c9-3f8b-405e-ad59-d65964b4c487 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:08.573240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f028f2c9-3f8b-405e-ad59-d65964b4c487 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:08.585478 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f028f2c9-3f8b-405e-ad59-d65964b4c487 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:08.586466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f028f2c9-3f8b-405e-ad59-d65964b4c487 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:08.587420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f028f2c9-3f8b-405e-ad59-d65964b4c487 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:08.587896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f028f2c9-3f8b-405e-ad59-d65964b4c487 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:08.788454 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f028f2c9-3f8b-405e-ad59-d65964b4c487 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:08.801197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f028f2c9-3f8b-405e-ad59-d65964b4c487 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.233286 Jul 14 15:39:08.802399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 182/335] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:08 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:09.231765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4a935d3d-5694-479c-a09f-61630f9c7439 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:09.232396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4a935d3d-5694-479c-a09f-61630f9c7439 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:09.263145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a935d3d-5694-479c-a09f-61630f9c7439 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:09.264510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a935d3d-5694-479c-a09f-61630f9c7439 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:09.265690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a935d3d-5694-479c-a09f-61630f9c7439 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:09.266325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a935d3d-5694-479c-a09f-61630f9c7439 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:09.554633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4a935d3d-5694-479c-a09f-61630f9c7439 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:09.565216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4a935d3d-5694-479c-a09f-61630f9c7439 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1314 microversion: 2.1 time: 0.338475 Jul 14 15:39:09.565953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 154/336] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:09 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1314 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:09.821713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c54c0936-296b-40f0-8d59-e803d0c592bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:09.822382 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c54c0936-296b-40f0-8d59-e803d0c592bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:09.825620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=6 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:09.830703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c54c0936-296b-40f0-8d59-e803d0c592bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:09.831186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c54c0936-296b-40f0-8d59-e803d0c592bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:09.832053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c54c0936-296b-40f0-8d59-e803d0c592bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:09.832495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c54c0936-296b-40f0-8d59-e803d0c592bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:10.011428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c54c0936-296b-40f0-8d59-e803d0c592bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:10.020863 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c54c0936-296b-40f0-8d59-e803d0c592bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.205679 Jul 14 15:39:10.022405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 183/337] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:09 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:10.588793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1983e103-43ca-4a9c-9fc6-d5715c8ac007 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:10.590163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1983e103-43ca-4a9c-9fc6-d5715c8ac007 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:10.616738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1983e103-43ca-4a9c-9fc6-d5715c8ac007 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:10.617435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1983e103-43ca-4a9c-9fc6-d5715c8ac007 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:10.618222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1983e103-43ca-4a9c-9fc6-d5715c8ac007 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:10.623107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1983e103-43ca-4a9c-9fc6-d5715c8ac007 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:10.865246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1983e103-43ca-4a9c-9fc6-d5715c8ac007 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:10.874002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1983e103-43ca-4a9c-9fc6-d5715c8ac007 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1314 microversion: 2.1 time: 0.295390 Jul 14 15:39:10.874914 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 155/338] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:10 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:11.038494 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d5220a99-428b-40c7-abe8-5bccbdfb4af3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:11.039271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d5220a99-428b-40c7-abe8-5bccbdfb4af3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:11.045737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d5220a99-428b-40c7-abe8-5bccbdfb4af3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:11.046198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d5220a99-428b-40c7-abe8-5bccbdfb4af3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:11.046982 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d5220a99-428b-40c7-abe8-5bccbdfb4af3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:11.047510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d5220a99-428b-40c7-abe8-5bccbdfb4af3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:11.242072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d5220a99-428b-40c7-abe8-5bccbdfb4af3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:11.256415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d5220a99-428b-40c7-abe8-5bccbdfb4af3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.221603 Jul 14 15:39:11.257477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 184/339] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:11 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:11.480383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6460dbee-02f1-4f5c-bb17-2d01e04ab250 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Action: 'create', calling method: .version_select at 0x7f357c03cc10>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-443020232", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDIyVfgqyWEdQ2mUFSlsadBh5s+JMlYRe38qrjb+qoeg68Ccdsik2jFe405LQB/KmJjAZh+hulDmdzElP5T1osse9rmn57vPIEU9+FD6vzD66j2QOp1c07pC4RNvUUNOZA=="}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:11.501402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-6460dbee-02f1-4f5c-bb17-2d01e04ab250 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Getting quotas for project 599a768f6b9d4134a4b8e05a7e5f5e87. Resources: {'key_pairs'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:39:11.505698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-6460dbee-02f1-4f5c-bb17-2d01e04ab250 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Getting quotas for user a0e4900b6ad24eb19fe169d9c8d8c3a7 and project 599a768f6b9d4134a4b8e05a7e5f5e87. Resources: {'key_pairs'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:39:11.551841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6460dbee-02f1-4f5c-bb17-2d01e04ab250 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.252097 Jul 14 15:39:11.553077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 156/340] 10.222.0.99 () {60 vars in 1158 bytes} [Thu Jul 14 15:39:11 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:11.901057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ccc2217c-f5e9-4783-932b-2cf7e8d6556a tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:11.901784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ccc2217c-f5e9-4783-932b-2cf7e8d6556a tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:11.908459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ccc2217c-f5e9-4783-932b-2cf7e8d6556a tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:11.909059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ccc2217c-f5e9-4783-932b-2cf7e8d6556a tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:11.910237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ccc2217c-f5e9-4783-932b-2cf7e8d6556a tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:11.910791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ccc2217c-f5e9-4783-932b-2cf7e8d6556a tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:12.122442 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ccc2217c-f5e9-4783-932b-2cf7e8d6556a tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:12.132146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ccc2217c-f5e9-4783-932b-2cf7e8d6556a tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1497 microversion: 2.1 time: 0.245463 Jul 14 15:39:12.132728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 185/341] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:11 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1497 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:12.281139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cca87af1-5d10-4b4f-920b-4ab59935efee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:12.282371 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cca87af1-5d10-4b4f-920b-4ab59935efee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:12.291451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cca87af1-5d10-4b4f-920b-4ab59935efee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:12.291937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cca87af1-5d10-4b4f-920b-4ab59935efee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:12.292706 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cca87af1-5d10-4b4f-920b-4ab59935efee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:12.293142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cca87af1-5d10-4b4f-920b-4ab59935efee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:12.515398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cca87af1-5d10-4b4f-920b-4ab59935efee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:12.525973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cca87af1-5d10-4b4f-920b-4ab59935efee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.253665 Jul 14 15:39:12.527027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 157/342] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:12 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:12.838121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ba93bd88-e0d1-4bbe-a87b-59f07b6c154e tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:12.838702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ba93bd88-e0d1-4bbe-a87b-59f07b6c154e tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:12.846426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba93bd88-e0d1-4bbe-a87b-59f07b6c154e tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:12.846426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba93bd88-e0d1-4bbe-a87b-59f07b6c154e tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:12.846879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba93bd88-e0d1-4bbe-a87b-59f07b6c154e tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:12.847318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba93bd88-e0d1-4bbe-a87b-59f07b6c154e tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:12.875214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ba93bd88-e0d1-4bbe-a87b-59f07b6c154e tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:39:12.976090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ba93bd88-e0d1-4bbe-a87b-59f07b6c154e tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "DELETE /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 204 len: 0 microversion: 2.1 time: 0.141578 Jul 14 15:39:12.976788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 186/343] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 15:39:12 2022] DELETE /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:39:12.986159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a42f539b-e9e9-4ef6-b878-ae2de4151618 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:12.986937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a42f539b-e9e9-4ef6-b878-ae2de4151618 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:12.993673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a42f539b-e9e9-4ef6-b878-ae2de4151618 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:12.994234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a42f539b-e9e9-4ef6-b878-ae2de4151618 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:12.995017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a42f539b-e9e9-4ef6-b878-ae2de4151618 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:12.995539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a42f539b-e9e9-4ef6-b878-ae2de4151618 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:13.144125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a42f539b-e9e9-4ef6-b878-ae2de4151618 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:13.151801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a42f539b-e9e9-4ef6-b878-ae2de4151618 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1503 microversion: 2.1 time: 0.170542 Jul 14 15:39:13.152368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 158/344] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:12 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1503 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:13.545594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-be82dabe-3b1b-4ffd-92d5-afbb853dc5b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:13.546292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-be82dabe-3b1b-4ffd-92d5-afbb853dc5b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:13.553992 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-be82dabe-3b1b-4ffd-92d5-afbb853dc5b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:13.554440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-be82dabe-3b1b-4ffd-92d5-afbb853dc5b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:13.555434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-be82dabe-3b1b-4ffd-92d5-afbb853dc5b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:13.556119 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-be82dabe-3b1b-4ffd-92d5-afbb853dc5b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:13.694790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-be82dabe-3b1b-4ffd-92d5-afbb853dc5b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:13.704270 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-be82dabe-3b1b-4ffd-92d5-afbb853dc5b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.162868 Jul 14 15:39:13.704895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 187/345] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:13 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:14.168836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e431e1ec-153a-4994-ad08-2baa60f40769 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:14.170237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e431e1ec-153a-4994-ad08-2baa60f40769 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:14.178880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e431e1ec-153a-4994-ad08-2baa60f40769 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:14.179412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e431e1ec-153a-4994-ad08-2baa60f40769 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:14.180302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e431e1ec-153a-4994-ad08-2baa60f40769 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:14.180813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e431e1ec-153a-4994-ad08-2baa60f40769 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:14.349288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e431e1ec-153a-4994-ad08-2baa60f40769 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:14.357307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e431e1ec-153a-4994-ad08-2baa60f40769 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1503 microversion: 2.1 time: 0.192584 Jul 14 15:39:14.358168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 159/346] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:14 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1503 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:14.722287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c0b28c65-dd0c-401e-bf87-9722b0adbea0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:14.722909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c0b28c65-dd0c-401e-bf87-9722b0adbea0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:14.729329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0b28c65-dd0c-401e-bf87-9722b0adbea0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:14.729777 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0b28c65-dd0c-401e-bf87-9722b0adbea0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:14.730576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0b28c65-dd0c-401e-bf87-9722b0adbea0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:14.731013 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0b28c65-dd0c-401e-bf87-9722b0adbea0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:14.868043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c0b28c65-dd0c-401e-bf87-9722b0adbea0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:14.876495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c0b28c65-dd0c-401e-bf87-9722b0adbea0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.158166 Jul 14 15:39:14.877070 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 188/347] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:14 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:15.374862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bba88d87-376a-4ef0-a2a6-d567a3fb649c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:15.376262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bba88d87-376a-4ef0-a2a6-d567a3fb649c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:15.383219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bba88d87-376a-4ef0-a2a6-d567a3fb649c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:15.383740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bba88d87-376a-4ef0-a2a6-d567a3fb649c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:15.384552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bba88d87-376a-4ef0-a2a6-d567a3fb649c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:15.384995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bba88d87-376a-4ef0-a2a6-d567a3fb649c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:15.539656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bba88d87-376a-4ef0-a2a6-d567a3fb649c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:15.548249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bba88d87-376a-4ef0-a2a6-d567a3fb649c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1503 microversion: 2.1 time: 0.177216 Jul 14 15:39:15.548840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 160/348] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:15 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1503 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:15.892968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5d34ad34-7506-4a09-b450-09aaa2c854af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:15.893616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5d34ad34-7506-4a09-b450-09aaa2c854af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:15.899979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d34ad34-7506-4a09-b450-09aaa2c854af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:15.900426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d34ad34-7506-4a09-b450-09aaa2c854af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:15.901183 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d34ad34-7506-4a09-b450-09aaa2c854af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:15.901622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d34ad34-7506-4a09-b450-09aaa2c854af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:16.040858 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5d34ad34-7506-4a09-b450-09aaa2c854af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:16.049418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5d34ad34-7506-4a09-b450-09aaa2c854af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.160077 Jul 14 15:39:16.050723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 189/349] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:15 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:16.566442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a5c351dd-629c-4968-96b2-738703c57629 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:16.567050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a5c351dd-629c-4968-96b2-738703c57629 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:16.573568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a5c351dd-629c-4968-96b2-738703c57629 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:16.574015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a5c351dd-629c-4968-96b2-738703c57629 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:16.574773 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a5c351dd-629c-4968-96b2-738703c57629 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:16.575204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a5c351dd-629c-4968-96b2-738703c57629 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:16.805365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a5c351dd-629c-4968-96b2-738703c57629 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:16.815746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a5c351dd-629c-4968-96b2-738703c57629 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1503 microversion: 2.1 time: 0.254045 Jul 14 15:39:16.816337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 161/350] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:16 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1503 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:17.056964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-92bf03e1-5fa2-4b5a-a2ea-0466ffcdc756 req-693b1254-119d-473e-b2bb-79d6ac7b1fc6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7", "name": "network-vif-deleted", "tag": "bf0f6faf-1d33-495c-a1a0-f228c9e57587"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:17.073899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2cb6a5ee-efd3-49f2-9b9b-158f076a55d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:17.074563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2cb6a5ee-efd3-49f2-9b9b-158f076a55d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:17.077645 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-92bf03e1-5fa2-4b5a-a2ea-0466ffcdc756 req-693b1254-119d-473e-b2bb-79d6ac7b1fc6 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:17.078100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-92bf03e1-5fa2-4b5a-a2ea-0466ffcdc756 req-693b1254-119d-473e-b2bb-79d6ac7b1fc6 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:17.081864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2cb6a5ee-efd3-49f2-9b9b-158f076a55d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:17.083111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2cb6a5ee-efd3-49f2-9b9b-158f076a55d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:17.083952 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2cb6a5ee-efd3-49f2-9b9b-158f076a55d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:17.084383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2cb6a5ee-efd3-49f2-9b9b-158f076a55d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:17.091809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-92bf03e1-5fa2-4b5a-a2ea-0466ffcdc756 req-693b1254-119d-473e-b2bb-79d6ac7b1fc6 service nova] Creating event network-vif-deleted:bf0f6faf-1d33-495c-a1a0-f228c9e57587 for instance 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 on hv-cinder-82651 Jul 14 15:39:17.097950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-92bf03e1-5fa2-4b5a-a2ea-0466ffcdc756 req-693b1254-119d-473e-b2bb-79d6ac7b1fc6 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044589 Jul 14 15:39:17.101881 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 190/351] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:17.239304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2cb6a5ee-efd3-49f2-9b9b-158f076a55d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:17.246717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2cb6a5ee-efd3-49f2-9b9b-158f076a55d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.184186 Jul 14 15:39:17.247277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 162/352] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:17 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:17.834174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ed3fe1cd-affe-4401-9a08-d5c32a945d5d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:17.834880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ed3fe1cd-affe-4401-9a08-d5c32a945d5d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:17.841099 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed3fe1cd-affe-4401-9a08-d5c32a945d5d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:17.841558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed3fe1cd-affe-4401-9a08-d5c32a945d5d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:17.842322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed3fe1cd-affe-4401-9a08-d5c32a945d5d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:17.842762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed3fe1cd-affe-4401-9a08-d5c32a945d5d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:17.878953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed3fe1cd-affe-4401-9a08-d5c32a945d5d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:17.879405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed3fe1cd-affe-4401-9a08-d5c32a945d5d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:17.879890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-ed3fe1cd-affe-4401-9a08-d5c32a945d5d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lazy-loading 'fault' on Instance uuid 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:39:17.927344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ed3fe1cd-affe-4401-9a08-d5c32a945d5d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:17.934170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ed3fe1cd-affe-4401-9a08-d5c32a945d5d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 200 len: 1304 microversion: 2.1 time: 0.105068 Jul 14 15:39:17.934741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 191/353] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:17 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 1304 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:18.264900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1acafc88-f0d5-49fe-a51b-9e0ae7ffa905 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:18.265514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1acafc88-f0d5-49fe-a51b-9e0ae7ffa905 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:18.272749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1acafc88-f0d5-49fe-a51b-9e0ae7ffa905 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:18.273201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1acafc88-f0d5-49fe-a51b-9e0ae7ffa905 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:18.273991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1acafc88-f0d5-49fe-a51b-9e0ae7ffa905 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:18.274433 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1acafc88-f0d5-49fe-a51b-9e0ae7ffa905 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:18.409383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1acafc88-f0d5-49fe-a51b-9e0ae7ffa905 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:18.411687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:18.420166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1acafc88-f0d5-49fe-a51b-9e0ae7ffa905 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.159076 Jul 14 15:39:18.420746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 163/354] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:18 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:18.952870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-135bd2c3-d90e-4113-b8ce-46624fe8b45f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:18.953988 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-135bd2c3-d90e-4113-b8ce-46624fe8b45f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:18.960079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-135bd2c3-d90e-4113-b8ce-46624fe8b45f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:18.960531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-135bd2c3-d90e-4113-b8ce-46624fe8b45f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:18.961291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-135bd2c3-d90e-4113-b8ce-46624fe8b45f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:18.961731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-135bd2c3-d90e-4113-b8ce-46624fe8b45f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:18.975790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-135bd2c3-d90e-4113-b8ce-46624fe8b45f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] HTTP exception thrown: Instance 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 could not be found. Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-135bd2c3-d90e-4113-b8ce-46624fe8b45f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Request method failure captured: Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 HTTP/1.1 Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DiMvBfw4lAZhw96dDpZ1vuDBE-1YVOJTdsSHEkHL-sRRBtG7UCs6bPbz69rLSBbdM99dtSKdjxyE07V2HEVUDQiHHNpTkGkLes25o_4asf19pUYjlkdlHs5mtxVQaLQ3sZOe0-PeNh6S6hve00SWNzZPdn_GIn14wBHPC04JcrDSjw Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 2345d49f9fee4842826a396c43132a33 Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-VolumesActionsTest-888751778 Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:39:18.977420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:39:18.978936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2345d49f9fee4842826a396c43132a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2345d49f9fee4842826a396c43132a33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2345d49f9fee4842826a396c43132a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2345d49f9fee4842826a396c43132a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:39:18.978936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-VolumesActionsTest-888751778 Jul 14 15:39:18.978936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 2345d49f9fee4842826a396c43132a33 Jul 14 15:39:18.978936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-VolumesActionsTest-888751778 Jul 14 15:39:18.978936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-VolumesActionsTest-888751778-project Jul 14 15:39:18.978936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:39:18.978936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:39:18.978936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 1f3411c8a7454203a4fbd748f1f3031a Jul 14 15:39:18.978936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-VolumesActionsTest-888751778-project Jul 14 15:39:18.978936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 15:39:18.978936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 could not be found. Jul 14 15:39:18.978936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7'} Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 could not be found. Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:39:18.979866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 could not be found. Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 could not be found. Jul 14 15:39:18.981236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:39:18.982487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-135bd2c3-d90e-4113-b8ce-46624fe8b45f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Returning 404 to user: Instance 5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:39:18.982487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-135bd2c3-d90e-4113-b8ce-46624fe8b45f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7" status: 404 len: 111 microversion: 2.1 time: 0.029847 Jul 14 15:39:18.982487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 192/355] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:18 2022] GET /compute/v2.1/servers/5c1e8dbc-0a75-48fc-a22c-6b519a6a68f7 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:39:19.081746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1786004343", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "networks": [{"uuid": "d93154e9-8290-48a7-9afe-cb7d3d5763ae"}]}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:19.438361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5b939c05-2c7f-4753-8c55-b58d886e0cea tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:19.439050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5b939c05-2c7f-4753-8c55-b58d886e0cea tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:19.445125 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b939c05-2c7f-4753-8c55-b58d886e0cea tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:19.445602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b939c05-2c7f-4753-8c55-b58d886e0cea tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:19.446363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b939c05-2c7f-4753-8c55-b58d886e0cea tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:19.446801 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b939c05-2c7f-4753-8c55-b58d886e0cea tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:19.591216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5b939c05-2c7f-4753-8c55-b58d886e0cea tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:19.598825 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5b939c05-2c7f-4753-8c55-b58d886e0cea tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.164908 Jul 14 15:39:19.599395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 193/356] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:19 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:20.617875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e2070579-3883-44a4-86e5-64ce7543175d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:20.618522 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e2070579-3883-44a4-86e5-64ce7543175d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:20.624463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e2070579-3883-44a4-86e5-64ce7543175d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:20.624919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e2070579-3883-44a4-86e5-64ce7543175d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:20.626325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e2070579-3883-44a4-86e5-64ce7543175d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:20.626686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e2070579-3883-44a4-86e5-64ce7543175d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:20.758531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e2070579-3883-44a4-86e5-64ce7543175d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:20.769272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e2070579-3883-44a4-86e5-64ce7543175d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.155010 Jul 14 15:39:20.770388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 194/357] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:20 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:20.859002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e51ef1c0-3567-4b77-acfc-b23a560a6b41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:20.859489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e51ef1c0-3567-4b77-acfc-b23a560a6b41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:20.865832 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e51ef1c0-3567-4b77-acfc-b23a560a6b41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:20.866282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e51ef1c0-3567-4b77-acfc-b23a560a6b41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:20.867042 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e51ef1c0-3567-4b77-acfc-b23a560a6b41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:20.867478 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e51ef1c0-3567-4b77-acfc-b23a560a6b41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:20.894709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e51ef1c0-3567-4b77-acfc-b23a560a6b41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/ips" status: 200 len: 152 microversion: 2.20 time: 0.039528 Jul 14 15:39:20.895282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 195/358] 10.222.0.99 () {60 vars in 1288 bytes} [Thu Jul 14 15:39:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/ips => generated 152 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:39:21.512855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=4 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:21.789870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-70911f2a-f02a-499c-9031-6003ed9b7078 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:21.790503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-70911f2a-f02a-499c-9031-6003ed9b7078 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:21.796713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70911f2a-f02a-499c-9031-6003ed9b7078 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:21.797184 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70911f2a-f02a-499c-9031-6003ed9b7078 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:21.798028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70911f2a-f02a-499c-9031-6003ed9b7078 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:21.798475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70911f2a-f02a-499c-9031-6003ed9b7078 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:21.939960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-70911f2a-f02a-499c-9031-6003ed9b7078 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:21.947482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-70911f2a-f02a-499c-9031-6003ed9b7078 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.161503 Jul 14 15:39:21.948098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 196/359] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:21 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:22.966047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-06a8ddbf-6d2c-4cb6-a41e-b66a239dbf31 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:22.966725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-06a8ddbf-6d2c-4cb6-a41e-b66a239dbf31 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:22.973390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06a8ddbf-6d2c-4cb6-a41e-b66a239dbf31 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:22.973837 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06a8ddbf-6d2c-4cb6-a41e-b66a239dbf31 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:22.974607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06a8ddbf-6d2c-4cb6-a41e-b66a239dbf31 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:22.975040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06a8ddbf-6d2c-4cb6-a41e-b66a239dbf31 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:22.977801 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:23.110284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-06a8ddbf-6d2c-4cb6-a41e-b66a239dbf31 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:23.118160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-06a8ddbf-6d2c-4cb6-a41e-b66a239dbf31 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.155879 Jul 14 15:39:23.119264 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 197/360] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:22 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:24.137525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8e63fa90-b3f2-4fb9-9861-aa226bfaa477 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:24.138385 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8e63fa90-b3f2-4fb9-9861-aa226bfaa477 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:24.144506 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e63fa90-b3f2-4fb9-9861-aa226bfaa477 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:24.144950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e63fa90-b3f2-4fb9-9861-aa226bfaa477 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:24.145705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e63fa90-b3f2-4fb9-9861-aa226bfaa477 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:24.146172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e63fa90-b3f2-4fb9-9861-aa226bfaa477 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:24.303011 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8e63fa90-b3f2-4fb9-9861-aa226bfaa477 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:24.310851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8e63fa90-b3f2-4fb9-9861-aa226bfaa477 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.177039 Jul 14 15:39:24.311427 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 198/361] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:24 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:25.096793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7a8d5bd-33ad-47b8-9f1d-cd5d653ef2f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:25.097321 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d7a8d5bd-33ad-47b8-9f1d-cd5d653ef2f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:25.103455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7a8d5bd-33ad-47b8-9f1d-cd5d653ef2f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:25.103935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7a8d5bd-33ad-47b8-9f1d-cd5d653ef2f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:25.104689 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7a8d5bd-33ad-47b8-9f1d-cd5d653ef2f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:25.105119 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7a8d5bd-33ad-47b8-9f1d-cd5d653ef2f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:25.129983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-d7a8d5bd-33ad-47b8-9f1d-cd5d653ef2f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lazy-loading 'flavor' on Instance uuid e5c8cb95-bde5-4c91-99de-27aa44a822bf {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:39:27.132840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.network.neutron [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] validate_networks() for [('d93154e9-8290-48a7-9afe-cb7d3d5763ae', None, None, None, None, None)] {{(pid=124503) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:39:27.295171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d7a8d5bd-33ad-47b8-9f1d-cd5d653ef2f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "POST /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/action" status: 202 len: 0 microversion: 2.20 time: 2.203138 Jul 14 15:39:27.299363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 199/362] 10.222.0.99 () {62 vars in 1318 bytes} [Thu Jul 14 15:39:25 2022] POST /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/action => generated 0 bytes in 2208 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:39:27.304616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1fbdf543-9787-47c8-836c-8c9ed4d86958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:27.305309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1fbdf543-9787-47c8-836c-8c9ed4d86958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:27.311713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fbdf543-9787-47c8-836c-8c9ed4d86958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:27.312500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fbdf543-9787-47c8-836c-8c9ed4d86958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:27.313271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fbdf543-9787-47c8-836c-8c9ed4d86958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:27.313700 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fbdf543-9787-47c8-836c-8c9ed4d86958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:27.466423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1fbdf543-9787-47c8-836c-8c9ed4d86958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:27.475486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1fbdf543-9787-47c8-836c-8c9ed4d86958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.174797 Jul 14 15:39:27.486172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 200/363] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:27 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:27.491607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-de4ae7b2-5a05-41b5-bcf3-60882643de86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:27.492332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-de4ae7b2-5a05-41b5-bcf3-60882643de86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:27.500853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-de4ae7b2-5a05-41b5-bcf3-60882643de86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:27.500853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-de4ae7b2-5a05-41b5-bcf3-60882643de86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:27.504401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-de4ae7b2-5a05-41b5-bcf3-60882643de86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:27.507175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-de4ae7b2-5a05-41b5-bcf3-60882643de86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:27.534644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Flavor limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:39:27.535101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Image limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:39:27.535589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Flavor pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:39:27.537561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Image pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:39:27.537993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:39:27.543343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:27.567931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:27.568842 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:27.569938 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:27.570809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:27.593567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Getting quotas for project 2345d49f9fee4842826a396c43132a33. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:39:27.603202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Getting quotas for user 1f3411c8a7454203a4fbd748f1f3031a and project 2345d49f9fee4842826a396c43132a33. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:39:27.626394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Going to run 1 instances... {{(pid=124503) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:39:27.629706 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124503) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:39:27.702785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-52b20190-430d-46aa-87ae-85b167f3048f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 8.625525 Jul 14 15:39:27.704199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 164/364] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 15:39:19 2022] POST /compute/v2.1/servers => generated 380 bytes in 8627 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:39:27.716534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-faccd510-b823-4bf0-b35c-4d126fd5140f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:27.717071 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-faccd510-b823-4bf0-b35c-4d126fd5140f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:27.759698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-de4ae7b2-5a05-41b5-bcf3-60882643de86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:27.769725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-de4ae7b2-5a05-41b5-bcf3-60882643de86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:27.773618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-de4ae7b2-5a05-41b5-bcf3-60882643de86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:27.775074 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-de4ae7b2-5a05-41b5-bcf3-60882643de86 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.287892 Jul 14 15:39:27.775900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 201/365] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:27.782228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-faccd510-b823-4bf0-b35c-4d126fd5140f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:27.790225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-faccd510-b823-4bf0-b35c-4d126fd5140f tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1214 microversion: 2.1 time: 0.079626 Jul 14 15:39:27.790798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 165/366] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:27 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1214 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:28.057170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e270686b-ba5d-4d80-852b-b8b13f707245 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:28.057735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e270686b-ba5d-4d80-852b-b8b13f707245 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:28.065433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e270686b-ba5d-4d80-852b-b8b13f707245 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:28.066195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e270686b-ba5d-4d80-852b-b8b13f707245 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:28.067331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e270686b-ba5d-4d80-852b-b8b13f707245 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:28.068574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e270686b-ba5d-4d80-852b-b8b13f707245 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:28.093964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e270686b-ba5d-4d80-852b-b8b13f707245 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/ips" status: 200 len: 144 microversion: 2.1 time: 0.040653 Jul 14 15:39:28.094544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 202/367] 10.222.0.99 () {58 vars in 1247 bytes} [Thu Jul 14 15:39:28 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/ips => generated 144 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:28.493053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bebe8752-4047-4a78-b73c-7003b9a7b9f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:28.493658 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bebe8752-4047-4a78-b73c-7003b9a7b9f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:28.502048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bebe8752-4047-4a78-b73c-7003b9a7b9f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:28.503076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bebe8752-4047-4a78-b73c-7003b9a7b9f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:28.503950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bebe8752-4047-4a78-b73c-7003b9a7b9f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:28.504418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bebe8752-4047-4a78-b73c-7003b9a7b9f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:28.659651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bebe8752-4047-4a78-b73c-7003b9a7b9f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:28.670895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bebe8752-4047-4a78-b73c-7003b9a7b9f9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.181726 Jul 14 15:39:28.676208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 166/368] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:28 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:28.800443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-08df413b-9352-49d4-a8b1-7790f85b04bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:28.801049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-08df413b-9352-49d4-a8b1-7790f85b04bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:28.806505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fa65bde2-6878-484f-9d73-e1cb9470362d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:28.807139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fa65bde2-6878-484f-9d73-e1cb9470362d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:28.807451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-08df413b-9352-49d4-a8b1-7790f85b04bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:28.807943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-08df413b-9352-49d4-a8b1-7790f85b04bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:28.808730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-08df413b-9352-49d4-a8b1-7790f85b04bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:28.809241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-08df413b-9352-49d4-a8b1-7790f85b04bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:28.816350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa65bde2-6878-484f-9d73-e1cb9470362d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:28.816805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa65bde2-6878-484f-9d73-e1cb9470362d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:28.818165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa65bde2-6878-484f-9d73-e1cb9470362d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:28.818876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa65bde2-6878-484f-9d73-e1cb9470362d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:28.886361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fa65bde2-6878-484f-9d73-e1cb9470362d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:28.897032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fa65bde2-6878-484f-9d73-e1cb9470362d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1218 microversion: 2.1 time: 0.094022 Jul 14 15:39:28.898376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 167/369] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:28 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1218 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:28.978431 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-08df413b-9352-49d4-a8b1-7790f85b04bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:28.988826 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-08df413b-9352-49d4-a8b1-7790f85b04bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:28.990650 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-08df413b-9352-49d4-a8b1-7790f85b04bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:28.991864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-08df413b-9352-49d4-a8b1-7790f85b04bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.198964 Jul 14 15:39:28.992678 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 203/370] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:28 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:29.689600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6218d49c-44bc-4f5a-8f49-1ef48527535b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:29.690225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6218d49c-44bc-4f5a-8f49-1ef48527535b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:29.696992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6218d49c-44bc-4f5a-8f49-1ef48527535b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:29.697443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6218d49c-44bc-4f5a-8f49-1ef48527535b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:29.698219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6218d49c-44bc-4f5a-8f49-1ef48527535b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:29.698689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6218d49c-44bc-4f5a-8f49-1ef48527535b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:29.853765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6218d49c-44bc-4f5a-8f49-1ef48527535b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:29.862406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6218d49c-44bc-4f5a-8f49-1ef48527535b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.177341 Jul 14 15:39:29.863080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 168/371] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:29 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:29.917797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9ea1f49c-cacf-4ed9-a477-c27b48ae1318 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:29.918553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9ea1f49c-cacf-4ed9-a477-c27b48ae1318 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:29.929561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9ea1f49c-cacf-4ed9-a477-c27b48ae1318 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:29.930009 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9ea1f49c-cacf-4ed9-a477-c27b48ae1318 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:29.931280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9ea1f49c-cacf-4ed9-a477-c27b48ae1318 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:29.931749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9ea1f49c-cacf-4ed9-a477-c27b48ae1318 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:30.016104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9ea1f49c-cacf-4ed9-a477-c27b48ae1318 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:30.020797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ecd8acc2-9c3e-4b24-becb-609bd1a69479 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:30.021416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ecd8acc2-9c3e-4b24-becb-609bd1a69479 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:30.025792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9ea1f49c-cacf-4ed9-a477-c27b48ae1318 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1210 microversion: 2.1 time: 0.112720 Jul 14 15:39:30.035697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 204/372] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:29 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1210 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:30.035894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ecd8acc2-9c3e-4b24-becb-609bd1a69479 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:30.035894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ecd8acc2-9c3e-4b24-becb-609bd1a69479 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:30.035894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ecd8acc2-9c3e-4b24-becb-609bd1a69479 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:30.035894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ecd8acc2-9c3e-4b24-becb-609bd1a69479 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:30.187879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ecd8acc2-9c3e-4b24-becb-609bd1a69479 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:30.198299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ecd8acc2-9c3e-4b24-becb-609bd1a69479 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:30.199850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ecd8acc2-9c3e-4b24-becb-609bd1a69479 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:30.201044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ecd8acc2-9c3e-4b24-becb-609bd1a69479 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.186270 Jul 14 15:39:30.201901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 169/373] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:30 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:39:30.879337 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-208dc720-f104-4d5a-99ad-8ab36b2a1545 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:30.880078 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-208dc720-f104-4d5a-99ad-8ab36b2a1545 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:30.886107 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-208dc720-f104-4d5a-99ad-8ab36b2a1545 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:30.886561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-208dc720-f104-4d5a-99ad-8ab36b2a1545 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:30.887315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-208dc720-f104-4d5a-99ad-8ab36b2a1545 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:30.887791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-208dc720-f104-4d5a-99ad-8ab36b2a1545 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:31.039918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-208dc720-f104-4d5a-99ad-8ab36b2a1545 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:31.044453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dd67120e-c40c-45e8-84ed-bb8da0564454 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:31.045085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dd67120e-c40c-45e8-84ed-bb8da0564454 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:31.048135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-208dc720-f104-4d5a-99ad-8ab36b2a1545 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.172772 Jul 14 15:39:31.048905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 205/374] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:30 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:31.052237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dd67120e-c40c-45e8-84ed-bb8da0564454 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:31.052691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dd67120e-c40c-45e8-84ed-bb8da0564454 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:31.053487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dd67120e-c40c-45e8-84ed-bb8da0564454 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:31.053931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dd67120e-c40c-45e8-84ed-bb8da0564454 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:31.120099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dd67120e-c40c-45e8-84ed-bb8da0564454 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:31.128725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dd67120e-c40c-45e8-84ed-bb8da0564454 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1266 microversion: 2.1 time: 0.088041 Jul 14 15:39:31.129468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 170/375] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:31 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1266 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:31.219196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d83cf3d0-3c1b-42fa-94f1-9ce375db7efd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:31.219866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d83cf3d0-3c1b-42fa-94f1-9ce375db7efd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:31.226572 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d83cf3d0-3c1b-42fa-94f1-9ce375db7efd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:31.227020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d83cf3d0-3c1b-42fa-94f1-9ce375db7efd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:31.227936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d83cf3d0-3c1b-42fa-94f1-9ce375db7efd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:31.228408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d83cf3d0-3c1b-42fa-94f1-9ce375db7efd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:31.371728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d83cf3d0-3c1b-42fa-94f1-9ce375db7efd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:31.381025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d83cf3d0-3c1b-42fa-94f1-9ce375db7efd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:31.382525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d83cf3d0-3c1b-42fa-94f1-9ce375db7efd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:31.383779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d83cf3d0-3c1b-42fa-94f1-9ce375db7efd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.168410 Jul 14 15:39:31.384357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 206/376] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:31 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:32.066613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-394e42ea-ab69-415b-9ffd-f32e3a3bacdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:32.067218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-394e42ea-ab69-415b-9ffd-f32e3a3bacdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:32.073667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-394e42ea-ab69-415b-9ffd-f32e3a3bacdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:32.074111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-394e42ea-ab69-415b-9ffd-f32e3a3bacdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:32.074857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-394e42ea-ab69-415b-9ffd-f32e3a3bacdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:32.075295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-394e42ea-ab69-415b-9ffd-f32e3a3bacdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:32.146696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b4cfdc10-594d-4685-a551-1cc8006e5e54 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:32.147555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b4cfdc10-594d-4685-a551-1cc8006e5e54 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:32.153490 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b4cfdc10-594d-4685-a551-1cc8006e5e54 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:32.153932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b4cfdc10-594d-4685-a551-1cc8006e5e54 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:32.154688 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b4cfdc10-594d-4685-a551-1cc8006e5e54 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:32.155125 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b4cfdc10-594d-4685-a551-1cc8006e5e54 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:32.225353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-394e42ea-ab69-415b-9ffd-f32e3a3bacdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:32.227084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b4cfdc10-594d-4685-a551-1cc8006e5e54 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:32.235058 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b4cfdc10-594d-4685-a551-1cc8006e5e54 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1266 microversion: 2.1 time: 0.092666 Jul 14 15:39:32.236661 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-394e42ea-ab69-415b-9ffd-f32e3a3bacdd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.173573 Jul 14 15:39:32.236933 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 207/377] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:32 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1266 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:32.237244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 171/378] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:32 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:32.402543 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bd72d0e7-5bf4-438f-81bb-0ce04a97e33a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:32.403158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bd72d0e7-5bf4-438f-81bb-0ce04a97e33a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:32.409830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bd72d0e7-5bf4-438f-81bb-0ce04a97e33a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:32.410283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bd72d0e7-5bf4-438f-81bb-0ce04a97e33a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:32.411044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bd72d0e7-5bf4-438f-81bb-0ce04a97e33a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:32.411484 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bd72d0e7-5bf4-438f-81bb-0ce04a97e33a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:32.542606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bd72d0e7-5bf4-438f-81bb-0ce04a97e33a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:32.551979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bd72d0e7-5bf4-438f-81bb-0ce04a97e33a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:32.553422 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bd72d0e7-5bf4-438f-81bb-0ce04a97e33a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:32.554594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bd72d0e7-5bf4-438f-81bb-0ce04a97e33a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.156040 Jul 14 15:39:32.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 208/379] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:33.253198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5ce9485a-5cd7-4e89-8e76-f81d9045ff6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:33.253834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-48342db2-5f59-400c-b344-7439f3221b81 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:33.254216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5ce9485a-5cd7-4e89-8e76-f81d9045ff6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:33.254318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-48342db2-5f59-400c-b344-7439f3221b81 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:33.260028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ce9485a-5cd7-4e89-8e76-f81d9045ff6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:33.260475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ce9485a-5cd7-4e89-8e76-f81d9045ff6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:33.261244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ce9485a-5cd7-4e89-8e76-f81d9045ff6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:33.261484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48342db2-5f59-400c-b344-7439f3221b81 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:33.261736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ce9485a-5cd7-4e89-8e76-f81d9045ff6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:33.261942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48342db2-5f59-400c-b344-7439f3221b81 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:33.262818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48342db2-5f59-400c-b344-7439f3221b81 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:33.263289 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48342db2-5f59-400c-b344-7439f3221b81 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:33.325747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5ce9485a-5cd7-4e89-8e76-f81d9045ff6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:33.333942 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5ce9485a-5cd7-4e89-8e76-f81d9045ff6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1274 microversion: 2.1 time: 0.084605 Jul 14 15:39:33.334717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 209/380] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:33 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1274 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:33.402629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-48342db2-5f59-400c-b344-7439f3221b81 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:33.410423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-48342db2-5f59-400c-b344-7439f3221b81 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1502 microversion: 2.1 time: 0.161127 Jul 14 15:39:33.410987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 172/381] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:33 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1502 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:33.427315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5227861c-c973-41d3-9c6c-5936d5ba3fe6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "798556b1-41ae-4a63-afa2-e543a22eeab8"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:33.428476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5227861c-c973-41d3-9c6c-5936d5ba3fe6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:33.434469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5227861c-c973-41d3-9c6c-5936d5ba3fe6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:33.434919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5227861c-c973-41d3-9c6c-5936d5ba3fe6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:33.435702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5227861c-c973-41d3-9c6c-5936d5ba3fe6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:33.436144 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5227861c-c973-41d3-9c6c-5936d5ba3fe6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:33.460840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-5227861c-c973-41d3-9c6c-5936d5ba3fe6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Cannot 'attach_volume' instance 15c97816-6d05-424a-832a-48500a73d87f while it is in vm_state rescued Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5227861c-c973-41d3-9c6c-5936d5ba3fe6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: POST /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f/os-volume_attachments HTTP/1.1 Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 74 Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:39:33.462488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:39:33.464134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:39:33.464134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:39:33.464134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:39:33.464134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:39:33.464134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:39:33.464134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:39:33.464134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:39:33.464134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 15:39:33.464134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:39:33.464134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Jul 14 15:39:33.464134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {"volumeAttachment": {"volumeId": "798556b1-41ae-4a63-afa2-e543a22eeab8"}} Jul 14 15:39:33.464134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Cannot 'attach_volume' instance 15c97816-6d05-424a-832a-48500a73d87f while it is in vm_state rescued Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'server_id': '15c97816-6d05-424a-832a-48500a73d87f', 'body': {'volumeAttachment': {'volumeId': '798556b1-41ae-4a63-afa2-e543a22eeab8'}}} Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 15c97816-6d05-424a-832a-48500a73d87f in vm_state rescued. Cannot attach_volume while the instance is in this state. Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:39:33.465113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 15c97816-6d05-424a-832a-48500a73d87f while it is in vm_state rescued Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:39:33.466561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:39:33.468171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:39:33.468171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:39:33.468171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 15c97816-6d05-424a-832a-48500a73d87f while it is in vm_state rescued Jul 14 15:39:33.468171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:39:33.468171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5227861c-c973-41d3-9c6c-5936d5ba3fe6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 409 to user: Cannot 'attach_volume' instance 15c97816-6d05-424a-832a-48500a73d87f while it is in vm_state rescued {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:39:33.468171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5227861c-c973-41d3-9c6c-5936d5ba3fe6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "POST /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.041142 Jul 14 15:39:33.468171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 210/382] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 15:39:33 2022] POST /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:39:33.473752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-04b1740d-bced-4ddd-a98d-8fd8175bd5fe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:33.474280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-04b1740d-bced-4ddd-a98d-8fd8175bd5fe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:33.480249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-04b1740d-bced-4ddd-a98d-8fd8175bd5fe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:33.480692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-04b1740d-bced-4ddd-a98d-8fd8175bd5fe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:33.481455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-04b1740d-bced-4ddd-a98d-8fd8175bd5fe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:33.481874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-04b1740d-bced-4ddd-a98d-8fd8175bd5fe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:33.552087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-04b1740d-bced-4ddd-a98d-8fd8175bd5fe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "POST /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f/action" status: 202 len: 0 microversion: 2.1 time: 0.082091 Jul 14 15:39:33.555680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 173/383] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 15:39:33 2022] POST /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f/action => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:39:33.560700 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-591db86a-c4ed-4222-af24-960479e2519d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:33.561306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-591db86a-c4ed-4222-af24-960479e2519d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:33.568732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-591db86a-c4ed-4222-af24-960479e2519d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:33.569177 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-591db86a-c4ed-4222-af24-960479e2519d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:33.569938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-591db86a-c4ed-4222-af24-960479e2519d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:33.570374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-591db86a-c4ed-4222-af24-960479e2519d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:33.572991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a70905c4-1137-4aaf-bcb7-e24b11915aa9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:33.573720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a70905c4-1137-4aaf-bcb7-e24b11915aa9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:33.580531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a70905c4-1137-4aaf-bcb7-e24b11915aa9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:33.580978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a70905c4-1137-4aaf-bcb7-e24b11915aa9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:33.581746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a70905c4-1137-4aaf-bcb7-e24b11915aa9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:33.582184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a70905c4-1137-4aaf-bcb7-e24b11915aa9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:33.707877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-591db86a-c4ed-4222-af24-960479e2519d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:33.718190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-591db86a-c4ed-4222-af24-960479e2519d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1510 microversion: 2.1 time: 0.160826 Jul 14 15:39:33.718551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a70905c4-1137-4aaf-bcb7-e24b11915aa9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:33.719016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 211/384] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:33 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1510 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:33.729461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a70905c4-1137-4aaf-bcb7-e24b11915aa9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:33.731117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a70905c4-1137-4aaf-bcb7-e24b11915aa9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:33.732310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a70905c4-1137-4aaf-bcb7-e24b11915aa9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.163492 Jul 14 15:39:33.732863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 174/385] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:33 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:39:34.350673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-68487189-bcaa-4bdb-8da7-0349cceca69d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:34.351460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-68487189-bcaa-4bdb-8da7-0349cceca69d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:34.357664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68487189-bcaa-4bdb-8da7-0349cceca69d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:34.358238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68487189-bcaa-4bdb-8da7-0349cceca69d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:34.359261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68487189-bcaa-4bdb-8da7-0349cceca69d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:34.359869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68487189-bcaa-4bdb-8da7-0349cceca69d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:34.376994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:34.613818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-68487189-bcaa-4bdb-8da7-0349cceca69d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:34.621597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-68487189-bcaa-4bdb-8da7-0349cceca69d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.274820 Jul 14 15:39:34.622480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 212/386] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:34 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:34.738066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f0454796-a584-4bbb-95b5-78d16a4417df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:34.738786 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f0454796-a584-4bbb-95b5-78d16a4417df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:34.747816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f0454796-a584-4bbb-95b5-78d16a4417df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:34.748584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f0454796-a584-4bbb-95b5-78d16a4417df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:34.749615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f0454796-a584-4bbb-95b5-78d16a4417df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:34.750265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f0454796-a584-4bbb-95b5-78d16a4417df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:34.756022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c088bac9-6fff-4f0e-85b5-3c302798147d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:34.756690 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c088bac9-6fff-4f0e-85b5-3c302798147d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:34.762894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c088bac9-6fff-4f0e-85b5-3c302798147d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:34.763490 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c088bac9-6fff-4f0e-85b5-3c302798147d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:34.764302 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c088bac9-6fff-4f0e-85b5-3c302798147d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:34.765089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c088bac9-6fff-4f0e-85b5-3c302798147d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:34.911214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c088bac9-6fff-4f0e-85b5-3c302798147d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:34.919659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c088bac9-6fff-4f0e-85b5-3c302798147d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:34.921164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c088bac9-6fff-4f0e-85b5-3c302798147d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:34.922320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c088bac9-6fff-4f0e-85b5-3c302798147d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.175975 Jul 14 15:39:34.922880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 213/387] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:34 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:34.985317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f0454796-a584-4bbb-95b5-78d16a4417df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:34.993978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f0454796-a584-4bbb-95b5-78d16a4417df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1510 microversion: 2.1 time: 0.261039 Jul 14 15:39:34.994796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 175/388] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:34 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1510 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:35.604433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-f96b2691-b15f-4140-8d44-448a8ca97c10 req-6ac6bb72-9aee-4151-a968-7aa141401912 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9", "tag": "bb09889c-5c62-4021-bad3-091a7dd6ec8a"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:35.621702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-f96b2691-b15f-4140-8d44-448a8ca97c10 req-6ac6bb72-9aee-4151-a968-7aa141401912 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:35.622621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-f96b2691-b15f-4140-8d44-448a8ca97c10 req-6ac6bb72-9aee-4151-a968-7aa141401912 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:35.635050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-f96b2691-b15f-4140-8d44-448a8ca97c10 req-6ac6bb72-9aee-4151-a968-7aa141401912 service nova] Creating event network-changed:bb09889c-5c62-4021-bad3-091a7dd6ec8a for instance 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 on hv-cinder-82651 Jul 14 15:39:35.639364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8f93caf6-f4f1-455e-9ead-7a5fd959deb6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:35.640047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-f96b2691-b15f-4140-8d44-448a8ca97c10 req-6ac6bb72-9aee-4151-a968-7aa141401912 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043303 Jul 14 15:39:35.640339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8f93caf6-f4f1-455e-9ead-7a5fd959deb6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:35.641109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 214/389] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:35.647562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8f93caf6-f4f1-455e-9ead-7a5fd959deb6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:35.650813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8f93caf6-f4f1-455e-9ead-7a5fd959deb6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:35.651737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8f93caf6-f4f1-455e-9ead-7a5fd959deb6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:35.652320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8f93caf6-f4f1-455e-9ead-7a5fd959deb6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:35.792784 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8f93caf6-f4f1-455e-9ead-7a5fd959deb6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:35.800989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8f93caf6-f4f1-455e-9ead-7a5fd959deb6 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.165623 Jul 14 15:39:35.801486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 176/390] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:35 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:35.942161 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cf93dfd2-124e-41f6-92ae-089a1c73badb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:35.942917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cf93dfd2-124e-41f6-92ae-089a1c73badb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:35.949147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf93dfd2-124e-41f6-92ae-089a1c73badb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:35.949594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf93dfd2-124e-41f6-92ae-089a1c73badb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:35.950355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf93dfd2-124e-41f6-92ae-089a1c73badb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:35.950794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf93dfd2-124e-41f6-92ae-089a1c73badb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:36.012870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-44ec161e-01b1-4b1f-b6d0-963e13bedbe1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:36.013622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-44ec161e-01b1-4b1f-b6d0-963e13bedbe1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:36.020603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-44ec161e-01b1-4b1f-b6d0-963e13bedbe1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:36.021057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-44ec161e-01b1-4b1f-b6d0-963e13bedbe1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:36.022190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-44ec161e-01b1-4b1f-b6d0-963e13bedbe1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:36.022558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-44ec161e-01b1-4b1f-b6d0-963e13bedbe1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:36.099032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cf93dfd2-124e-41f6-92ae-089a1c73badb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:36.108785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cf93dfd2-124e-41f6-92ae-089a1c73badb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:36.111073 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cf93dfd2-124e-41f6-92ae-089a1c73badb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:36.113110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cf93dfd2-124e-41f6-92ae-089a1c73badb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.175380 Jul 14 15:39:36.113572 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 215/391] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:35 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:36.193221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-44ec161e-01b1-4b1f-b6d0-963e13bedbe1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:36.200913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-44ec161e-01b1-4b1f-b6d0-963e13bedbe1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1510 microversion: 2.1 time: 0.191597 Jul 14 15:39:36.201484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 177/392] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:36 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1510 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:36.818908 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-52e115e9-57b6-4c27-bfc9-d85bcb179414 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:36.819517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-52e115e9-57b6-4c27-bfc9-d85bcb179414 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:36.825655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52e115e9-57b6-4c27-bfc9-d85bcb179414 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:36.826096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52e115e9-57b6-4c27-bfc9-d85bcb179414 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:36.826849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52e115e9-57b6-4c27-bfc9-d85bcb179414 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:36.827273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52e115e9-57b6-4c27-bfc9-d85bcb179414 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:36.966363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-52e115e9-57b6-4c27-bfc9-d85bcb179414 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:36.974186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-52e115e9-57b6-4c27-bfc9-d85bcb179414 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.159245 Jul 14 15:39:36.974761 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 216/393] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:36 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:37.133165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-045ec161-d992-4fa8-b57d-afb84add8b72 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:37.134256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-045ec161-d992-4fa8-b57d-afb84add8b72 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:37.142801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-045ec161-d992-4fa8-b57d-afb84add8b72 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:37.143252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-045ec161-d992-4fa8-b57d-afb84add8b72 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:37.144310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-045ec161-d992-4fa8-b57d-afb84add8b72 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:37.144718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-045ec161-d992-4fa8-b57d-afb84add8b72 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:37.218602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6c103760-fd95-4d8a-8321-ab4cd6617fbe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:37.227661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6c103760-fd95-4d8a-8321-ab4cd6617fbe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:37.227661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c103760-fd95-4d8a-8321-ab4cd6617fbe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:37.227661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c103760-fd95-4d8a-8321-ab4cd6617fbe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:37.227661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c103760-fd95-4d8a-8321-ab4cd6617fbe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:37.228208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c103760-fd95-4d8a-8321-ab4cd6617fbe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:37.291619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-045ec161-d992-4fa8-b57d-afb84add8b72 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:37.302073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-045ec161-d992-4fa8-b57d-afb84add8b72 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:37.303648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-045ec161-d992-4fa8-b57d-afb84add8b72 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:37.304906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-045ec161-d992-4fa8-b57d-afb84add8b72 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.177230 Jul 14 15:39:37.305524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 178/394] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:37 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:37.364720 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6c103760-fd95-4d8a-8321-ab4cd6617fbe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:37.372123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6c103760-fd95-4d8a-8321-ab4cd6617fbe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1510 microversion: 2.1 time: 0.157422 Jul 14 15:39:37.372691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 217/395] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:37 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:37.992267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c9f2a5d2-a02b-4483-a21d-c899fa0166af tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:37.992795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c9f2a5d2-a02b-4483-a21d-c899fa0166af tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:37.995915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:37.996654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=8 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:38.000328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c9f2a5d2-a02b-4483-a21d-c899fa0166af tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:38.000792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c9f2a5d2-a02b-4483-a21d-c899fa0166af tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:38.002151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c9f2a5d2-a02b-4483-a21d-c899fa0166af tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:38.002549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c9f2a5d2-a02b-4483-a21d-c899fa0166af tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:38.155405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c9f2a5d2-a02b-4483-a21d-c899fa0166af tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:38.165553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c9f2a5d2-a02b-4483-a21d-c899fa0166af tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.177031 Jul 14 15:39:38.166141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 179/396] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:37 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:38.324001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4feeca9b-a0ed-4779-83f8-59e5cf38491c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:38.324900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4feeca9b-a0ed-4779-83f8-59e5cf38491c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:38.332162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4feeca9b-a0ed-4779-83f8-59e5cf38491c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:38.332852 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4feeca9b-a0ed-4779-83f8-59e5cf38491c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:38.334363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4feeca9b-a0ed-4779-83f8-59e5cf38491c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:38.335270 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4feeca9b-a0ed-4779-83f8-59e5cf38491c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:38.390881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a8105c53-d77f-4981-81e0-8a46fb655d83 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:38.391843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a8105c53-d77f-4981-81e0-8a46fb655d83 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:38.401923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8105c53-d77f-4981-81e0-8a46fb655d83 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:38.402682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8105c53-d77f-4981-81e0-8a46fb655d83 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:38.403495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8105c53-d77f-4981-81e0-8a46fb655d83 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:38.403955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8105c53-d77f-4981-81e0-8a46fb655d83 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:38.506858 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4feeca9b-a0ed-4779-83f8-59e5cf38491c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:38.513663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4feeca9b-a0ed-4779-83f8-59e5cf38491c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:38.515159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4feeca9b-a0ed-4779-83f8-59e5cf38491c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:38.516342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4feeca9b-a0ed-4779-83f8-59e5cf38491c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.196172 Jul 14 15:39:38.516953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 218/397] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:38.545520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a8105c53-d77f-4981-81e0-8a46fb655d83 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:38.554560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a8105c53-d77f-4981-81e0-8a46fb655d83 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1516 microversion: 2.1 time: 0.168258 Jul 14 15:39:38.555118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 180/398] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:38 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1516 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:39.182955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4466e361-01a7-42a2-8adc-25d092703ee3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:39.182955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4466e361-01a7-42a2-8adc-25d092703ee3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:39.189735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4466e361-01a7-42a2-8adc-25d092703ee3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:39.190240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4466e361-01a7-42a2-8adc-25d092703ee3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:39.191045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4466e361-01a7-42a2-8adc-25d092703ee3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:39.191487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4466e361-01a7-42a2-8adc-25d092703ee3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:39.338756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4466e361-01a7-42a2-8adc-25d092703ee3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:39.346390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4466e361-01a7-42a2-8adc-25d092703ee3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.168077 Jul 14 15:39:39.346958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 219/399] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:39 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:39.534532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a89a5e5b-48c1-4f80-85ad-8c63f78362ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:39.535071 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a89a5e5b-48c1-4f80-85ad-8c63f78362ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:39.541737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a89a5e5b-48c1-4f80-85ad-8c63f78362ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:39.542190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a89a5e5b-48c1-4f80-85ad-8c63f78362ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:39.543026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a89a5e5b-48c1-4f80-85ad-8c63f78362ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:39.543381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a89a5e5b-48c1-4f80-85ad-8c63f78362ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:39.546141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:39.768425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a89a5e5b-48c1-4f80-85ad-8c63f78362ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:39.781539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a89a5e5b-48c1-4f80-85ad-8c63f78362ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:39.785231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a89a5e5b-48c1-4f80-85ad-8c63f78362ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:39.787170 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a89a5e5b-48c1-4f80-85ad-8c63f78362ac tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.256506 Jul 14 15:39:39.788166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 181/400] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:39 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:39.919095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-da794b13-e110-42df-ad20-240ea41d652d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Action: 'create', calling method: .version_select at 0x7f357c084d30>, body: {"keypair": {"name": "tempest-keypair-2068264139", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFgujU1PzL09aWnJzR0byFXSWx/jVYyztBsz0M6nBrqjkqrxHLQj7Q/xPudrlRT7lvJodUiTd5xhwS8tIUUeo2Xad7x+P1JKFuJW/aOctJBcd088VJobzp/BtDUmZBEnWg=="}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:39.924982 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=81,nova_api:UPDATE=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:39.939576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-da794b13-e110-42df-ad20-240ea41d652d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Getting quotas for project 2a542b3ba16943a4ab7d2624d961b4a5. Resources: {'key_pairs'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:39:39.944825 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-da794b13-e110-42df-ad20-240ea41d652d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Getting quotas for user d01c301ea20d4acab8dff1148501a975 and project 2a542b3ba16943a4ab7d2624d961b4a5. Resources: {'key_pairs'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:39:39.990654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-da794b13-e110-42df-ad20-240ea41d652d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.075450 Jul 14 15:39:39.991441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 220/401] 10.222.0.99 () {60 vars in 1158 bytes} [Thu Jul 14 15:39:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:40.364641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-97ee1510-e9b4-4141-98d4-8717fd9610ef tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:40.365663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-97ee1510-e9b4-4141-98d4-8717fd9610ef tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:40.374226 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97ee1510-e9b4-4141-98d4-8717fd9610ef tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:40.374928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97ee1510-e9b4-4141-98d4-8717fd9610ef tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:40.375907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97ee1510-e9b4-4141-98d4-8717fd9610ef tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:40.377559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97ee1510-e9b4-4141-98d4-8717fd9610ef tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:40.405658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9402e9bb-7759-44fa-a91e-b87daa3520f6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5aeb8c58-b548-4b0b-960e-c2b5564d5ff7", "device": "/dev/sdb"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:40.408345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9402e9bb-7759-44fa-a91e-b87daa3520f6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:40.416105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9402e9bb-7759-44fa-a91e-b87daa3520f6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:40.416803 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9402e9bb-7759-44fa-a91e-b87daa3520f6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:40.417762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9402e9bb-7759-44fa-a91e-b87daa3520f6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:40.418864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9402e9bb-7759-44fa-a91e-b87daa3520f6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:40.551487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-97ee1510-e9b4-4141-98d4-8717fd9610ef tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:40.559163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-97ee1510-e9b4-4141-98d4-8717fd9610ef tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.200059 Jul 14 15:39:40.561065 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 182/402] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:40 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:40.806868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7bbd4452-dbce-4764-9484-1f489194f95d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:40.807851 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7bbd4452-dbce-4764-9484-1f489194f95d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:40.814977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7bbd4452-dbce-4764-9484-1f489194f95d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:40.815437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7bbd4452-dbce-4764-9484-1f489194f95d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:40.816252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7bbd4452-dbce-4764-9484-1f489194f95d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:40.816696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7bbd4452-dbce-4764-9484-1f489194f95d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:40.998730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7bbd4452-dbce-4764-9484-1f489194f95d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:41.008470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7bbd4452-dbce-4764-9484-1f489194f95d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:41.009647 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7bbd4452-dbce-4764-9484-1f489194f95d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:41.010812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7bbd4452-dbce-4764-9484-1f489194f95d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.208318 Jul 14 15:39:41.011655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 183/403] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:40 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:39:41.229495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1a8b6d61-0fd7-4a9c-9fde-ae290c8ce140 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9277eb13-8d62-4610-b82c-07c55704df0f"}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:41.230645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1a8b6d61-0fd7-4a9c-9fde-ae290c8ce140 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:41.237282 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a8b6d61-0fd7-4a9c-9fde-ae290c8ce140 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:41.237746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a8b6d61-0fd7-4a9c-9fde-ae290c8ce140 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:41.238517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a8b6d61-0fd7-4a9c-9fde-ae290c8ce140 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:41.238963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a8b6d61-0fd7-4a9c-9fde-ae290c8ce140 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:42.595798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1a8b6d61-0fd7-4a9c-9fde-ae290c8ce140 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "POST /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.369311 Jul 14 15:39:42.598232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 184/404] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 15:39:41 2022] POST /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 194 bytes in 1373 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:39:42.607331 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f103283e-398c-4ace-9b92-18d4dbeaeb6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:42.608451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f103283e-398c-4ace-9b92-18d4dbeaeb6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:42.621469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f103283e-398c-4ace-9b92-18d4dbeaeb6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:42.622568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f103283e-398c-4ace-9b92-18d4dbeaeb6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:42.623904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f103283e-398c-4ace-9b92-18d4dbeaeb6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:42.625048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f103283e-398c-4ace-9b92-18d4dbeaeb6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:42.694756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9402e9bb-7759-44fa-a91e-b87daa3520f6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "POST /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.291377 Jul 14 15:39:42.695758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 221/405] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 15:39:40 2022] POST /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7/os-volume_attachments => generated 194 bytes in 2295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:42.703905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1975370633", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "dae89fa7-f52a-48c3-941f-a22cec0d55f2"}], "security_groups": [{"name": "tempest-securitygroup--342976605"}], "key_name": "tempest-keypair-2068264139", "user_data": "}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:42.859254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f103283e-398c-4ace-9b92-18d4dbeaeb6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:42.869285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f103283e-398c-4ace-9b92-18d4dbeaeb6b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.269296 Jul 14 15:39:42.880679 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 185/406] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:42 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:42.887506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ab4cde9d-ed0b-4fee-b04b-40997f1f495b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:42.888803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ab4cde9d-ed0b-4fee-b04b-40997f1f495b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:42.889446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.network.neutron [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] validate_networks() for [('dae89fa7-f52a-48c3-941f-a22cec0d55f2', None, None, None, None, None)] {{(pid=124502) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:39:42.898933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ab4cde9d-ed0b-4fee-b04b-40997f1f495b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:42.899586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ab4cde9d-ed0b-4fee-b04b-40997f1f495b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:42.900530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ab4cde9d-ed0b-4fee-b04b-40997f1f495b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:42.901119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ab4cde9d-ed0b-4fee-b04b-40997f1f495b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:43.090662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ab4cde9d-ed0b-4fee-b04b-40997f1f495b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:43.100209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ab4cde9d-ed0b-4fee-b04b-40997f1f495b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:43.102162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ab4cde9d-ed0b-4fee-b04b-40997f1f495b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:43.103501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ab4cde9d-ed0b-4fee-b04b-40997f1f495b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.221590 Jul 14 15:39:43.104233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 186/407] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:42 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:43.359300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Flavor limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:39:43.359790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Image limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:39:43.360296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Flavor pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:39:43.360887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Image pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:39:43.361311 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:39:43.370392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:43.370757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:43.371556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:43.372032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:43.389615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Getting quotas for project 2a542b3ba16943a4ab7d2624d961b4a5. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:39:43.394168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Getting quotas for user d01c301ea20d4acab8dff1148501a975 and project 2a542b3ba16943a4ab7d2624d961b4a5. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:39:43.406649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Going to run 1 instances... {{(pid=124502) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:39:43.409677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124502) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:39:43.462033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-909f4625-cc52-49fa-8b81-d6526aef956d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.764065 Jul 14 15:39:43.463050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 222/408] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 15:39:42 2022] POST /compute/v2.1/servers => generated 408 bytes in 766 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:39:43.474499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cc2060e1-8503-4752-8e0c-f7848dfb482a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:43.475260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cc2060e1-8503-4752-8e0c-f7848dfb482a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:43.547730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cc2060e1-8503-4752-8e0c-f7848dfb482a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:43.556325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cc2060e1-8503-4752-8e0c-f7848dfb482a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1246 microversion: 2.1 time: 0.086833 Jul 14 15:39:43.557854 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 187/409] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:43 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:43.887076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-222b6b6e-a6ed-4ea4-9871-010dd4e5cccb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:43.887741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-222b6b6e-a6ed-4ea4-9871-010dd4e5cccb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:43.896320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-222b6b6e-a6ed-4ea4-9871-010dd4e5cccb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:43.896779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-222b6b6e-a6ed-4ea4-9871-010dd4e5cccb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:43.898462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-222b6b6e-a6ed-4ea4-9871-010dd4e5cccb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:43.898898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-222b6b6e-a6ed-4ea4-9871-010dd4e5cccb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:44.058610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-222b6b6e-a6ed-4ea4-9871-010dd4e5cccb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:44.067223 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-222b6b6e-a6ed-4ea4-9871-010dd4e5cccb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.184660 Jul 14 15:39:44.067936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 223/410] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:43 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:44.122454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-28f893eb-a982-453d-b3e6-c95e713e55fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:44.123738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-28f893eb-a982-453d-b3e6-c95e713e55fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:44.130732 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28f893eb-a982-453d-b3e6-c95e713e55fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:44.131216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28f893eb-a982-453d-b3e6-c95e713e55fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:44.132036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28f893eb-a982-453d-b3e6-c95e713e55fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:44.132465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28f893eb-a982-453d-b3e6-c95e713e55fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:44.306908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-28f893eb-a982-453d-b3e6-c95e713e55fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:44.317350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-28f893eb-a982-453d-b3e6-c95e713e55fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:44.319179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-28f893eb-a982-453d-b3e6-c95e713e55fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:44.321085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-28f893eb-a982-453d-b3e6-c95e713e55fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.202623 Jul 14 15:39:44.322083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 188/411] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:44.575446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-11089e5d-ed13-44cb-9c79-f49e98699c00 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:44.576448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-11089e5d-ed13-44cb-9c79-f49e98699c00 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:44.585215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-11089e5d-ed13-44cb-9c79-f49e98699c00 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:44.585693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-11089e5d-ed13-44cb-9c79-f49e98699c00 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:44.586463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-11089e5d-ed13-44cb-9c79-f49e98699c00 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:44.587002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-11089e5d-ed13-44cb-9c79-f49e98699c00 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:44.665463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-11089e5d-ed13-44cb-9c79-f49e98699c00 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:44.675054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-11089e5d-ed13-44cb-9c79-f49e98699c00 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1298 microversion: 2.1 time: 0.103406 Jul 14 15:39:44.675657 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 224/412] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:44 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1298 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:45.086100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4b94a2b8-b512-457c-81d6-d99b9792fede tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:45.086894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4b94a2b8-b512-457c-81d6-d99b9792fede tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:45.094273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b94a2b8-b512-457c-81d6-d99b9792fede tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:45.094931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b94a2b8-b512-457c-81d6-d99b9792fede tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:45.095949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b94a2b8-b512-457c-81d6-d99b9792fede tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:45.096450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b94a2b8-b512-457c-81d6-d99b9792fede tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:45.316505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4b94a2b8-b512-457c-81d6-d99b9792fede tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:45.325251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4b94a2b8-b512-457c-81d6-d99b9792fede tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.243921 Jul 14 15:39:45.325833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 189/413] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:45 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:45.341969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e6176e61-a39b-4df5-9bd6-4d0bf58b2c80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:45.342634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e6176e61-a39b-4df5-9bd6-4d0bf58b2c80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:45.349633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6176e61-a39b-4df5-9bd6-4d0bf58b2c80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:45.350260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6176e61-a39b-4df5-9bd6-4d0bf58b2c80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:45.351111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6176e61-a39b-4df5-9bd6-4d0bf58b2c80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:45.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6176e61-a39b-4df5-9bd6-4d0bf58b2c80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:45.513996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e6176e61-a39b-4df5-9bd6-4d0bf58b2c80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:45.522922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e6176e61-a39b-4df5-9bd6-4d0bf58b2c80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:45.524467 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e6176e61-a39b-4df5-9bd6-4d0bf58b2c80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:45.526613 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e6176e61-a39b-4df5-9bd6-4d0bf58b2c80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.189754 Jul 14 15:39:45.527331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 225/414] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:45 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:45.693752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0ea7ca94-84e0-4028-b14c-e4951b64d45b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:45.694661 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0ea7ca94-84e0-4028-b14c-e4951b64d45b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:45.701415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ea7ca94-84e0-4028-b14c-e4951b64d45b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:45.702008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ea7ca94-84e0-4028-b14c-e4951b64d45b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:45.702910 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ea7ca94-84e0-4028-b14c-e4951b64d45b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:45.703455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ea7ca94-84e0-4028-b14c-e4951b64d45b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:45.890240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-b2bc63bf-2a0a-48b1-b66a-4f14a00c6c8d req-1cba8e31-eca8-4538-a38f-7c4ad95a6c31 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9", "name": "network-vif-plugged", "status": "completed", "tag": "bb09889c-5c62-4021-bad3-091a7dd6ec8a"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:45.909246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-b2bc63bf-2a0a-48b1-b66a-4f14a00c6c8d req-1cba8e31-eca8-4538-a38f-7c4ad95a6c31 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:45.910246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-b2bc63bf-2a0a-48b1-b66a-4f14a00c6c8d req-1cba8e31-eca8-4538-a38f-7c4ad95a6c31 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:45.926576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-b2bc63bf-2a0a-48b1-b66a-4f14a00c6c8d req-1cba8e31-eca8-4538-a38f-7c4ad95a6c31 service nova] Creating event network-vif-plugged:bb09889c-5c62-4021-bad3-091a7dd6ec8a for instance 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 on hv-cinder-82651 Jul 14 15:39:45.934984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-b2bc63bf-2a0a-48b1-b66a-4f14a00c6c8d req-1cba8e31-eca8-4538-a38f-7c4ad95a6c31 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051004 Jul 14 15:39:45.937533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 226/415] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:45.996158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0ea7ca94-84e0-4028-b14c-e4951b64d45b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:46.017928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0ea7ca94-84e0-4028-b14c-e4951b64d45b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1371 microversion: 2.1 time: 0.327277 Jul 14 15:39:46.020867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 190/416] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:45 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1371 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:46.344326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-06f9b590-2d76-4d11-b66d-0707c4d2fdee tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:46.346074 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-06f9b590-2d76-4d11-b66d-0707c4d2fdee tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:46.352567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06f9b590-2d76-4d11-b66d-0707c4d2fdee tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:46.353012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06f9b590-2d76-4d11-b66d-0707c4d2fdee tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:46.353781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06f9b590-2d76-4d11-b66d-0707c4d2fdee tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:46.354210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06f9b590-2d76-4d11-b66d-0707c4d2fdee tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:46.521267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-06f9b590-2d76-4d11-b66d-0707c4d2fdee tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:46.530759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-06f9b590-2d76-4d11-b66d-0707c4d2fdee tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.190947 Jul 14 15:39:46.531359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 227/417] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:46 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:46.546354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-67fd598a-9570-455f-9fe3-3b8318414488 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:46.547627 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-67fd598a-9570-455f-9fe3-3b8318414488 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:46.557087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-67fd598a-9570-455f-9fe3-3b8318414488 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:46.557670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-67fd598a-9570-455f-9fe3-3b8318414488 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:46.559295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-67fd598a-9570-455f-9fe3-3b8318414488 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:46.560007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-67fd598a-9570-455f-9fe3-3b8318414488 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:46.791022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-b91a05a0-fecf-46ff-be6d-b085f0ee2689 req-610f8405-da45-4588-bf3b-0ae937396bf0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e7b59f-1959-4ed1-ba26-c70f4d9336bb", "tag": "6d596c25-d79d-4ae5-aad6-5b159dc0f3f0"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:46.804118 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-b91a05a0-fecf-46ff-be6d-b085f0ee2689 req-610f8405-da45-4588-bf3b-0ae937396bf0 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:46.805565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-b91a05a0-fecf-46ff-be6d-b085f0ee2689 req-610f8405-da45-4588-bf3b-0ae937396bf0 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:46.820271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-b91a05a0-fecf-46ff-be6d-b085f0ee2689 req-610f8405-da45-4588-bf3b-0ae937396bf0 service nova] Creating event network-changed:6d596c25-d79d-4ae5-aad6-5b159dc0f3f0 for instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb on hv-cinder-82651 Jul 14 15:39:46.826151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-b91a05a0-fecf-46ff-be6d-b085f0ee2689 req-610f8405-da45-4588-bf3b-0ae937396bf0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048395 Jul 14 15:39:46.827475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 228/418] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:46.863789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-67fd598a-9570-455f-9fe3-3b8318414488 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:46.873462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-67fd598a-9570-455f-9fe3-3b8318414488 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:46.876141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-67fd598a-9570-455f-9fe3-3b8318414488 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:46.878324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-67fd598a-9570-455f-9fe3-3b8318414488 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.336058 Jul 14 15:39:46.879245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 191/419] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:46 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:47.047587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ed4e49f4-7c2a-4238-ab9a-f2de5ee8cd59 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:47.049741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ed4e49f4-7c2a-4238-ab9a-f2de5ee8cd59 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:47.057540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed4e49f4-7c2a-4238-ab9a-f2de5ee8cd59 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:47.057996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed4e49f4-7c2a-4238-ab9a-f2de5ee8cd59 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:47.059185 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed4e49f4-7c2a-4238-ab9a-f2de5ee8cd59 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:47.059363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed4e49f4-7c2a-4238-ab9a-f2de5ee8cd59 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:47.197598 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ed4e49f4-7c2a-4238-ab9a-f2de5ee8cd59 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:47.206155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ed4e49f4-7c2a-4238-ab9a-f2de5ee8cd59 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1371 microversion: 2.1 time: 0.169648 Jul 14 15:39:47.211257 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 229/420] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:47 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1371 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:47.551731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6cd1eda2-6419-463c-80d7-6fac2ac11a56 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:47.552290 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6cd1eda2-6419-463c-80d7-6fac2ac11a56 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:47.558716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cd1eda2-6419-463c-80d7-6fac2ac11a56 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:47.559161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cd1eda2-6419-463c-80d7-6fac2ac11a56 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:47.559955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cd1eda2-6419-463c-80d7-6fac2ac11a56 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:47.560387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cd1eda2-6419-463c-80d7-6fac2ac11a56 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:47.693569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6cd1eda2-6419-463c-80d7-6fac2ac11a56 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:47.701126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6cd1eda2-6419-463c-80d7-6fac2ac11a56 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.154519 Jul 14 15:39:47.701695 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 192/421] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:47 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:47.899631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5d112756-e354-47dd-acf1-1db29813897b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:47.900374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5d112756-e354-47dd-acf1-1db29813897b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:47.911183 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d112756-e354-47dd-acf1-1db29813897b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:47.912386 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d112756-e354-47dd-acf1-1db29813897b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:47.913598 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d112756-e354-47dd-acf1-1db29813897b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:47.915171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d112756-e354-47dd-acf1-1db29813897b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:48.067840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5d112756-e354-47dd-acf1-1db29813897b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:48.077404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5d112756-e354-47dd-acf1-1db29813897b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:48.079975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5d112756-e354-47dd-acf1-1db29813897b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:48.081129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5d112756-e354-47dd-acf1-1db29813897b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.187063 Jul 14 15:39:48.091708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 230/422] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:47 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:39:48.223295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f9688e59-bffe-4c9f-9f29-b9436eda61f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:48.223976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f9688e59-bffe-4c9f-9f29-b9436eda61f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:48.230759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9688e59-bffe-4c9f-9f29-b9436eda61f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:48.231241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9688e59-bffe-4c9f-9f29-b9436eda61f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:48.232248 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9688e59-bffe-4c9f-9f29-b9436eda61f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:48.232648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9688e59-bffe-4c9f-9f29-b9436eda61f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:48.441364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f9688e59-bffe-4c9f-9f29-b9436eda61f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:48.451983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f9688e59-bffe-4c9f-9f29-b9436eda61f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1371 microversion: 2.1 time: 0.230059 Jul 14 15:39:48.459117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 193/423] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:48 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1371 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:48.718368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bdd43769-a290-44b3-b5ef-8d3092fc7d9d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:48.718919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bdd43769-a290-44b3-b5ef-8d3092fc7d9d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:48.725580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bdd43769-a290-44b3-b5ef-8d3092fc7d9d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:48.726031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bdd43769-a290-44b3-b5ef-8d3092fc7d9d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:48.726798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bdd43769-a290-44b3-b5ef-8d3092fc7d9d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:48.727239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bdd43769-a290-44b3-b5ef-8d3092fc7d9d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:48.743867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:48.880269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bdd43769-a290-44b3-b5ef-8d3092fc7d9d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:48.888392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bdd43769-a290-44b3-b5ef-8d3092fc7d9d tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.173874 Jul 14 15:39:48.888968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 231/424] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:48 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:49.108883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-08c857f0-a4a4-426d-b1ad-8c104c4727cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:49.109554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-08c857f0-a4a4-426d-b1ad-8c104c4727cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:49.117039 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08c857f0-a4a4-426d-b1ad-8c104c4727cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:49.117496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08c857f0-a4a4-426d-b1ad-8c104c4727cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:49.118273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08c857f0-a4a4-426d-b1ad-8c104c4727cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:49.118712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08c857f0-a4a4-426d-b1ad-8c104c4727cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:49.308210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-08c857f0-a4a4-426d-b1ad-8c104c4727cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:49.317312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-08c857f0-a4a4-426d-b1ad-8c104c4727cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:49.318873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-08c857f0-a4a4-426d-b1ad-8c104c4727cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:49.320164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-08c857f0-a4a4-426d-b1ad-8c104c4727cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.215473 Jul 14 15:39:49.321094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 194/425] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:49 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:49.466287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d85beec8-720c-40e6-953a-78a01b908ed7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:49.466906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d85beec8-720c-40e6-953a-78a01b908ed7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:49.474256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d85beec8-720c-40e6-953a-78a01b908ed7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:49.474713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d85beec8-720c-40e6-953a-78a01b908ed7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:49.475520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d85beec8-720c-40e6-953a-78a01b908ed7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:49.475989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d85beec8-720c-40e6-953a-78a01b908ed7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:49.622119 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d85beec8-720c-40e6-953a-78a01b908ed7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:49.631355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d85beec8-720c-40e6-953a-78a01b908ed7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1371 microversion: 2.1 time: 0.168791 Jul 14 15:39:49.631912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 232/426] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:49 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1371 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:49.905718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e4a30cc4-94ac-41ec-b226-a646e3666e9c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:49.906517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e4a30cc4-94ac-41ec-b226-a646e3666e9c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:49.913347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4a30cc4-94ac-41ec-b226-a646e3666e9c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:49.913789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4a30cc4-94ac-41ec-b226-a646e3666e9c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:49.914641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4a30cc4-94ac-41ec-b226-a646e3666e9c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:49.914990 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4a30cc4-94ac-41ec-b226-a646e3666e9c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:50.047717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e4a30cc4-94ac-41ec-b226-a646e3666e9c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:50.055890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e4a30cc4-94ac-41ec-b226-a646e3666e9c tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1314 microversion: 2.1 time: 0.154085 Jul 14 15:39:50.056456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 195/427] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:49 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:50.339751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c984dbaf-62c6-4477-86c3-4dfa4da04500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:50.340494 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c984dbaf-62c6-4477-86c3-4dfa4da04500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:50.346652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c984dbaf-62c6-4477-86c3-4dfa4da04500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:50.347159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c984dbaf-62c6-4477-86c3-4dfa4da04500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:50.348047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c984dbaf-62c6-4477-86c3-4dfa4da04500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:50.348479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c984dbaf-62c6-4477-86c3-4dfa4da04500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:50.489417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c984dbaf-62c6-4477-86c3-4dfa4da04500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:50.498438 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c984dbaf-62c6-4477-86c3-4dfa4da04500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:50.500187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c984dbaf-62c6-4477-86c3-4dfa4da04500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:50.502415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c984dbaf-62c6-4477-86c3-4dfa4da04500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.166046 Jul 14 15:39:50.502589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 233/428] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:50 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:39:50.649716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3952d727-d5c2-492e-b4c5-15692fcd7552 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:50.650335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3952d727-d5c2-492e-b4c5-15692fcd7552 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:50.657251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3952d727-d5c2-492e-b4c5-15692fcd7552 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:50.657766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3952d727-d5c2-492e-b4c5-15692fcd7552 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:50.658551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3952d727-d5c2-492e-b4c5-15692fcd7552 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:50.658990 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3952d727-d5c2-492e-b4c5-15692fcd7552 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:50.833244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3952d727-d5c2-492e-b4c5-15692fcd7552 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:50.839916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3952d727-d5c2-492e-b4c5-15692fcd7552 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1371 microversion: 2.1 time: 0.194398 Jul 14 15:39:50.840599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 196/429] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:50 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1371 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:50.906215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-302319790", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:50.958006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.network.neutron [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] validate_networks() for None {{(pid=124502) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:39:51.079141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6fa44b9d-9152-4203-9334-20fbcd64d3a1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:51.080203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6fa44b9d-9152-4203-9334-20fbcd64d3a1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:51.088896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6fa44b9d-9152-4203-9334-20fbcd64d3a1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:51.089350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6fa44b9d-9152-4203-9334-20fbcd64d3a1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:51.090121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6fa44b9d-9152-4203-9334-20fbcd64d3a1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:51.090552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6fa44b9d-9152-4203-9334-20fbcd64d3a1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:51.106486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:51.233647 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6fa44b9d-9152-4203-9334-20fbcd64d3a1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:51.241965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6fa44b9d-9152-4203-9334-20fbcd64d3a1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1498 microversion: 2.1 time: 0.172275 Jul 14 15:39:51.242548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 197/430] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:51 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1498 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:51.260089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Flavor limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:39:51.260564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Image limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:39:51.261036 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Flavor pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:39:51.261446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Image pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:39:51.261857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:39:51.271781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:51.272230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:51.273275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:51.273706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:51.291237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Getting quotas for project 75292a36c8354a2dbd28428efb2e9df9. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:39:51.295524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Getting quotas for user 4689786287394deb9ecafb9f2cdbca89 and project 75292a36c8354a2dbd28428efb2e9df9. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:39:51.307975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Going to run 1 instances... {{(pid=124502) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:39:51.310236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124502) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:39:51.358943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ce676796-b25b-4b69-8f13-4f722649a924 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.456410 Jul 14 15:39:51.359934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 234/431] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 15:39:50 2022] POST /compute/v2.1/servers => generated 380 bytes in 458 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:39:51.371499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ab787f14-e4be-4b07-a194-17d7efcbbe8b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:51.372429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ab787f14-e4be-4b07-a194-17d7efcbbe8b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:51.446801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ab787f14-e4be-4b07-a194-17d7efcbbe8b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:51.456809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ab787f14-e4be-4b07-a194-17d7efcbbe8b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1214 microversion: 2.1 time: 0.090037 Jul 14 15:39:51.457396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 198/432] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:51 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:51.521270 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2d1c4073-b1fc-4405-8578-997010681cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:51.524305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2d1c4073-b1fc-4405-8578-997010681cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:51.531159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2d1c4073-b1fc-4405-8578-997010681cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:51.531651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2d1c4073-b1fc-4405-8578-997010681cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:51.533753 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2d1c4073-b1fc-4405-8578-997010681cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:51.533980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2d1c4073-b1fc-4405-8578-997010681cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:51.714687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2d1c4073-b1fc-4405-8578-997010681cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:51.725432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2d1c4073-b1fc-4405-8578-997010681cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:51.727317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2d1c4073-b1fc-4405-8578-997010681cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:51.728997 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2d1c4073-b1fc-4405-8578-997010681cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.212893 Jul 14 15:39:51.741271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 235/433] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:51 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:51.858951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a4e4df2e-fec0-48db-85b7-f27de5894fd9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:51.860959 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a4e4df2e-fec0-48db-85b7-f27de5894fd9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:51.869144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a4e4df2e-fec0-48db-85b7-f27de5894fd9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:51.869874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a4e4df2e-fec0-48db-85b7-f27de5894fd9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:51.870941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a4e4df2e-fec0-48db-85b7-f27de5894fd9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:51.871384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a4e4df2e-fec0-48db-85b7-f27de5894fd9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:52.020110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a4e4df2e-fec0-48db-85b7-f27de5894fd9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:52.023040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e59e0b8b-7959-447e-b6ca-0e95efa56474 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:52.023640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e59e0b8b-7959-447e-b6ca-0e95efa56474 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:52.028052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a4e4df2e-fec0-48db-85b7-f27de5894fd9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1371 microversion: 2.1 time: 0.175006 Jul 14 15:39:52.028715 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 199/434] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:51 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1371 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:52.035957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e59e0b8b-7959-447e-b6ca-0e95efa56474 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:52.036466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e59e0b8b-7959-447e-b6ca-0e95efa56474 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:52.037262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e59e0b8b-7959-447e-b6ca-0e95efa56474 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:52.037704 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e59e0b8b-7959-447e-b6ca-0e95efa56474 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:52.064538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e59e0b8b-7959-447e-b6ca-0e95efa56474 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:39:52.161001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e59e0b8b-7959-447e-b6ca-0e95efa56474 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "DELETE /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 204 len: 0 microversion: 2.1 time: 0.141814 Jul 14 15:39:52.161594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 236/435] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 15:39:52 2022] DELETE /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:39:52.169803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-37d0e180-97da-4fbb-be6b-dfcd77d4d1c9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:52.170473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-37d0e180-97da-4fbb-be6b-dfcd77d4d1c9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:52.177901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37d0e180-97da-4fbb-be6b-dfcd77d4d1c9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:52.178355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37d0e180-97da-4fbb-be6b-dfcd77d4d1c9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:52.179115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37d0e180-97da-4fbb-be6b-dfcd77d4d1c9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:52.179551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37d0e180-97da-4fbb-be6b-dfcd77d4d1c9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:52.318321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37d0e180-97da-4fbb-be6b-dfcd77d4d1c9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:52.326081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-37d0e180-97da-4fbb-be6b-dfcd77d4d1c9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1504 microversion: 2.1 time: 0.159983 Jul 14 15:39:52.326718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 200/436] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:52 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1504 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:52.475361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c1badec9-c97f-4fd1-a838-06645a617f34 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:52.476094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c1badec9-c97f-4fd1-a838-06645a617f34 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:52.491112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1badec9-c97f-4fd1-a838-06645a617f34 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:52.491949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1badec9-c97f-4fd1-a838-06645a617f34 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:52.493239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1badec9-c97f-4fd1-a838-06645a617f34 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:52.493954 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1badec9-c97f-4fd1-a838-06645a617f34 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:52.561470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c1badec9-c97f-4fd1-a838-06645a617f34 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:52.569729 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c1badec9-c97f-4fd1-a838-06645a617f34 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1218 microversion: 2.1 time: 0.098609 Jul 14 15:39:52.570316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 237/437] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:52 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1218 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:52.748350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4c9c1e51-446d-41ed-8a1d-03113f7a95d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:52.748905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4c9c1e51-446d-41ed-8a1d-03113f7a95d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:52.755761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4c9c1e51-446d-41ed-8a1d-03113f7a95d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:52.756204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4c9c1e51-446d-41ed-8a1d-03113f7a95d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:52.757025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4c9c1e51-446d-41ed-8a1d-03113f7a95d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:52.757454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4c9c1e51-446d-41ed-8a1d-03113f7a95d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:52.890996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4c9c1e51-446d-41ed-8a1d-03113f7a95d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:52.900480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4c9c1e51-446d-41ed-8a1d-03113f7a95d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:52.901958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4c9c1e51-446d-41ed-8a1d-03113f7a95d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:52.903249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4c9c1e51-446d-41ed-8a1d-03113f7a95d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.158983 Jul 14 15:39:52.903856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 201/438] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:52 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:53.045502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7c79cdac-eda3-4b0d-8c2a-778bc60332b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:53.046110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7c79cdac-eda3-4b0d-8c2a-778bc60332b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:53.053580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c79cdac-eda3-4b0d-8c2a-778bc60332b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:53.054136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c79cdac-eda3-4b0d-8c2a-778bc60332b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:53.055008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c79cdac-eda3-4b0d-8c2a-778bc60332b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:53.055558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c79cdac-eda3-4b0d-8c2a-778bc60332b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:53.196569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7c79cdac-eda3-4b0d-8c2a-778bc60332b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:53.206816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7c79cdac-eda3-4b0d-8c2a-778bc60332b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1371 microversion: 2.1 time: 0.164980 Jul 14 15:39:53.207365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 238/439] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:53 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1371 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:53.343861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f726647c-aaab-431e-a894-fa93ea0fafcb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:53.344385 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f726647c-aaab-431e-a894-fa93ea0fafcb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:53.351282 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f726647c-aaab-431e-a894-fa93ea0fafcb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:53.351765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f726647c-aaab-431e-a894-fa93ea0fafcb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:53.352530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f726647c-aaab-431e-a894-fa93ea0fafcb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:53.352959 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f726647c-aaab-431e-a894-fa93ea0fafcb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:53.496242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f726647c-aaab-431e-a894-fa93ea0fafcb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:53.504793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f726647c-aaab-431e-a894-fa93ea0fafcb tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1504 microversion: 2.1 time: 0.164873 Jul 14 15:39:53.505421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 202/440] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:53 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1504 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:53.585861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d38d6ed7-13fc-4e19-a6f6-04ca971b9d61 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:53.586499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d38d6ed7-13fc-4e19-a6f6-04ca971b9d61 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:53.593507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d38d6ed7-13fc-4e19-a6f6-04ca971b9d61 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:53.594040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d38d6ed7-13fc-4e19-a6f6-04ca971b9d61 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:53.595502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d38d6ed7-13fc-4e19-a6f6-04ca971b9d61 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:53.595997 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d38d6ed7-13fc-4e19-a6f6-04ca971b9d61 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:53.663333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d38d6ed7-13fc-4e19-a6f6-04ca971b9d61 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:53.671883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d38d6ed7-13fc-4e19-a6f6-04ca971b9d61 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1218 microversion: 2.1 time: 0.089851 Jul 14 15:39:53.672609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 239/441] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:53 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:53.921588 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1dd9e883-5d20-4877-93b9-f549f400d23f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:53.922192 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1dd9e883-5d20-4877-93b9-f549f400d23f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:53.929116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1dd9e883-5d20-4877-93b9-f549f400d23f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:53.929585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1dd9e883-5d20-4877-93b9-f549f400d23f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:53.930342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1dd9e883-5d20-4877-93b9-f549f400d23f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:53.930778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1dd9e883-5d20-4877-93b9-f549f400d23f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:54.080562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1dd9e883-5d20-4877-93b9-f549f400d23f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:54.088812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1dd9e883-5d20-4877-93b9-f549f400d23f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:54.090319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1dd9e883-5d20-4877-93b9-f549f400d23f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:54.091530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1dd9e883-5d20-4877-93b9-f549f400d23f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.173920 Jul 14 15:39:54.092113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 203/442] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:53 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:54.185586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-a29305e7-d9ea-4354-9f09-0443aded9de6 req-31f80565-57f1-4345-815a-ced20a974c58 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e7b59f-1959-4ed1-ba26-c70f4d9336bb", "name": "network-vif-plugged", "status": "completed", "tag": "6d596c25-d79d-4ae5-aad6-5b159dc0f3f0"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:54.196850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-a29305e7-d9ea-4354-9f09-0443aded9de6 req-31f80565-57f1-4345-815a-ced20a974c58 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:54.197301 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-a29305e7-d9ea-4354-9f09-0443aded9de6 req-31f80565-57f1-4345-815a-ced20a974c58 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:54.214809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-a29305e7-d9ea-4354-9f09-0443aded9de6 req-31f80565-57f1-4345-815a-ced20a974c58 service nova] Creating event network-vif-plugged:6d596c25-d79d-4ae5-aad6-5b159dc0f3f0 for instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb on hv-cinder-82651 Jul 14 15:39:54.220915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-a29305e7-d9ea-4354-9f09-0443aded9de6 req-31f80565-57f1-4345-815a-ced20a974c58 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038929 Jul 14 15:39:54.221511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 240/443] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:39:54.223928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-452861ea-242c-4bd6-90c5-81f62119d583 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:54.224536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-452861ea-242c-4bd6-90c5-81f62119d583 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:54.230571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-452861ea-242c-4bd6-90c5-81f62119d583 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:54.231015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-452861ea-242c-4bd6-90c5-81f62119d583 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:54.232626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-452861ea-242c-4bd6-90c5-81f62119d583 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:54.233663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-452861ea-242c-4bd6-90c5-81f62119d583 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:54.523847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c155e971-c6eb-4a91-9570-5caeb27744a4 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:54.524768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c155e971-c6eb-4a91-9570-5caeb27744a4 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:54.544742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c155e971-c6eb-4a91-9570-5caeb27744a4 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:54.545031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c155e971-c6eb-4a91-9570-5caeb27744a4 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:54.546048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c155e971-c6eb-4a91-9570-5caeb27744a4 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:54.546230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c155e971-c6eb-4a91-9570-5caeb27744a4 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:54.615244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-452861ea-242c-4bd6-90c5-81f62119d583 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:54.623799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-452861ea-242c-4bd6-90c5-81f62119d583 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1371 microversion: 2.1 time: 0.404240 Jul 14 15:39:54.624382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 204/444] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:54 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1371 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:54.692642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-75c474e2-3c69-4750-98f6-0b2c1e38e059 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:54.693283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-75c474e2-3c69-4750-98f6-0b2c1e38e059 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:54.695309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:54.696585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c155e971-c6eb-4a91-9570-5caeb27744a4 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:54.701545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-75c474e2-3c69-4750-98f6-0b2c1e38e059 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:54.702003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-75c474e2-3c69-4750-98f6-0b2c1e38e059 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:54.702848 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-75c474e2-3c69-4750-98f6-0b2c1e38e059 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:54.703283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-75c474e2-3c69-4750-98f6-0b2c1e38e059 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:54.707037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c155e971-c6eb-4a91-9570-5caeb27744a4 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1504 microversion: 2.1 time: 0.187741 Jul 14 15:39:54.707739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 241/445] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:54 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1504 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:54.766089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-75c474e2-3c69-4750-98f6-0b2c1e38e059 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:54.773948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-75c474e2-3c69-4750-98f6-0b2c1e38e059 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1218 microversion: 2.1 time: 0.086971 Jul 14 15:39:54.774527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 205/446] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:54 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:55.120783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ec93315b-ce9d-47db-96cd-a6f8f7c900a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:55.122072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ec93315b-ce9d-47db-96cd-a6f8f7c900a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:55.132113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec93315b-ce9d-47db-96cd-a6f8f7c900a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:55.132853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec93315b-ce9d-47db-96cd-a6f8f7c900a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:55.134110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec93315b-ce9d-47db-96cd-a6f8f7c900a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:55.134716 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec93315b-ce9d-47db-96cd-a6f8f7c900a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:55.273664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ec93315b-ce9d-47db-96cd-a6f8f7c900a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:55.282939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ec93315b-ce9d-47db-96cd-a6f8f7c900a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:55.284887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ec93315b-ce9d-47db-96cd-a6f8f7c900a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:55.286284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ec93315b-ce9d-47db-96cd-a6f8f7c900a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.179441 Jul 14 15:39:55.286854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 242/447] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:55 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:55.641356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d54472e3-9a6c-4da7-b930-33ab1ef32dfe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:55.642226 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d54472e3-9a6c-4da7-b930-33ab1ef32dfe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:55.649264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d54472e3-9a6c-4da7-b930-33ab1ef32dfe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:55.649718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d54472e3-9a6c-4da7-b930-33ab1ef32dfe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:55.650491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d54472e3-9a6c-4da7-b930-33ab1ef32dfe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:55.650929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d54472e3-9a6c-4da7-b930-33ab1ef32dfe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:55.725686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-28e9e216-94f4-4562-8be8-02c5ea5bc7c1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:55.726376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-28e9e216-94f4-4562-8be8-02c5ea5bc7c1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:55.733232 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-28e9e216-94f4-4562-8be8-02c5ea5bc7c1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:55.733687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-28e9e216-94f4-4562-8be8-02c5ea5bc7c1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:55.734462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-28e9e216-94f4-4562-8be8-02c5ea5bc7c1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:55.734907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-28e9e216-94f4-4562-8be8-02c5ea5bc7c1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:55.788927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d54472e3-9a6c-4da7-b930-33ab1ef32dfe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:55.796343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d54472e3-9a6c-4da7-b930-33ab1ef32dfe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1371 microversion: 2.1 time: 0.158900 Jul 14 15:39:55.796916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 206/448] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:55 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:55.801906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-27cdb631-4ffa-4bfe-9159-e5fd33db3c1f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:55.802505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-27cdb631-4ffa-4bfe-9159-e5fd33db3c1f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:55.808670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27cdb631-4ffa-4bfe-9159-e5fd33db3c1f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:55.809110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27cdb631-4ffa-4bfe-9159-e5fd33db3c1f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:55.809864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27cdb631-4ffa-4bfe-9159-e5fd33db3c1f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:55.810292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27cdb631-4ffa-4bfe-9159-e5fd33db3c1f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:55.873984 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-27cdb631-4ffa-4bfe-9159-e5fd33db3c1f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:55.882588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-28e9e216-94f4-4562-8be8-02c5ea5bc7c1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:55.882829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-27cdb631-4ffa-4bfe-9159-e5fd33db3c1f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1210 microversion: 2.1 time: 0.084886 Jul 14 15:39:55.883562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 207/449] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:55 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:55.891092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-28e9e216-94f4-4562-8be8-02c5ea5bc7c1 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1504 microversion: 2.1 time: 0.170288 Jul 14 15:39:55.904116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 243/450] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:55 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:56.305104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5800ebea-71b4-47ce-9a30-28102ca3c25d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:56.305745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5800ebea-71b4-47ce-9a30-28102ca3c25d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:56.311992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5800ebea-71b4-47ce-9a30-28102ca3c25d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:56.312442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5800ebea-71b4-47ce-9a30-28102ca3c25d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:56.313204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5800ebea-71b4-47ce-9a30-28102ca3c25d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:56.314289 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5800ebea-71b4-47ce-9a30-28102ca3c25d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:56.450818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5800ebea-71b4-47ce-9a30-28102ca3c25d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:56.458968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5800ebea-71b4-47ce-9a30-28102ca3c25d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:56.460486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5800ebea-71b4-47ce-9a30-28102ca3c25d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:56.461640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5800ebea-71b4-47ce-9a30-28102ca3c25d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.160574 Jul 14 15:39:56.462188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 208/451] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:56 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:56.812192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7b990059-08ec-4030-955a-b391d10a5837 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:56.813194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d27b8a67-15ef-44fb-8af9-61cae78b06a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:56.814548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d27b8a67-15ef-44fb-8af9-61cae78b06a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:56.821396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b990059-08ec-4030-955a-b391d10a5837 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:56.821865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d27b8a67-15ef-44fb-8af9-61cae78b06a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:56.822277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b990059-08ec-4030-955a-b391d10a5837 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:56.822405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d27b8a67-15ef-44fb-8af9-61cae78b06a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:56.823077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d27b8a67-15ef-44fb-8af9-61cae78b06a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:56.823518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d27b8a67-15ef-44fb-8af9-61cae78b06a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:56.889330 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7b990059-08ec-4030-955a-b391d10a5837 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Going to try to stop instance {{(pid=124502) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jul 14 15:39:56.933320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7b990059-08ec-4030-955a-b391d10a5837 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "POST /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/action" status: 202 len: 0 microversion: 2.1 time: 0.124886 Jul 14 15:39:56.934042 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 244/452] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 15:39:56 2022] POST /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/action => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:39:56.939620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-944935bf-0306-4c16-8471-ac530caeb99f req-0e632f72-266f-43a8-ab25-e8f68f01c63b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9", "name": "network-vif-deleted", "tag": "bb09889c-5c62-4021-bad3-091a7dd6ec8a"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:39:56.947942 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-944935bf-0306-4c16-8471-ac530caeb99f req-0e632f72-266f-43a8-ab25-e8f68f01c63b service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:56.948416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-944935bf-0306-4c16-8471-ac530caeb99f req-0e632f72-266f-43a8-ab25-e8f68f01c63b service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:56.959795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-944935bf-0306-4c16-8471-ac530caeb99f req-0e632f72-266f-43a8-ab25-e8f68f01c63b service nova] Creating event network-vif-deleted:bb09889c-5c62-4021-bad3-091a7dd6ec8a for instance 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 on hv-cinder-82651 Jul 14 15:39:56.962131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d27b8a67-15ef-44fb-8af9-61cae78b06a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:56.964686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-944935bf-0306-4c16-8471-ac530caeb99f req-0e632f72-266f-43a8-ab25-e8f68f01c63b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029447 Jul 14 15:39:56.965482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 245/453] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:39:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:39:56.970627 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d27b8a67-15ef-44fb-8af9-61cae78b06a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1371 microversion: 2.1 time: 0.161102 Jul 14 15:39:56.971338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 209/454] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:56 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1371 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:56.974873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f8d3a20a-62fc-4f59-85cc-afe72f4626a7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:56.975574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f8d3a20a-62fc-4f59-85cc-afe72f4626a7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:56.975991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-528d0a16-d028-4f5f-b643-c85b4f109a72 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:56.976594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-528d0a16-d028-4f5f-b643-c85b4f109a72 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:56.981792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8d3a20a-62fc-4f59-85cc-afe72f4626a7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:56.982238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8d3a20a-62fc-4f59-85cc-afe72f4626a7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:56.982365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-528d0a16-d028-4f5f-b643-c85b4f109a72 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:56.982881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-528d0a16-d028-4f5f-b643-c85b4f109a72 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:56.983028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8d3a20a-62fc-4f59-85cc-afe72f4626a7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:56.983417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8d3a20a-62fc-4f59-85cc-afe72f4626a7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:56.983666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-528d0a16-d028-4f5f-b643-c85b4f109a72 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:56.984106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-528d0a16-d028-4f5f-b643-c85b4f109a72 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:57.057182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-528d0a16-d028-4f5f-b643-c85b4f109a72 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:57.060950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f8d3a20a-62fc-4f59-85cc-afe72f4626a7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:57.065474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-528d0a16-d028-4f5f-b643-c85b4f109a72 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1462 microversion: 2.1 time: 0.092949 Jul 14 15:39:57.066052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 210/455] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:56 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1462 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:57.068887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f8d3a20a-62fc-4f59-85cc-afe72f4626a7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1274 microversion: 2.1 time: 0.099897 Jul 14 15:39:57.069884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 246/456] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:56 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1274 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:57.070567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-292d7ebb-3f1e-4b32-9e2b-f636e7a0f1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:57.071178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-292d7ebb-3f1e-4b32-9e2b-f636e7a0f1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:57.077222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-292d7ebb-3f1e-4b32-9e2b-f636e7a0f1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:57.077677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-292d7ebb-3f1e-4b32-9e2b-f636e7a0f1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:57.078452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-292d7ebb-3f1e-4b32-9e2b-f636e7a0f1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:57.078893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-292d7ebb-3f1e-4b32-9e2b-f636e7a0f1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:57.228913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-292d7ebb-3f1e-4b32-9e2b-f636e7a0f1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:57.241869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-292d7ebb-3f1e-4b32-9e2b-f636e7a0f1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.174745 Jul 14 15:39:57.242457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 211/457] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:57 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:57.480719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6c1c8b5c-d992-42b9-b9c9-5ba32dc4a0a2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:57.481249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6c1c8b5c-d992-42b9-b9c9-5ba32dc4a0a2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:57.483198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=7,nova_api:UPDATE=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:57.490074 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c1c8b5c-d992-42b9-b9c9-5ba32dc4a0a2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:57.490528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c1c8b5c-d992-42b9-b9c9-5ba32dc4a0a2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:57.491300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c1c8b5c-d992-42b9-b9c9-5ba32dc4a0a2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:57.491788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c1c8b5c-d992-42b9-b9c9-5ba32dc4a0a2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:57.507542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:57.702052 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6c1c8b5c-d992-42b9-b9c9-5ba32dc4a0a2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:57.710278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6c1c8b5c-d992-42b9-b9c9-5ba32dc4a0a2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:57.711837 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6c1c8b5c-d992-42b9-b9c9-5ba32dc4a0a2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:57.713144 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6c1c8b5c-d992-42b9-b9c9-5ba32dc4a0a2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.236348 Jul 14 15:39:57.713915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 247/458] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:57 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:57.990284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8d5010d3-5d20-4370-8d1e-ec4f870870b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:57.991138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8d5010d3-5d20-4370-8d1e-ec4f870870b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:57.999083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8d5010d3-5d20-4370-8d1e-ec4f870870b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:57.999558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8d5010d3-5d20-4370-8d1e-ec4f870870b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:58.000420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8d5010d3-5d20-4370-8d1e-ec4f870870b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:58.000937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8d5010d3-5d20-4370-8d1e-ec4f870870b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:58.083265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1f5e8af6-ec02-4a90-a97b-ca98c4c382f9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:58.084033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1f5e8af6-ec02-4a90-a97b-ca98c4c382f9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:58.090635 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f5e8af6-ec02-4a90-a97b-ca98c4c382f9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:58.091197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f5e8af6-ec02-4a90-a97b-ca98c4c382f9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:58.092091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f5e8af6-ec02-4a90-a97b-ca98c4c382f9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:58.092505 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f5e8af6-ec02-4a90-a97b-ca98c4c382f9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:58.124363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f5e8af6-ec02-4a90-a97b-ca98c4c382f9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:58.124818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f5e8af6-ec02-4a90-a97b-ca98c4c382f9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:58.125262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-1f5e8af6-ec02-4a90-a97b-ca98c4c382f9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lazy-loading 'fault' on Instance uuid 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:39:58.136046 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8d5010d3-5d20-4370-8d1e-ec4f870870b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:58.144466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8d5010d3-5d20-4370-8d1e-ec4f870870b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1371 microversion: 2.1 time: 0.160557 Jul 14 15:39:58.145787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 212/459] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:57 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:58.161103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f1227e75-223d-4be9-9467-939357cff8fc tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:58.161729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f1227e75-223d-4be9-9467-939357cff8fc tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:58.168214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f1227e75-223d-4be9-9467-939357cff8fc tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:58.168667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f1227e75-223d-4be9-9467-939357cff8fc tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:58.169446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f1227e75-223d-4be9-9467-939357cff8fc tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:58.169882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f1227e75-223d-4be9-9467-939357cff8fc tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:58.179139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1f5e8af6-ec02-4a90-a97b-ca98c4c382f9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:58.186550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1f5e8af6-ec02-4a90-a97b-ca98c4c382f9 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1304 microversion: 2.1 time: 0.107857 Jul 14 15:39:58.187301 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 248/460] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:58 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1304 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:58.236661 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f1227e75-223d-4be9-9467-939357cff8fc tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:58.244040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f1227e75-223d-4be9-9467-939357cff8fc tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1272 microversion: 2.1 time: 0.096941 Jul 14 15:39:58.244529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 213/461] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:58 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:58.260069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9cae8c08-db17-4f70-bbb3-6f787b7a48b9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:58.260739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9cae8c08-db17-4f70-bbb3-6f787b7a48b9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:58.267409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9cae8c08-db17-4f70-bbb3-6f787b7a48b9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:58.267919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9cae8c08-db17-4f70-bbb3-6f787b7a48b9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:58.268627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9cae8c08-db17-4f70-bbb3-6f787b7a48b9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:58.269061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9cae8c08-db17-4f70-bbb3-6f787b7a48b9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:58.404511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9cae8c08-db17-4f70-bbb3-6f787b7a48b9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:58.413593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9cae8c08-db17-4f70-bbb3-6f787b7a48b9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.157298 Jul 14 15:39:58.414169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 249/462] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:58 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:58.731627 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f3de1c1b-401f-4f9d-bdd9-3579fca1064c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:58.732256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f3de1c1b-401f-4f9d-bdd9-3579fca1064c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:58.739249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3de1c1b-401f-4f9d-bdd9-3579fca1064c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:58.739720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3de1c1b-401f-4f9d-bdd9-3579fca1064c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:58.740481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3de1c1b-401f-4f9d-bdd9-3579fca1064c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:58.740915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3de1c1b-401f-4f9d-bdd9-3579fca1064c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:58.877969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f3de1c1b-401f-4f9d-bdd9-3579fca1064c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:58.885956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f3de1c1b-401f-4f9d-bdd9-3579fca1064c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:58.887461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f3de1c1b-401f-4f9d-bdd9-3579fca1064c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:58.888653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f3de1c1b-401f-4f9d-bdd9-3579fca1064c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.160963 Jul 14 15:39:58.889212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 214/463] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:58 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:39:59.162172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-33d854ef-0867-47be-9bdf-2a2a88055bef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:59.163334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-33d854ef-0867-47be-9bdf-2a2a88055bef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:59.169439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33d854ef-0867-47be-9bdf-2a2a88055bef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:59.169894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33d854ef-0867-47be-9bdf-2a2a88055bef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:59.170661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33d854ef-0867-47be-9bdf-2a2a88055bef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:59.171131 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33d854ef-0867-47be-9bdf-2a2a88055bef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:59.203820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4def300d-878a-4b01-b81f-23d428b010f5 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:59.204998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4def300d-878a-4b01-b81f-23d428b010f5 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:59.217130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4def300d-878a-4b01-b81f-23d428b010f5 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:59.217130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4def300d-878a-4b01-b81f-23d428b010f5 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:59.217130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4def300d-878a-4b01-b81f-23d428b010f5 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:59.217130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4def300d-878a-4b01-b81f-23d428b010f5 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:59.222984 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:39:59.258879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4def300d-878a-4b01-b81f-23d428b010f5 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:59.259620 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4def300d-878a-4b01-b81f-23d428b010f5 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:59.260232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-4def300d-878a-4b01-b81f-23d428b010f5 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lazy-loading 'fault' on Instance uuid 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:39:59.323656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4def300d-878a-4b01-b81f-23d428b010f5 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:59.328048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-33d854ef-0867-47be-9bdf-2a2a88055bef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:59.335003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4def300d-878a-4b01-b81f-23d428b010f5 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1304 microversion: 2.1 time: 0.135115 Jul 14 15:39:59.337748 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-33d854ef-0867-47be-9bdf-2a2a88055bef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1371 microversion: 2.1 time: 0.179288 Jul 14 15:39:59.338333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 250/464] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:59 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1371 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:59.343538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b7154048-d887-45a1-b251-93eb7aa5fbcf tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:59.344358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b7154048-d887-45a1-b251-93eb7aa5fbcf tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:59.347446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 215/465] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:59 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1304 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:59.352035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7154048-d887-45a1-b251-93eb7aa5fbcf tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:59.352495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7154048-d887-45a1-b251-93eb7aa5fbcf tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:59.353300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7154048-d887-45a1-b251-93eb7aa5fbcf tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:59.353936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7154048-d887-45a1-b251-93eb7aa5fbcf tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:59.430444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4286bcbf-9c5f-460f-aff0-f5f7e36767d2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:59.431117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4286bcbf-9c5f-460f-aff0-f5f7e36767d2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:59.437488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4286bcbf-9c5f-460f-aff0-f5f7e36767d2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:59.437935 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4286bcbf-9c5f-460f-aff0-f5f7e36767d2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:59.440031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4286bcbf-9c5f-460f-aff0-f5f7e36767d2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:59.440532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4286bcbf-9c5f-460f-aff0-f5f7e36767d2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:59.458056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b7154048-d887-45a1-b251-93eb7aa5fbcf tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:59.466303 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b7154048-d887-45a1-b251-93eb7aa5fbcf tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1272 microversion: 2.1 time: 0.126719 Jul 14 15:39:59.466966 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 251/466] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:59 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1272 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:39:59.592697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4286bcbf-9c5f-460f-aff0-f5f7e36767d2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:39:59.601624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4286bcbf-9c5f-460f-aff0-f5f7e36767d2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.175036 Jul 14 15:39:59.607634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 216/467] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:39:59 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:39:59.908402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6adb549a-194d-4c3b-9ded-350cd01ab8b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:39:59.909030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6adb549a-194d-4c3b-9ded-350cd01ab8b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:39:59.915253 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6adb549a-194d-4c3b-9ded-350cd01ab8b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:59.915740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6adb549a-194d-4c3b-9ded-350cd01ab8b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:39:59.916516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6adb549a-194d-4c3b-9ded-350cd01ab8b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:39:59.916958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6adb549a-194d-4c3b-9ded-350cd01ab8b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:00.137464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6adb549a-194d-4c3b-9ded-350cd01ab8b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:00.148000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6adb549a-194d-4c3b-9ded-350cd01ab8b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:00.149700 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6adb549a-194d-4c3b-9ded-350cd01ab8b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:00.150948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6adb549a-194d-4c3b-9ded-350cd01ab8b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1722 microversion: 2.20 time: 0.247239 Jul 14 15:40:00.151545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 252/468] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:39:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1722 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:00.354734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f006561c-b3ea-48f2-bc47-a72faed758a3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:00.355250 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ef8492e9-ea9a-458e-89db-d20ba4463984 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:00.355662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f006561c-b3ea-48f2-bc47-a72faed758a3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:00.355764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ef8492e9-ea9a-458e-89db-d20ba4463984 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:00.363316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f006561c-b3ea-48f2-bc47-a72faed758a3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:00.364020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ef8492e9-ea9a-458e-89db-d20ba4463984 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:00.364171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f006561c-b3ea-48f2-bc47-a72faed758a3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:00.364272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ef8492e9-ea9a-458e-89db-d20ba4463984 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:00.364442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f006561c-b3ea-48f2-bc47-a72faed758a3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:00.364616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ef8492e9-ea9a-458e-89db-d20ba4463984 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:00.364880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f006561c-b3ea-48f2-bc47-a72faed758a3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:00.364979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ef8492e9-ea9a-458e-89db-d20ba4463984 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:00.397240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f006561c-b3ea-48f2-bc47-a72faed758a3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:00.397940 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f006561c-b3ea-48f2-bc47-a72faed758a3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:00.398396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-f006561c-b3ea-48f2-bc47-a72faed758a3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lazy-loading 'fault' on Instance uuid 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:40:00.441334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f006561c-b3ea-48f2-bc47-a72faed758a3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1f3411c8a7454203a4fbd748f1f3031a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2345d49f9fee4842826a396c43132a33', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:00.448719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f006561c-b3ea-48f2-bc47-a72faed758a3 tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 200 len: 1304 microversion: 2.1 time: 0.098269 Jul 14 15:40:00.449303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 217/469] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:00 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:00.483813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-486d406f-4760-4e98-8d6e-464dea231255 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:00.484432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-486d406f-4760-4e98-8d6e-464dea231255 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:00.490430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-486d406f-4760-4e98-8d6e-464dea231255 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:00.490882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-486d406f-4760-4e98-8d6e-464dea231255 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:00.491671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-486d406f-4760-4e98-8d6e-464dea231255 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:00.492134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-486d406f-4760-4e98-8d6e-464dea231255 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:00.504709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ef8492e9-ea9a-458e-89db-d20ba4463984 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:00.512056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ef8492e9-ea9a-458e-89db-d20ba4463984 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1566 microversion: 2.1 time: 0.160622 Jul 14 15:40:00.512627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 253/470] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:00 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1566 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:00.528860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e8848fbe-f635-47ed-996a-8806574d5bee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:00.529352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e8848fbe-f635-47ed-996a-8806574d5bee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:00.536459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e8848fbe-f635-47ed-996a-8806574d5bee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:00.536835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e8848fbe-f635-47ed-996a-8806574d5bee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:00.537616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e8848fbe-f635-47ed-996a-8806574d5bee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:00.538072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e8848fbe-f635-47ed-996a-8806574d5bee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:00.620068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e8848fbe-f635-47ed-996a-8806574d5bee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094856 Jul 14 15:40:00.620666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 254/471] 10.222.0.99 () {58 vars in 1274 bytes} [Thu Jul 14 15:40:00 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:40:00.625645 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e93a91b7-4ceb-43db-a8f3-82f7e4ffdc26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:00.626609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e93a91b7-4ceb-43db-a8f3-82f7e4ffdc26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:00.629734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-486d406f-4760-4e98-8d6e-464dea231255 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:00.633054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e93a91b7-4ceb-43db-a8f3-82f7e4ffdc26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:00.633503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e93a91b7-4ceb-43db-a8f3-82f7e4ffdc26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:00.634304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e93a91b7-4ceb-43db-a8f3-82f7e4ffdc26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:00.634742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e93a91b7-4ceb-43db-a8f3-82f7e4ffdc26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:00.637271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-486d406f-4760-4e98-8d6e-464dea231255 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.157426 Jul 14 15:40:00.638038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 218/472] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:00 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:00.912799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e93a91b7-4ceb-43db-a8f3-82f7e4ffdc26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:00.921464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e93a91b7-4ceb-43db-a8f3-82f7e4ffdc26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.299792 Jul 14 15:40:00.922201 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 255/473] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:00 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:01.170320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e6f40438-fe3c-4d5b-a973-0480ec3ccf45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:01.170931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e6f40438-fe3c-4d5b-a973-0480ec3ccf45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:01.177500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6f40438-fe3c-4d5b-a973-0480ec3ccf45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:01.177980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6f40438-fe3c-4d5b-a973-0480ec3ccf45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:01.178750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6f40438-fe3c-4d5b-a973-0480ec3ccf45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:01.179474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6f40438-fe3c-4d5b-a973-0480ec3ccf45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:01.324856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e6f40438-fe3c-4d5b-a973-0480ec3ccf45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:01.334623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e6f40438-fe3c-4d5b-a973-0480ec3ccf45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:01.336208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e6f40438-fe3c-4d5b-a973-0480ec3ccf45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:01.337592 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e6f40438-fe3c-4d5b-a973-0480ec3ccf45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1743 microversion: 2.20 time: 0.171215 Jul 14 15:40:01.338158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 219/474] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:01 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1743 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:01.465694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dc063514-cf52-4743-91fb-3c877c2eec4b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:01.466433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dc063514-cf52-4743-91fb-3c877c2eec4b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] [instance: 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:01.468341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=4 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:01.468998 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=16 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:01.477661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc063514-cf52-4743-91fb-3c877c2eec4b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:01.478372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc063514-cf52-4743-91fb-3c877c2eec4b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:01.479382 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc063514-cf52-4743-91fb-3c877c2eec4b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:01.480042 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc063514-cf52-4743-91fb-3c877c2eec4b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:01.505472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-dc063514-cf52-4743-91fb-3c877c2eec4b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] HTTP exception thrown: Instance 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 could not be found. Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dc063514-cf52-4743-91fb-3c877c2eec4b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Request method failure captured: Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 HTTP/1.1 Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DiMvBfw4lAZhw96dDpZ1vuDBE-1YVOJTdsSHEkHL-sRRBtG7UCs6bPbz69rLSBbdM99dtSKdjxyE07V2HEVUDQiHHNpTkGkLes25o_4asf19pUYjlkdlHs5mtxVQaLQ3sZOe0-PeNh6S6hve00SWNzZPdn_GIn14wBHPC04JcrDSjw Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 2345d49f9fee4842826a396c43132a33 Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-VolumesActionsTest-888751778 Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:40:01.507854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:40:01.509217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2345d49f9fee4842826a396c43132a33"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2345d49f9fee4842826a396c43132a33"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2345d49f9fee4842826a396c43132a33"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2345d49f9fee4842826a396c43132a33"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:40:01.509217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-VolumesActionsTest-888751778 Jul 14 15:40:01.509217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 2345d49f9fee4842826a396c43132a33 Jul 14 15:40:01.509217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-VolumesActionsTest-888751778 Jul 14 15:40:01.509217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-VolumesActionsTest-888751778-project Jul 14 15:40:01.509217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:40:01.509217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:40:01.509217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 1f3411c8a7454203a4fbd748f1f3031a Jul 14 15:40:01.509217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-VolumesActionsTest-888751778-project Jul 14 15:40:01.509217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 15:40:01.509217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 could not be found. Jul 14 15:40:01.509217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9'} Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 could not be found. Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:40:01.509949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 could not be found. Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 could not be found. Jul 14 15:40:01.511169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:40:01.512831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dc063514-cf52-4743-91fb-3c877c2eec4b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] Returning 404 to user: Instance 8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:40:01.512831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dc063514-cf52-4743-91fb-3c877c2eec4b tempest-VolumesActionsTest-888751778 tempest-VolumesActionsTest-888751778-project] 10.222.0.99 "GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9" status: 404 len: 111 microversion: 2.1 time: 0.048240 Jul 14 15:40:01.512831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 256/475] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:01 2022] GET /compute/v2.1/servers/8f1cbf92-5e63-4546-aa31-ccc5b4f6e5b9 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:40:01.657865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3bdb1605-560b-4042-955b-f09d91c33c1b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:01.659132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3bdb1605-560b-4042-955b-f09d91c33c1b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:01.661489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=4 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:01.668148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3bdb1605-560b-4042-955b-f09d91c33c1b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:01.668455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3bdb1605-560b-4042-955b-f09d91c33c1b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:01.669480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3bdb1605-560b-4042-955b-f09d91c33c1b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:01.670090 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3bdb1605-560b-4042-955b-f09d91c33c1b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:01.847079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3bdb1605-560b-4042-955b-f09d91c33c1b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:01.855088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3bdb1605-560b-4042-955b-f09d91c33c1b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.202213 Jul 14 15:40:01.856898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 220/476] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:01 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:01.942581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b4c122ef-4f38-44fe-9347-6cb6a5fb6c26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:01.948617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b4c122ef-4f38-44fe-9347-6cb6a5fb6c26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:01.963627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b4c122ef-4f38-44fe-9347-6cb6a5fb6c26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:01.964381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b4c122ef-4f38-44fe-9347-6cb6a5fb6c26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:01.965164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b4c122ef-4f38-44fe-9347-6cb6a5fb6c26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:01.965610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b4c122ef-4f38-44fe-9347-6cb6a5fb6c26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:02.291739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-1c4a3bdf-35f2-4370-84e0-70008bd17cc5 req-cc16b20b-ddbc-4591-9995-4a8d5d49e523 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2213f73d-c833-4f74-b8f7-72e0699c30f9", "tag": "e9db016d-1273-4cca-b86b-04b2641d228a"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:02.312155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-1c4a3bdf-35f2-4370-84e0-70008bd17cc5 req-cc16b20b-ddbc-4591-9995-4a8d5d49e523 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:02.314193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-1c4a3bdf-35f2-4370-84e0-70008bd17cc5 req-cc16b20b-ddbc-4591-9995-4a8d5d49e523 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:02.321465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b4c122ef-4f38-44fe-9347-6cb6a5fb6c26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:02.334684 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b4c122ef-4f38-44fe-9347-6cb6a5fb6c26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.396626 Jul 14 15:40:02.352000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 257/477] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:01 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:02.357788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e746a1b1-db59-4771-bc78-425422dd617a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:02.362608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-1c4a3bdf-35f2-4370-84e0-70008bd17cc5 req-cc16b20b-ddbc-4591-9995-4a8d5d49e523 service nova] Creating event network-changed:e9db016d-1273-4cca-b86b-04b2641d228a for instance 2213f73d-c833-4f74-b8f7-72e0699c30f9 on hv-cinder-82651 Jul 14 15:40:02.363783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e746a1b1-db59-4771-bc78-425422dd617a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:02.374761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-1c4a3bdf-35f2-4370-84e0-70008bd17cc5 req-cc16b20b-ddbc-4591-9995-4a8d5d49e523 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.086954 Jul 14 15:40:02.377185 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e746a1b1-db59-4771-bc78-425422dd617a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:02.378981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 221/478] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:40:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:40:02.379253 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e746a1b1-db59-4771-bc78-425422dd617a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:02.380474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e746a1b1-db59-4771-bc78-425422dd617a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:02.381177 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e746a1b1-db59-4771-bc78-425422dd617a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:02.874470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-935f4e95-c73c-4fd2-b037-999b377f767e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:02.875180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-935f4e95-c73c-4fd2-b037-999b377f767e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:02.881769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-935f4e95-c73c-4fd2-b037-999b377f767e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:02.882231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-935f4e95-c73c-4fd2-b037-999b377f767e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:02.883200 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-935f4e95-c73c-4fd2-b037-999b377f767e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:02.883857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-935f4e95-c73c-4fd2-b037-999b377f767e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:02.903408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e746a1b1-db59-4771-bc78-425422dd617a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:02.915017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e746a1b1-db59-4771-bc78-425422dd617a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:02.920155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e746a1b1-db59-4771-bc78-425422dd617a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:02.929336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e746a1b1-db59-4771-bc78-425422dd617a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1743 microversion: 2.20 time: 0.575003 Jul 14 15:40:02.930665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 258/479] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1743 bytes in 577 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:40:03.048146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-935f4e95-c73c-4fd2-b037-999b377f767e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:03.056112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-935f4e95-c73c-4fd2-b037-999b377f767e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.186131 Jul 14 15:40:03.056609 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 222/480] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:02 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:03.354699 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ff974b73-ac6d-4b30-b357-3fe056b3754b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:03.355558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ff974b73-ac6d-4b30-b357-3fe056b3754b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:03.362582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ff974b73-ac6d-4b30-b357-3fe056b3754b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:03.363041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ff974b73-ac6d-4b30-b357-3fe056b3754b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:03.363860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ff974b73-ac6d-4b30-b357-3fe056b3754b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:03.364301 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ff974b73-ac6d-4b30-b357-3fe056b3754b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:03.504400 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ff974b73-ac6d-4b30-b357-3fe056b3754b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:03.512649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ff974b73-ac6d-4b30-b357-3fe056b3754b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.161773 Jul 14 15:40:03.513269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 259/481] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:03 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:03.949716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-76cd2113-b540-4e41-9a4b-a149c4763769 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:03.950328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-76cd2113-b540-4e41-9a4b-a149c4763769 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:03.957238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76cd2113-b540-4e41-9a4b-a149c4763769 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:03.957687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76cd2113-b540-4e41-9a4b-a149c4763769 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:03.958512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76cd2113-b540-4e41-9a4b-a149c4763769 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:03.958956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76cd2113-b540-4e41-9a4b-a149c4763769 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:04.073089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ab6f8aa2-e95a-4144-bb5e-73951dc0b15d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:04.073925 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ab6f8aa2-e95a-4144-bb5e-73951dc0b15d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:04.080879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab6f8aa2-e95a-4144-bb5e-73951dc0b15d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:04.081328 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab6f8aa2-e95a-4144-bb5e-73951dc0b15d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:04.082095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab6f8aa2-e95a-4144-bb5e-73951dc0b15d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:04.082531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab6f8aa2-e95a-4144-bb5e-73951dc0b15d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:04.096026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-76cd2113-b540-4e41-9a4b-a149c4763769 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:04.104043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-76cd2113-b540-4e41-9a4b-a149c4763769 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:04.105506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-76cd2113-b540-4e41-9a4b-a149c4763769 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:04.106711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-76cd2113-b540-4e41-9a4b-a149c4763769 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1743 microversion: 2.20 time: 0.160892 Jul 14 15:40:04.107201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 223/482] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1743 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:04.216429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ab6f8aa2-e95a-4144-bb5e-73951dc0b15d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:04.224834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ab6f8aa2-e95a-4144-bb5e-73951dc0b15d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.155619 Jul 14 15:40:04.225405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 260/483] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:04 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:04.425616 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-c85a7af0-f273-499a-9935-4d1c5a023d21 req-41d66868-e870-4aef-8506-4a7eaaebeb9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e7b59f-1959-4ed1-ba26-c70f4d9336bb", "tag": "6d596c25-d79d-4ae5-aad6-5b159dc0f3f0"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:04.433786 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-c85a7af0-f273-499a-9935-4d1c5a023d21 req-41d66868-e870-4aef-8506-4a7eaaebeb9c service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:04.434254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-c85a7af0-f273-499a-9935-4d1c5a023d21 req-41d66868-e870-4aef-8506-4a7eaaebeb9c service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:04.446406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-c85a7af0-f273-499a-9935-4d1c5a023d21 req-41d66868-e870-4aef-8506-4a7eaaebeb9c service nova] Creating event network-changed:6d596c25-d79d-4ae5-aad6-5b159dc0f3f0 for instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb on hv-cinder-82651 Jul 14 15:40:04.451449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-c85a7af0-f273-499a-9935-4d1c5a023d21 req-41d66868-e870-4aef-8506-4a7eaaebeb9c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030174 Jul 14 15:40:04.452062 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 224/484] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:40:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:40:04.530417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7b8d6ffe-fcb3-47fd-9da1-f3088b12da98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:04.531036 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7b8d6ffe-fcb3-47fd-9da1-f3088b12da98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:04.538019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b8d6ffe-fcb3-47fd-9da1-f3088b12da98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:04.538472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b8d6ffe-fcb3-47fd-9da1-f3088b12da98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:04.539241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b8d6ffe-fcb3-47fd-9da1-f3088b12da98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:04.539707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b8d6ffe-fcb3-47fd-9da1-f3088b12da98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:04.680602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7b8d6ffe-fcb3-47fd-9da1-f3088b12da98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:04.692721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7b8d6ffe-fcb3-47fd-9da1-f3088b12da98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.166058 Jul 14 15:40:04.693781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 261/485] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:04 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:05.127318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fcb9a613-c2a1-40a9-9197-cef678be0682 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:05.128051 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fcb9a613-c2a1-40a9-9197-cef678be0682 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:05.134291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcb9a613-c2a1-40a9-9197-cef678be0682 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:05.134745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcb9a613-c2a1-40a9-9197-cef678be0682 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:05.135504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcb9a613-c2a1-40a9-9197-cef678be0682 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:05.135968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcb9a613-c2a1-40a9-9197-cef678be0682 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:05.242405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-96f018d6-70ee-4d15-a00f-102bfaf6e3a3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:05.243757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-96f018d6-70ee-4d15-a00f-102bfaf6e3a3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:05.250103 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96f018d6-70ee-4d15-a00f-102bfaf6e3a3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:05.250488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96f018d6-70ee-4d15-a00f-102bfaf6e3a3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:05.252370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96f018d6-70ee-4d15-a00f-102bfaf6e3a3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:05.253747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96f018d6-70ee-4d15-a00f-102bfaf6e3a3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:05.272448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcb9a613-c2a1-40a9-9197-cef678be0682 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:05.281015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcb9a613-c2a1-40a9-9197-cef678be0682 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:05.282677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcb9a613-c2a1-40a9-9197-cef678be0682 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:05.283994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fcb9a613-c2a1-40a9-9197-cef678be0682 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1743 microversion: 2.20 time: 0.162281 Jul 14 15:40:05.284642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 225/486] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:05 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1743 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:05.407897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-96f018d6-70ee-4d15-a00f-102bfaf6e3a3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:05.415451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-96f018d6-70ee-4d15-a00f-102bfaf6e3a3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.176863 Jul 14 15:40:05.416060 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 262/487] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:05 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:05.711317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0047277d-1b45-45c7-bed6-fdb7e868c108 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:05.711997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0047277d-1b45-45c7-bed6-fdb7e868c108 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:05.718205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0047277d-1b45-45c7-bed6-fdb7e868c108 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:05.718663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0047277d-1b45-45c7-bed6-fdb7e868c108 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:05.719420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0047277d-1b45-45c7-bed6-fdb7e868c108 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:05.719956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0047277d-1b45-45c7-bed6-fdb7e868c108 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:05.855236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0047277d-1b45-45c7-bed6-fdb7e868c108 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:05.863887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0047277d-1b45-45c7-bed6-fdb7e868c108 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.156237 Jul 14 15:40:05.864459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 226/488] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:05 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:06.303194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6969189e-8f66-420d-872e-4f4c1833f3c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:06.303844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6969189e-8f66-420d-872e-4f4c1833f3c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:06.310308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6969189e-8f66-420d-872e-4f4c1833f3c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:06.310759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6969189e-8f66-420d-872e-4f4c1833f3c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:06.311528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6969189e-8f66-420d-872e-4f4c1833f3c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:06.311992 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6969189e-8f66-420d-872e-4f4c1833f3c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:06.441277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b451e53f-3fbc-4901-bea4-de8f73be3427 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:06.442116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b451e53f-3fbc-4901-bea4-de8f73be3427 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:06.446361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6969189e-8f66-420d-872e-4f4c1833f3c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:06.448815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b451e53f-3fbc-4901-bea4-de8f73be3427 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:06.449330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b451e53f-3fbc-4901-bea4-de8f73be3427 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:06.450483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b451e53f-3fbc-4901-bea4-de8f73be3427 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:06.450640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b451e53f-3fbc-4901-bea4-de8f73be3427 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:06.455722 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6969189e-8f66-420d-872e-4f4c1833f3c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:06.457423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6969189e-8f66-420d-872e-4f4c1833f3c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:06.458587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6969189e-8f66-420d-872e-4f4c1833f3c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1743 microversion: 2.20 time: 0.159577 Jul 14 15:40:06.459146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 263/489] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:06 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1743 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:06.584982 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b451e53f-3fbc-4901-bea4-de8f73be3427 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:06.592923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b451e53f-3fbc-4901-bea4-de8f73be3427 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.155872 Jul 14 15:40:06.593485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 227/490] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:06 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:06.881115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c29f8003-a453-4330-a0ff-65d1df521cd3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:06.882074 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c29f8003-a453-4330-a0ff-65d1df521cd3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:06.888266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c29f8003-a453-4330-a0ff-65d1df521cd3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:06.888726 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c29f8003-a453-4330-a0ff-65d1df521cd3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:06.889500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c29f8003-a453-4330-a0ff-65d1df521cd3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:06.889938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c29f8003-a453-4330-a0ff-65d1df521cd3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:07.027167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c29f8003-a453-4330-a0ff-65d1df521cd3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:07.029401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:07.037504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c29f8003-a453-4330-a0ff-65d1df521cd3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.160200 Jul 14 15:40:07.038108 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 264/491] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:06 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:07.477038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a5f51ce2-81da-44b7-b1fc-d95f697a4426 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:07.477596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a5f51ce2-81da-44b7-b1fc-d95f697a4426 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:07.484118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a5f51ce2-81da-44b7-b1fc-d95f697a4426 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:07.484569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a5f51ce2-81da-44b7-b1fc-d95f697a4426 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:07.485862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a5f51ce2-81da-44b7-b1fc-d95f697a4426 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:07.486306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a5f51ce2-81da-44b7-b1fc-d95f697a4426 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:07.611093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-83a5ad9b-4e6d-464a-a7ec-e09570069429 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:07.611749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-83a5ad9b-4e6d-464a-a7ec-e09570069429 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:07.618273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83a5ad9b-4e6d-464a-a7ec-e09570069429 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:07.618731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83a5ad9b-4e6d-464a-a7ec-e09570069429 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:07.619512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83a5ad9b-4e6d-464a-a7ec-e09570069429 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:07.619981 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83a5ad9b-4e6d-464a-a7ec-e09570069429 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:07.628285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a5f51ce2-81da-44b7-b1fc-d95f697a4426 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:07.636285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a5f51ce2-81da-44b7-b1fc-d95f697a4426 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:07.637790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a5f51ce2-81da-44b7-b1fc-d95f697a4426 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:07.638948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a5f51ce2-81da-44b7-b1fc-d95f697a4426 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1743 microversion: 2.20 time: 0.165919 Jul 14 15:40:07.639512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 228/492] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:07 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1743 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:07.757605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-83a5ad9b-4e6d-464a-a7ec-e09570069429 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:07.765097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-83a5ad9b-4e6d-464a-a7ec-e09570069429 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.158630 Jul 14 15:40:07.765653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 265/493] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:07 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:08.054868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-524eb76a-aa3d-48ce-94a3-32af6cbd6db6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:08.055509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-524eb76a-aa3d-48ce-94a3-32af6cbd6db6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:08.061554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-524eb76a-aa3d-48ce-94a3-32af6cbd6db6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:08.062008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-524eb76a-aa3d-48ce-94a3-32af6cbd6db6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:08.062782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-524eb76a-aa3d-48ce-94a3-32af6cbd6db6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:08.063283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-524eb76a-aa3d-48ce-94a3-32af6cbd6db6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:08.216087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-524eb76a-aa3d-48ce-94a3-32af6cbd6db6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:08.220241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-7d28a07e-33c9-46a2-8471-4e3e031dd3ac req-5cf856d0-c786-483b-bfdb-fdb1d2ce9840 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c8cb95-bde5-4c91-99de-27aa44a822bf", "name": "network-vif-plugged", "status": "completed", "tag": "daed7bb6-45ad-49c9-829a-e0e2a0eca7f9"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:08.225628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-524eb76a-aa3d-48ce-94a3-32af6cbd6db6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.174666 Jul 14 15:40:08.226208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 229/494] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:08 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:08.231315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-7d28a07e-33c9-46a2-8471-4e3e031dd3ac req-5cf856d0-c786-483b-bfdb-fdb1d2ce9840 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:08.232357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-7d28a07e-33c9-46a2-8471-4e3e031dd3ac req-5cf856d0-c786-483b-bfdb-fdb1d2ce9840 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:08.247796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-7d28a07e-33c9-46a2-8471-4e3e031dd3ac req-5cf856d0-c786-483b-bfdb-fdb1d2ce9840 service nova] Creating event network-vif-plugged:daed7bb6-45ad-49c9-829a-e0e2a0eca7f9 for instance e5c8cb95-bde5-4c91-99de-27aa44a822bf on hv-cinder-82651 Jul 14 15:40:08.253156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-7d28a07e-33c9-46a2-8471-4e3e031dd3ac req-5cf856d0-c786-483b-bfdb-fdb1d2ce9840 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037626 Jul 14 15:40:08.253752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 266/495] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:40:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:40:08.658413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-64b1b093-b8f6-4932-b95c-64207ab53216 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:08.659024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-64b1b093-b8f6-4932-b95c-64207ab53216 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:08.665590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-64b1b093-b8f6-4932-b95c-64207ab53216 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:08.666037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-64b1b093-b8f6-4932-b95c-64207ab53216 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:08.666794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-64b1b093-b8f6-4932-b95c-64207ab53216 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:08.667230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-64b1b093-b8f6-4932-b95c-64207ab53216 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:08.784507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-64f3780c-8fd4-438e-840b-b5f7529febb9 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:08.786296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-64f3780c-8fd4-438e-840b-b5f7529febb9 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:08.793582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-64f3780c-8fd4-438e-840b-b5f7529febb9 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:08.794040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-64f3780c-8fd4-438e-840b-b5f7529febb9 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:08.794981 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-64f3780c-8fd4-438e-840b-b5f7529febb9 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:08.795995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-64f3780c-8fd4-438e-840b-b5f7529febb9 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:08.807177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-64b1b093-b8f6-4932-b95c-64207ab53216 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:08.815911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-64b1b093-b8f6-4932-b95c-64207ab53216 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:08.817441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-64b1b093-b8f6-4932-b95c-64207ab53216 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:08.818600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-64b1b093-b8f6-4932-b95c-64207ab53216 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1743 microversion: 2.20 time: 0.165068 Jul 14 15:40:08.819160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 230/496] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:08 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1743 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:08.951528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-64f3780c-8fd4-438e-840b-b5f7529febb9 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:08.960350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-64f3780c-8fd4-438e-840b-b5f7529febb9 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.182110 Jul 14 15:40:08.960948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 267/497] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:08 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:09.047591 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2135213347", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-443020232", "security_groups": [{"name": "tempest-secgroup-smoke-2950909"}], "block_device_mapping_v2": [{"uuid": "a826ab59-6b31-4681-b6e0-7734870763e1", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "a69b93e4-5ebf-4475-ad2c-50ce2a3ccbee"}]}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:09.179015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.network.neutron [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] validate_networks() for [('a69b93e4-5ebf-4475-ad2c-50ce2a3ccbee', None, None, None, None, None)] {{(pid=124503) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:40:09.248727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-30420c41-58a4-4251-9388-742feabe6d4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:09.249338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-30420c41-58a4-4251-9388-742feabe6d4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:09.256190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30420c41-58a4-4251-9388-742feabe6d4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:09.256642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30420c41-58a4-4251-9388-742feabe6d4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:09.257407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30420c41-58a4-4251-9388-742feabe6d4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:09.257847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30420c41-58a4-4251-9388-742feabe6d4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:09.403356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-30420c41-58a4-4251-9388-742feabe6d4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:09.411541 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-30420c41-58a4-4251-9388-742feabe6d4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.166604 Jul 14 15:40:09.412358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 268/498] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:09 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:09.585969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Flavor limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:40:09.586413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Image limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:40:09.586981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Flavor pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:40:09.587509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Image pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:40:09.588079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:40:09.599382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:09.599882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:09.600682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:09.601117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:09.619050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Getting quotas for project 599a768f6b9d4134a4b8e05a7e5f5e87. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:40:09.623264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Getting quotas for user a0e4900b6ad24eb19fe169d9c8d8c3a7 and project 599a768f6b9d4134a4b8e05a7e5f5e87. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:40:09.682440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Going to run 1 instances... {{(pid=124503) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:40:09.684539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a826ab59-6b31-4681-b6e0-7734870763e1',volume_size=None,volume_type=None)] {{(pid=124503) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:40:09.823802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-34e2de76-9d40-4ac5-91d8-327c473a3c70 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 403 microversion: 2.1 time: 0.780051 Jul 14 15:40:09.824609 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 231/499] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 15:40:09 2022] POST /compute/v2.1/servers => generated 403 bytes in 782 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:40:09.835318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a540b5cd-25c9-40fa-bfdf-4102abbb1b6f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:09.836028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a540b5cd-25c9-40fa-bfdf-4102abbb1b6f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:09.837354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5ba0d603-83c2-4bdc-9c09-ec7d0df91678 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:09.838000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5ba0d603-83c2-4bdc-9c09-ec7d0df91678 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:09.844267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ba0d603-83c2-4bdc-9c09-ec7d0df91678 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:09.845864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ba0d603-83c2-4bdc-9c09-ec7d0df91678 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:09.846649 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ba0d603-83c2-4bdc-9c09-ec7d0df91678 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:09.847098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ba0d603-83c2-4bdc-9c09-ec7d0df91678 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:09.894132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a540b5cd-25c9-40fa-bfdf-4102abbb1b6f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:09.901450 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a540b5cd-25c9-40fa-bfdf-4102abbb1b6f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1094 microversion: 2.1 time: 0.070159 Jul 14 15:40:09.911542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 269/500] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:09 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1094 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:09.977746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d03800d2-7c4e-4f09-bcc2-f0c23150d2a1 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:09.978365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d03800d2-7c4e-4f09-bcc2-f0c23150d2a1 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:09.991141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d03800d2-7c4e-4f09-bcc2-f0c23150d2a1 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:09.991141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d03800d2-7c4e-4f09-bcc2-f0c23150d2a1 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:09.991141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d03800d2-7c4e-4f09-bcc2-f0c23150d2a1 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:09.991141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d03800d2-7c4e-4f09-bcc2-f0c23150d2a1 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:10.002327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5ba0d603-83c2-4bdc-9c09-ec7d0df91678 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:10.010627 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5ba0d603-83c2-4bdc-9c09-ec7d0df91678 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:10.012803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5ba0d603-83c2-4bdc-9c09-ec7d0df91678 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:10.014385 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5ba0d603-83c2-4bdc-9c09-ec7d0df91678 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1743 microversion: 2.20 time: 0.180851 Jul 14 15:40:10.014985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 232/501] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:09 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1743 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:10.145434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d03800d2-7c4e-4f09-bcc2-f0c23150d2a1 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:10.153428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d03800d2-7c4e-4f09-bcc2-f0c23150d2a1 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.179937 Jul 14 15:40:10.154091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 270/502] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:09 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:10.431762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-838fd417-22ba-4ed7-a3fa-9f671c229f26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:10.432766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-838fd417-22ba-4ed7-a3fa-9f671c229f26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:10.443133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-838fd417-22ba-4ed7-a3fa-9f671c229f26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:10.444218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-838fd417-22ba-4ed7-a3fa-9f671c229f26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:10.445214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-838fd417-22ba-4ed7-a3fa-9f671c229f26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:10.445859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-838fd417-22ba-4ed7-a3fa-9f671c229f26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:10.452508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:10.622374 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-838fd417-22ba-4ed7-a3fa-9f671c229f26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:10.632562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-838fd417-22ba-4ed7-a3fa-9f671c229f26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.206264 Jul 14 15:40:10.634282 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 233/503] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:10 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:10.918842 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a7816ec1-01a4-491d-998f-e1934af93c49 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:10.920209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a7816ec1-01a4-491d-998f-e1934af93c49 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:10.928050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a7816ec1-01a4-491d-998f-e1934af93c49 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:10.928050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a7816ec1-01a4-491d-998f-e1934af93c49 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:10.929715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a7816ec1-01a4-491d-998f-e1934af93c49 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:10.929715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a7816ec1-01a4-491d-998f-e1934af93c49 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:10.997296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a7816ec1-01a4-491d-998f-e1934af93c49 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:11.006296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a7816ec1-01a4-491d-998f-e1934af93c49 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1144 microversion: 2.1 time: 0.091344 Jul 14 15:40:11.006866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 271/504] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:10 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1144 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:11.035522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2ff9b4bf-9e65-49ed-aa51-d08b87854b10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:11.036404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2ff9b4bf-9e65-49ed-aa51-d08b87854b10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:11.043639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2ff9b4bf-9e65-49ed-aa51-d08b87854b10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:11.044365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2ff9b4bf-9e65-49ed-aa51-d08b87854b10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:11.045354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2ff9b4bf-9e65-49ed-aa51-d08b87854b10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:11.045932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2ff9b4bf-9e65-49ed-aa51-d08b87854b10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:11.170637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1fbfa44f-1ec3-4c94-a1c5-40a0b0adbe69 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:11.171159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1fbfa44f-1ec3-4c94-a1c5-40a0b0adbe69 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:11.182068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fbfa44f-1ec3-4c94-a1c5-40a0b0adbe69 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:11.182847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fbfa44f-1ec3-4c94-a1c5-40a0b0adbe69 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:11.183920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fbfa44f-1ec3-4c94-a1c5-40a0b0adbe69 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:11.184742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fbfa44f-1ec3-4c94-a1c5-40a0b0adbe69 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:11.226334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2ff9b4bf-9e65-49ed-aa51-d08b87854b10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:11.240630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2ff9b4bf-9e65-49ed-aa51-d08b87854b10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:11.242523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2ff9b4bf-9e65-49ed-aa51-d08b87854b10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:11.244058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2ff9b4bf-9e65-49ed-aa51-d08b87854b10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1743 microversion: 2.20 time: 0.213036 Jul 14 15:40:11.245215 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 234/505] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:11 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1743 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:40:11.576871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1fbfa44f-1ec3-4c94-a1c5-40a0b0adbe69 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:11.586611 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1fbfa44f-1ec3-4c94-a1c5-40a0b0adbe69 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.420123 Jul 14 15:40:11.587199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 272/506] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:11 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:11.654820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-20be3f2e-ba94-478e-823c-3df7b3d1bf29 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:11.655553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-20be3f2e-ba94-478e-823c-3df7b3d1bf29 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:11.662807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20be3f2e-ba94-478e-823c-3df7b3d1bf29 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:11.663437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20be3f2e-ba94-478e-823c-3df7b3d1bf29 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:11.664583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20be3f2e-ba94-478e-823c-3df7b3d1bf29 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:11.665140 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20be3f2e-ba94-478e-823c-3df7b3d1bf29 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:11.809815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-20be3f2e-ba94-478e-823c-3df7b3d1bf29 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:11.819191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-20be3f2e-ba94-478e-823c-3df7b3d1bf29 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.168550 Jul 14 15:40:11.819806 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 235/507] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:11 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:12.032459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1deaf3a8-6f16-4a89-90df-d811d169fbff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:12.034195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1deaf3a8-6f16-4a89-90df-d811d169fbff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:12.055228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1deaf3a8-6f16-4a89-90df-d811d169fbff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:12.061704 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1deaf3a8-6f16-4a89-90df-d811d169fbff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:12.063927 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1deaf3a8-6f16-4a89-90df-d811d169fbff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:12.066537 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1deaf3a8-6f16-4a89-90df-d811d169fbff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:12.264404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1deaf3a8-6f16-4a89-90df-d811d169fbff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:12.269756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-352282c4-6828-441a-9bb4-2195513f92fa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:12.270455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-352282c4-6828-441a-9bb4-2195513f92fa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:12.289222 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1deaf3a8-6f16-4a89-90df-d811d169fbff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1136 microversion: 2.1 time: 0.270633 Jul 14 15:40:12.293022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 273/508] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:12 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1136 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:12.303092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-352282c4-6828-441a-9bb4-2195513f92fa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:12.303544 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-352282c4-6828-441a-9bb4-2195513f92fa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:12.304361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-352282c4-6828-441a-9bb4-2195513f92fa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:12.304798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-352282c4-6828-441a-9bb4-2195513f92fa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:12.604646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-352282c4-6828-441a-9bb4-2195513f92fa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:12.605729 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-10092ac1-970d-4a47-9bbe-db8ee7bb4028 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:12.606698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-10092ac1-970d-4a47-9bbe-db8ee7bb4028 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:12.614734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-352282c4-6828-441a-9bb4-2195513f92fa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:12.617816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-352282c4-6828-441a-9bb4-2195513f92fa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:12.620348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-352282c4-6828-441a-9bb4-2195513f92fa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.355426 Jul 14 15:40:12.621797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 236/509] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:12 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:12.629724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-10092ac1-970d-4a47-9bbe-db8ee7bb4028 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:12.632769 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-10092ac1-970d-4a47-9bbe-db8ee7bb4028 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:12.634584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-10092ac1-970d-4a47-9bbe-db8ee7bb4028 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:12.635208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-10092ac1-970d-4a47-9bbe-db8ee7bb4028 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:12.839587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0ff50f38-56d7-4e02-a10f-490b316c6ffe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:12.840500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0ff50f38-56d7-4e02-a10f-490b316c6ffe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:12.845920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-10092ac1-970d-4a47-9bbe-db8ee7bb4028 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:12.853067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ff50f38-56d7-4e02-a10f-490b316c6ffe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:12.854034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ff50f38-56d7-4e02-a10f-490b316c6ffe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:12.854643 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-10092ac1-970d-4a47-9bbe-db8ee7bb4028 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.254701 Jul 14 15:40:12.855519 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 274/510] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:12 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:12.856157 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ff50f38-56d7-4e02-a10f-490b316c6ffe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:12.856926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ff50f38-56d7-4e02-a10f-490b316c6ffe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:13.080547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0ff50f38-56d7-4e02-a10f-490b316c6ffe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:13.098498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0ff50f38-56d7-4e02-a10f-490b316c6ffe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.255612 Jul 14 15:40:13.112007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 237/511] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:12 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:13.309320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0403300a-3271-4ec6-b99f-a03aa0d86ffb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:13.310718 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0403300a-3271-4ec6-b99f-a03aa0d86ffb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:13.322176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0403300a-3271-4ec6-b99f-a03aa0d86ffb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:13.322913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0403300a-3271-4ec6-b99f-a03aa0d86ffb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:13.323914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0403300a-3271-4ec6-b99f-a03aa0d86ffb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:13.324541 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0403300a-3271-4ec6-b99f-a03aa0d86ffb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:13.533574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0403300a-3271-4ec6-b99f-a03aa0d86ffb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:13.543088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0403300a-3271-4ec6-b99f-a03aa0d86ffb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1200 microversion: 2.1 time: 0.239619 Jul 14 15:40:13.549106 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 275/512] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:13 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1200 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:13.648282 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-167c3fbd-8955-413f-bbc0-82977793b700 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:13.652602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-167c3fbd-8955-413f-bbc0-82977793b700 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:13.677024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-167c3fbd-8955-413f-bbc0-82977793b700 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:13.678698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-167c3fbd-8955-413f-bbc0-82977793b700 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:13.682529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-167c3fbd-8955-413f-bbc0-82977793b700 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:13.683348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-167c3fbd-8955-413f-bbc0-82977793b700 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:13.873743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9193a9ba-8ee3-42a4-b677-faff1dfcd5fa tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:13.874632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9193a9ba-8ee3-42a4-b677-faff1dfcd5fa tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:13.882345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9193a9ba-8ee3-42a4-b677-faff1dfcd5fa tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:13.883100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9193a9ba-8ee3-42a4-b677-faff1dfcd5fa tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:13.883914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9193a9ba-8ee3-42a4-b677-faff1dfcd5fa tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:13.884513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9193a9ba-8ee3-42a4-b677-faff1dfcd5fa tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:13.914129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-167c3fbd-8955-413f-bbc0-82977793b700 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:13.925609 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-167c3fbd-8955-413f-bbc0-82977793b700 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:13.930473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-167c3fbd-8955-413f-bbc0-82977793b700 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:13.939688 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-167c3fbd-8955-413f-bbc0-82977793b700 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.301288 Jul 14 15:40:13.952322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 238/513] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:13 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 315 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:14.116419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-73c87d29-e952-4f9e-ba4c-7e2cf6b704dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:14.117397 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-73c87d29-e952-4f9e-ba4c-7e2cf6b704dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:14.129343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73c87d29-e952-4f9e-ba4c-7e2cf6b704dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:14.130049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73c87d29-e952-4f9e-ba4c-7e2cf6b704dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:14.131007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73c87d29-e952-4f9e-ba4c-7e2cf6b704dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:14.145090 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73c87d29-e952-4f9e-ba4c-7e2cf6b704dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:14.164023 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9193a9ba-8ee3-42a4-b677-faff1dfcd5fa tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:14.179525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9193a9ba-8ee3-42a4-b677-faff1dfcd5fa tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.309368 Jul 14 15:40:14.180692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 276/514] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:13 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:14.379188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-73c87d29-e952-4f9e-ba4c-7e2cf6b704dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:14.395499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-73c87d29-e952-4f9e-ba4c-7e2cf6b704dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.283170 Jul 14 15:40:14.423398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 239/515] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:14 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:14.578905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-593c1256-79fe-4e3d-b174-ae004969f7ff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:14.580355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-593c1256-79fe-4e3d-b174-ae004969f7ff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:14.588299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-593c1256-79fe-4e3d-b174-ae004969f7ff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:14.589092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-593c1256-79fe-4e3d-b174-ae004969f7ff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:14.590093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-593c1256-79fe-4e3d-b174-ae004969f7ff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:14.590829 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-593c1256-79fe-4e3d-b174-ae004969f7ff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:14.742064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-593c1256-79fe-4e3d-b174-ae004969f7ff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:14.757056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-593c1256-79fe-4e3d-b174-ae004969f7ff tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1210 microversion: 2.1 time: 0.182390 Jul 14 15:40:14.758424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 277/516] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:14 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1210 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:14.977761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-68c59db7-1bd9-4c7f-a7f5-110a0f72244b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:14.980327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-68c59db7-1bd9-4c7f-a7f5-110a0f72244b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:15.006999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-68c59db7-1bd9-4c7f-a7f5-110a0f72244b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:15.007764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-68c59db7-1bd9-4c7f-a7f5-110a0f72244b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:15.008723 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-68c59db7-1bd9-4c7f-a7f5-110a0f72244b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:15.011641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-68c59db7-1bd9-4c7f-a7f5-110a0f72244b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:15.198563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a9e973e6-ac34-48df-a84a-86a32ba017e2 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:15.199448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a9e973e6-ac34-48df-a84a-86a32ba017e2 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:15.210293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a9e973e6-ac34-48df-a84a-86a32ba017e2 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:15.211047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a9e973e6-ac34-48df-a84a-86a32ba017e2 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:15.212484 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a9e973e6-ac34-48df-a84a-86a32ba017e2 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:15.216654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a9e973e6-ac34-48df-a84a-86a32ba017e2 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:15.281109 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-68c59db7-1bd9-4c7f-a7f5-110a0f72244b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:15.291864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-68c59db7-1bd9-4c7f-a7f5-110a0f72244b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:15.293567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-68c59db7-1bd9-4c7f-a7f5-110a0f72244b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:15.294897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-68c59db7-1bd9-4c7f-a7f5-110a0f72244b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.326024 Jul 14 15:40:15.296300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 240/517] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:14 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:15.444520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8a5ce1d7-0bd6-498a-a70b-ff3495db481e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:15.445521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8a5ce1d7-0bd6-498a-a70b-ff3495db481e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:15.461869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8a5ce1d7-0bd6-498a-a70b-ff3495db481e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:15.462784 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8a5ce1d7-0bd6-498a-a70b-ff3495db481e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:15.464002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8a5ce1d7-0bd6-498a-a70b-ff3495db481e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:15.464728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8a5ce1d7-0bd6-498a-a70b-ff3495db481e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:15.517099 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a9e973e6-ac34-48df-a84a-86a32ba017e2 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:15.530266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a9e973e6-ac34-48df-a84a-86a32ba017e2 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.335577 Jul 14 15:40:15.532805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 278/518] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:15 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:15.766840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8a5ce1d7-0bd6-498a-a70b-ff3495db481e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:15.776050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8a5ce1d7-0bd6-498a-a70b-ff3495db481e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.342091 Jul 14 15:40:15.776277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-92918998-27b2-449e-82b9-3d4494d87c9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:15.776959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-92918998-27b2-449e-82b9-3d4494d87c9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:15.785662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 241/519] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:15 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:15.791614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92918998-27b2-449e-82b9-3d4494d87c9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:15.792092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92918998-27b2-449e-82b9-3d4494d87c9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:15.793029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92918998-27b2-449e-82b9-3d4494d87c9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:15.793544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92918998-27b2-449e-82b9-3d4494d87c9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:15.908128 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-92918998-27b2-449e-82b9-3d4494d87c9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:15.916529 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-92918998-27b2-449e-82b9-3d4494d87c9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1210 microversion: 2.1 time: 0.144457 Jul 14 15:40:15.926238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 279/520] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:15 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1210 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:16.326017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-448f2091-63f1-4e0b-ad82-8b181d7c07b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:16.330803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-448f2091-63f1-4e0b-ad82-8b181d7c07b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:16.344135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-448f2091-63f1-4e0b-ad82-8b181d7c07b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:16.345630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-448f2091-63f1-4e0b-ad82-8b181d7c07b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:16.346705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-448f2091-63f1-4e0b-ad82-8b181d7c07b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:16.347361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-448f2091-63f1-4e0b-ad82-8b181d7c07b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:16.560353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b3173592-b39c-41f4-844b-284cee0a1d12 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:16.561051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b3173592-b39c-41f4-844b-284cee0a1d12 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:16.562866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-448f2091-63f1-4e0b-ad82-8b181d7c07b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:16.574316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-448f2091-63f1-4e0b-ad82-8b181d7c07b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:16.575084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3173592-b39c-41f4-844b-284cee0a1d12 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:16.577739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-448f2091-63f1-4e0b-ad82-8b181d7c07b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:16.580116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-448f2091-63f1-4e0b-ad82-8b181d7c07b4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.262365 Jul 14 15:40:16.590734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3173592-b39c-41f4-844b-284cee0a1d12 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:16.590734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3173592-b39c-41f4-844b-284cee0a1d12 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:16.590734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3173592-b39c-41f4-844b-284cee0a1d12 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:16.591808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 242/521] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:16 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:16.808192 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dadce545-35c2-4c20-9685-205d22a9a048 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:16.811889 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dadce545-35c2-4c20-9685-205d22a9a048 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:16.825106 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b3173592-b39c-41f4-844b-284cee0a1d12 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:16.826673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dadce545-35c2-4c20-9685-205d22a9a048 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:16.827482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dadce545-35c2-4c20-9685-205d22a9a048 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:16.828542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dadce545-35c2-4c20-9685-205d22a9a048 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:16.829965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dadce545-35c2-4c20-9685-205d22a9a048 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:16.839637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b3173592-b39c-41f4-844b-284cee0a1d12 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.282773 Jul 14 15:40:16.840595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 280/522] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:16 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:17.035243 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a78dc752-ba20-4ac8-8147-b10af04fbd09 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:17.037002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a78dc752-ba20-4ac8-8147-b10af04fbd09 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:17.053381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a78dc752-ba20-4ac8-8147-b10af04fbd09 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:17.054226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a78dc752-ba20-4ac8-8147-b10af04fbd09 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:17.055261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a78dc752-ba20-4ac8-8147-b10af04fbd09 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:17.055951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a78dc752-ba20-4ac8-8147-b10af04fbd09 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:17.168692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a78dc752-ba20-4ac8-8147-b10af04fbd09 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:17.177515 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a78dc752-ba20-4ac8-8147-b10af04fbd09 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1210 microversion: 2.1 time: 0.241202 Jul 14 15:40:17.179918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 281/523] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:16 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1210 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:17.183214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dadce545-35c2-4c20-9685-205d22a9a048 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:17.193270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dadce545-35c2-4c20-9685-205d22a9a048 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.389024 Jul 14 15:40:17.194399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 243/524] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:16 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 391 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:17.600542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-354d9902-f1d3-4e54-b785-72107fea7fc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:17.601054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-354d9902-f1d3-4e54-b785-72107fea7fc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:17.608633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-354d9902-f1d3-4e54-b785-72107fea7fc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:17.609238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-354d9902-f1d3-4e54-b785-72107fea7fc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:17.610116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-354d9902-f1d3-4e54-b785-72107fea7fc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:17.611381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-354d9902-f1d3-4e54-b785-72107fea7fc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:17.859039 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ffab9ef3-bc18-4bc8-bc27-eb1ce3666e65 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:17.859666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ffab9ef3-bc18-4bc8-bc27-eb1ce3666e65 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:17.871210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-354d9902-f1d3-4e54-b785-72107fea7fc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:17.879093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffab9ef3-bc18-4bc8-bc27-eb1ce3666e65 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:17.880843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffab9ef3-bc18-4bc8-bc27-eb1ce3666e65 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:17.881450 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-354d9902-f1d3-4e54-b785-72107fea7fc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:17.881645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffab9ef3-bc18-4bc8-bc27-eb1ce3666e65 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:17.882095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffab9ef3-bc18-4bc8-bc27-eb1ce3666e65 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:17.883648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-354d9902-f1d3-4e54-b785-72107fea7fc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:17.885325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-354d9902-f1d3-4e54-b785-72107fea7fc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.290004 Jul 14 15:40:17.899199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 282/525] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:17 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:18.130644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ffab9ef3-bc18-4bc8-bc27-eb1ce3666e65 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:18.141772 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ffab9ef3-bc18-4bc8-bc27-eb1ce3666e65 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.286551 Jul 14 15:40:18.143046 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 244/526] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:17 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:18.197624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-600992f3-1aa9-4f39-ab03-8dc53dd08bf2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:18.198391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-600992f3-1aa9-4f39-ab03-8dc53dd08bf2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:18.210917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b4b4e13b-f9a4-47c7-b721-c836f6964de8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:18.211582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b4b4e13b-f9a4-47c7-b721-c836f6964de8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:18.213531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:18.218755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-600992f3-1aa9-4f39-ab03-8dc53dd08bf2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:18.220283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-600992f3-1aa9-4f39-ab03-8dc53dd08bf2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:18.221574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-600992f3-1aa9-4f39-ab03-8dc53dd08bf2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:18.221574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-600992f3-1aa9-4f39-ab03-8dc53dd08bf2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:18.233151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4b4e13b-f9a4-47c7-b721-c836f6964de8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:18.233628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4b4e13b-f9a4-47c7-b721-c836f6964de8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:18.235571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4b4e13b-f9a4-47c7-b721-c836f6964de8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:18.235571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4b4e13b-f9a4-47c7-b721-c836f6964de8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:18.271909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:18.397741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-600992f3-1aa9-4f39-ab03-8dc53dd08bf2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:18.414292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-600992f3-1aa9-4f39-ab03-8dc53dd08bf2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1210 microversion: 2.1 time: 0.220695 Jul 14 15:40:18.424625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 283/527] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:18 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1210 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:18.540151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b4b4e13b-f9a4-47c7-b721-c836f6964de8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:18.570922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b4b4e13b-f9a4-47c7-b721-c836f6964de8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.363802 Jul 14 15:40:18.571911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 245/528] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:18 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:18.912397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2b648a00-2312-4e35-976d-3f1987d40530 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:18.913689 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2b648a00-2312-4e35-976d-3f1987d40530 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:18.927219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2b648a00-2312-4e35-976d-3f1987d40530 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:18.927219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2b648a00-2312-4e35-976d-3f1987d40530 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:18.927219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2b648a00-2312-4e35-976d-3f1987d40530 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:18.928084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2b648a00-2312-4e35-976d-3f1987d40530 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:19.161568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-97ebe560-7610-4e0a-b174-42872cfbf825 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:19.163100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-97ebe560-7610-4e0a-b174-42872cfbf825 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:19.258016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97ebe560-7610-4e0a-b174-42872cfbf825 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:19.258851 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97ebe560-7610-4e0a-b174-42872cfbf825 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:19.259908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97ebe560-7610-4e0a-b174-42872cfbf825 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:19.260572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97ebe560-7610-4e0a-b174-42872cfbf825 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:19.568258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2b648a00-2312-4e35-976d-3f1987d40530 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:19.588663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2b648a00-2312-4e35-976d-3f1987d40530 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:19.595017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2b648a00-2312-4e35-976d-3f1987d40530 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:19.600960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2b648a00-2312-4e35-976d-3f1987d40530 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.698647 Jul 14 15:40:19.602691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 284/529] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:18 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 701 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:19.609377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:19.614194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-009f0785-09d1-48d7-9881-10a665b5f7ba tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:19.614825 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-009f0785-09d1-48d7-9881-10a665b5f7ba tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:19.630594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=6 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:19.637970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-009f0785-09d1-48d7-9881-10a665b5f7ba tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:19.640105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-009f0785-09d1-48d7-9881-10a665b5f7ba tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:19.640948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-009f0785-09d1-48d7-9881-10a665b5f7ba tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:19.645896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-009f0785-09d1-48d7-9881-10a665b5f7ba tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:19.760600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-97ebe560-7610-4e0a-b174-42872cfbf825 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:19.769464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-009f0785-09d1-48d7-9881-10a665b5f7ba tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:19.803850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-009f0785-09d1-48d7-9881-10a665b5f7ba tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1210 microversion: 2.1 time: 0.199689 Jul 14 15:40:19.804655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-97ebe560-7610-4e0a-b174-42872cfbf825 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.646463 Jul 14 15:40:19.805890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 285/530] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:19 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1210 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:19.817154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 246/531] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:19 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 662 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:19.822424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-967d2ee3-e629-455a-bc51-0211cc646dc4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:19.823338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-967d2ee3-e629-455a-bc51-0211cc646dc4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:19.837086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-967d2ee3-e629-455a-bc51-0211cc646dc4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:19.838026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-967d2ee3-e629-455a-bc51-0211cc646dc4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:19.839343 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-967d2ee3-e629-455a-bc51-0211cc646dc4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:19.842307 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-967d2ee3-e629-455a-bc51-0211cc646dc4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:19.901278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:20.044044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-967d2ee3-e629-455a-bc51-0211cc646dc4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:20.060901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-967d2ee3-e629-455a-bc51-0211cc646dc4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.241835 Jul 14 15:40:20.062264 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 286/532] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:19 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:20.621660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a87ab871-c39d-4fd1-b600-dc86464bdeff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:20.622571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a87ab871-c39d-4fd1-b600-dc86464bdeff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:20.640095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a87ab871-c39d-4fd1-b600-dc86464bdeff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:20.640609 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a87ab871-c39d-4fd1-b600-dc86464bdeff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:20.641520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a87ab871-c39d-4fd1-b600-dc86464bdeff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:20.641971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a87ab871-c39d-4fd1-b600-dc86464bdeff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:20.826336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-edab8146-02ff-4e90-b1c4-e2837e529063 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:20.827286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-edab8146-02ff-4e90-b1c4-e2837e529063 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:20.852002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-edab8146-02ff-4e90-b1c4-e2837e529063 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:20.852851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-edab8146-02ff-4e90-b1c4-e2837e529063 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:20.853953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-edab8146-02ff-4e90-b1c4-e2837e529063 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:20.854615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-edab8146-02ff-4e90-b1c4-e2837e529063 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:21.130605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-edab8146-02ff-4e90-b1c4-e2837e529063 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:21.161714 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-edab8146-02ff-4e90-b1c4-e2837e529063 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1275 microversion: 2.1 time: 0.342674 Jul 14 15:40:21.162826 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 287/533] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:20 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1275 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:21.169752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6a296d19-5fd3-457b-9bf1-8e64e6bb6b0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:21.171124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6a296d19-5fd3-457b-9bf1-8e64e6bb6b0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:21.185838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a296d19-5fd3-457b-9bf1-8e64e6bb6b0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:21.187325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a296d19-5fd3-457b-9bf1-8e64e6bb6b0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:21.188631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a296d19-5fd3-457b-9bf1-8e64e6bb6b0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:21.190065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a296d19-5fd3-457b-9bf1-8e64e6bb6b0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:21.369623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a87ab871-c39d-4fd1-b600-dc86464bdeff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:21.381988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a87ab871-c39d-4fd1-b600-dc86464bdeff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:21.384460 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a87ab871-c39d-4fd1-b600-dc86464bdeff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:21.391381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a87ab871-c39d-4fd1-b600-dc86464bdeff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.770610 Jul 14 15:40:21.392284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 247/534] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 775 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:21.407175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-a74272b4-2fff-46a2-9020-bd88955f51e8 req-d7f708eb-fe75-4d7a-9736-ffcfe727e5ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2213f73d-c833-4f74-b8f7-72e0699c30f9", "name": "network-vif-plugged", "status": "completed", "tag": "e9db016d-1273-4cca-b86b-04b2641d228a"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:21.427214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-a74272b4-2fff-46a2-9020-bd88955f51e8 req-d7f708eb-fe75-4d7a-9736-ffcfe727e5ce service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:21.427967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-a74272b4-2fff-46a2-9020-bd88955f51e8 req-d7f708eb-fe75-4d7a-9736-ffcfe727e5ce service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:21.495723 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-a74272b4-2fff-46a2-9020-bd88955f51e8 req-d7f708eb-fe75-4d7a-9736-ffcfe727e5ce service nova] Creating event network-vif-plugged:e9db016d-1273-4cca-b86b-04b2641d228a for instance 2213f73d-c833-4f74-b8f7-72e0699c30f9 on hv-cinder-82651 Jul 14 15:40:21.497928 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6a296d19-5fd3-457b-9bf1-8e64e6bb6b0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:21.511804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6a296d19-5fd3-457b-9bf1-8e64e6bb6b0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.347114 Jul 14 15:40:21.513217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 288/535] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:21 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:21.519571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e6e6f5e3-154e-4299-8ef3-f4b8b416a8c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:21.520616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e6e6f5e3-154e-4299-8ef3-f4b8b416a8c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:21.527072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-a74272b4-2fff-46a2-9020-bd88955f51e8 req-d7f708eb-fe75-4d7a-9736-ffcfe727e5ce service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119686 Jul 14 15:40:21.528076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 248/536] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:40:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:40:21.529511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6e6f5e3-154e-4299-8ef3-f4b8b416a8c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:21.531017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6e6f5e3-154e-4299-8ef3-f4b8b416a8c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:21.533496 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6e6f5e3-154e-4299-8ef3-f4b8b416a8c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:21.534266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6e6f5e3-154e-4299-8ef3-f4b8b416a8c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:21.833080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e6e6f5e3-154e-4299-8ef3-f4b8b416a8c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:21.849821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e6e6f5e3-154e-4299-8ef3-f4b8b416a8c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.335267 Jul 14 15:40:21.850788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 289/537] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:21 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:22.180167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-abd1d9c8-fd49-4da8-a3c1-63afd3c5abe5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:22.181642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-abd1d9c8-fd49-4da8-a3c1-63afd3c5abe5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:22.204493 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abd1d9c8-fd49-4da8-a3c1-63afd3c5abe5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:22.208479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abd1d9c8-fd49-4da8-a3c1-63afd3c5abe5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:22.211704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abd1d9c8-fd49-4da8-a3c1-63afd3c5abe5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:22.217278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abd1d9c8-fd49-4da8-a3c1-63afd3c5abe5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:22.411559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-82555e9f-a41d-48bd-83aa-4b77a4843a00 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:22.412900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-82555e9f-a41d-48bd-83aa-4b77a4843a00 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:22.428580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82555e9f-a41d-48bd-83aa-4b77a4843a00 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:22.430049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82555e9f-a41d-48bd-83aa-4b77a4843a00 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:22.431071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82555e9f-a41d-48bd-83aa-4b77a4843a00 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:22.432758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82555e9f-a41d-48bd-83aa-4b77a4843a00 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:22.724365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-82555e9f-a41d-48bd-83aa-4b77a4843a00 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:22.733898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-82555e9f-a41d-48bd-83aa-4b77a4843a00 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:22.741341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-82555e9f-a41d-48bd-83aa-4b77a4843a00 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:22.742649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-82555e9f-a41d-48bd-83aa-4b77a4843a00 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.335870 Jul 14 15:40:22.747196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 290/538] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:22 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 341 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:40:22.758118 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5e4f13e5-32eb-4f3a-a377-cfd258a2810f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:22.759093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5e4f13e5-32eb-4f3a-a377-cfd258a2810f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:22.781719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5e4f13e5-32eb-4f3a-a377-cfd258a2810f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:22.783209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5e4f13e5-32eb-4f3a-a377-cfd258a2810f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:22.784236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5e4f13e5-32eb-4f3a-a377-cfd258a2810f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:22.784860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5e4f13e5-32eb-4f3a-a377-cfd258a2810f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:22.868770 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-abd1d9c8-fd49-4da8-a3c1-63afd3c5abe5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:22.878441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-abd1d9c8-fd49-4da8-a3c1-63afd3c5abe5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.703277 Jul 14 15:40:22.896718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 249/539] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:22 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:22.910342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-11344c8a-d6dc-4b87-a2f4-99969301d348 req-09a148b0-d72d-4f23-9693-2469eae82a8e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea27265-d9b4-48a9-80e7-00f4be8ca323", "tag": "404d8f87-7e6c-41cf-b6ba-764dede489c9"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:22.935834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-11344c8a-d6dc-4b87-a2f4-99969301d348 req-09a148b0-d72d-4f23-9693-2469eae82a8e service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:22.940016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-11344c8a-d6dc-4b87-a2f4-99969301d348 req-09a148b0-d72d-4f23-9693-2469eae82a8e service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:23.014481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-11344c8a-d6dc-4b87-a2f4-99969301d348 req-09a148b0-d72d-4f23-9693-2469eae82a8e service nova] Creating event network-changed:404d8f87-7e6c-41cf-b6ba-764dede489c9 for instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 on hv-cinder-82651 Jul 14 15:40:23.020708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-11344c8a-d6dc-4b87-a2f4-99969301d348 req-09a148b0-d72d-4f23-9693-2469eae82a8e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.122434 Jul 14 15:40:23.022057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 250/540] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:40:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:40:23.029753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-62455252-80ce-4f70-83af-0956d459c203 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:23.041525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-62455252-80ce-4f70-83af-0956d459c203 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:23.061875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62455252-80ce-4f70-83af-0956d459c203 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:23.062479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62455252-80ce-4f70-83af-0956d459c203 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:23.063412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62455252-80ce-4f70-83af-0956d459c203 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:23.064550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62455252-80ce-4f70-83af-0956d459c203 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:23.129472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:23.134159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5e4f13e5-32eb-4f3a-a377-cfd258a2810f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:23.143264 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5e4f13e5-32eb-4f3a-a377-cfd258a2810f tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.394127 Jul 14 15:40:23.146743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 291/541] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:22 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:23.319185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-62455252-80ce-4f70-83af-0956d459c203 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:23.327812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-62455252-80ce-4f70-83af-0956d459c203 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.303945 Jul 14 15:40:23.329232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 251/542] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:23 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:23.766896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-aef26b81-abee-45e8-b9aa-797472f14ff7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:23.767526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-aef26b81-abee-45e8-b9aa-797472f14ff7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:23.777590 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aef26b81-abee-45e8-b9aa-797472f14ff7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:23.778078 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aef26b81-abee-45e8-b9aa-797472f14ff7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:23.778798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aef26b81-abee-45e8-b9aa-797472f14ff7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:23.780986 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aef26b81-abee-45e8-b9aa-797472f14ff7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:23.919066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fec9fc8f-c345-4ae1-8a5c-a85da8f13405 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:23.920328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fec9fc8f-c345-4ae1-8a5c-a85da8f13405 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:23.928173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fec9fc8f-c345-4ae1-8a5c-a85da8f13405 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:23.928941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fec9fc8f-c345-4ae1-8a5c-a85da8f13405 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:23.930426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fec9fc8f-c345-4ae1-8a5c-a85da8f13405 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:23.931914 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fec9fc8f-c345-4ae1-8a5c-a85da8f13405 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:24.131871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aef26b81-abee-45e8-b9aa-797472f14ff7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:24.162561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aef26b81-abee-45e8-b9aa-797472f14ff7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:24.166880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aef26b81-abee-45e8-b9aa-797472f14ff7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:24.172846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-aef26b81-abee-45e8-b9aa-797472f14ff7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.406815 Jul 14 15:40:24.187174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 292/543] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:23 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:24.199533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f7222a36-5748-4c82-83f8-75d30d589d84 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:24.204466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f7222a36-5748-4c82-83f8-75d30d589d84 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:24.260004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7222a36-5748-4c82-83f8-75d30d589d84 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:24.261688 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7222a36-5748-4c82-83f8-75d30d589d84 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:24.264325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7222a36-5748-4c82-83f8-75d30d589d84 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:24.267762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7222a36-5748-4c82-83f8-75d30d589d84 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:24.477665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fec9fc8f-c345-4ae1-8a5c-a85da8f13405 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:24.490289 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fec9fc8f-c345-4ae1-8a5c-a85da8f13405 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.578041 Jul 14 15:40:24.491419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 252/544] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:23 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 581 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:24.496822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f591ec3e-ac3b-446f-818a-d4d2605bee65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:24.497717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f591ec3e-ac3b-446f-818a-d4d2605bee65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:24.507543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f591ec3e-ac3b-446f-818a-d4d2605bee65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:24.508392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f591ec3e-ac3b-446f-818a-d4d2605bee65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:24.509879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f591ec3e-ac3b-446f-818a-d4d2605bee65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:24.510559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f591ec3e-ac3b-446f-818a-d4d2605bee65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:24.617730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f7222a36-5748-4c82-83f8-75d30d589d84 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:24.638799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f7222a36-5748-4c82-83f8-75d30d589d84 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.458378 Jul 14 15:40:24.638799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 293/545] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:24 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:24.842463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f591ec3e-ac3b-446f-818a-d4d2605bee65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:24.858643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f591ec3e-ac3b-446f-818a-d4d2605bee65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.365454 Jul 14 15:40:24.859680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 253/546] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:24 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:25.194659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-01c8ae70-2133-4e33-82e3-81040382465d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:25.195323 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-01c8ae70-2133-4e33-82e3-81040382465d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:25.202287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01c8ae70-2133-4e33-82e3-81040382465d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:25.202735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01c8ae70-2133-4e33-82e3-81040382465d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:25.203688 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01c8ae70-2133-4e33-82e3-81040382465d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:25.216683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01c8ae70-2133-4e33-82e3-81040382465d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:25.449769 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-01c8ae70-2133-4e33-82e3-81040382465d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:25.459459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-01c8ae70-2133-4e33-82e3-81040382465d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:25.461230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-01c8ae70-2133-4e33-82e3-81040382465d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:25.462620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-01c8ae70-2133-4e33-82e3-81040382465d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.271904 Jul 14 15:40:25.474578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 294/547] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:25 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:25.514126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1da74aea-b7f1-4766-8d4f-17c1f2b12c7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:25.514730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1da74aea-b7f1-4766-8d4f-17c1f2b12c7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:25.522736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1da74aea-b7f1-4766-8d4f-17c1f2b12c7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:25.523438 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1da74aea-b7f1-4766-8d4f-17c1f2b12c7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:25.524241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1da74aea-b7f1-4766-8d4f-17c1f2b12c7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:25.524849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1da74aea-b7f1-4766-8d4f-17c1f2b12c7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:25.666095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-aee15371-192d-4fc1-8831-7ef2ce067ed4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:25.667098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-aee15371-192d-4fc1-8831-7ef2ce067ed4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:25.674012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:25.676044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aee15371-192d-4fc1-8831-7ef2ce067ed4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:25.676921 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aee15371-192d-4fc1-8831-7ef2ce067ed4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:25.678122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aee15371-192d-4fc1-8831-7ef2ce067ed4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:25.678679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aee15371-192d-4fc1-8831-7ef2ce067ed4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:25.695172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1da74aea-b7f1-4766-8d4f-17c1f2b12c7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:25.706517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1da74aea-b7f1-4766-8d4f-17c1f2b12c7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.196257 Jul 14 15:40:25.707790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 254/548] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:25 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:25.877369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7ea6fb07-3b06-4559-a231-06b084fd4478 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:25.877919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7ea6fb07-3b06-4559-a231-06b084fd4478 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:25.887224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aee15371-192d-4fc1-8831-7ef2ce067ed4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:25.892629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7ea6fb07-3b06-4559-a231-06b084fd4478 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:25.893093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7ea6fb07-3b06-4559-a231-06b084fd4478 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:25.893880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7ea6fb07-3b06-4559-a231-06b084fd4478 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:25.894332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7ea6fb07-3b06-4559-a231-06b084fd4478 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:25.897690 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-aee15371-192d-4fc1-8831-7ef2ce067ed4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.235397 Jul 14 15:40:25.913510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 295/549] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:25 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:26.124864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7ea6fb07-3b06-4559-a231-06b084fd4478 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:26.146193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7ea6fb07-3b06-4559-a231-06b084fd4478 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.272390 Jul 14 15:40:26.157378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 255/550] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:25 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:26.481496 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fdcf415a-ff16-4d2f-bbd5-cf81dc47b46d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:26.482735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fdcf415a-ff16-4d2f-bbd5-cf81dc47b46d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:26.489934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdcf415a-ff16-4d2f-bbd5-cf81dc47b46d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:26.490645 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdcf415a-ff16-4d2f-bbd5-cf81dc47b46d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:26.491654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdcf415a-ff16-4d2f-bbd5-cf81dc47b46d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:26.492264 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdcf415a-ff16-4d2f-bbd5-cf81dc47b46d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:26.686437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fdcf415a-ff16-4d2f-bbd5-cf81dc47b46d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:26.700304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fdcf415a-ff16-4d2f-bbd5-cf81dc47b46d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:26.702956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fdcf415a-ff16-4d2f-bbd5-cf81dc47b46d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:26.705054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fdcf415a-ff16-4d2f-bbd5-cf81dc47b46d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.227465 Jul 14 15:40:26.706306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 296/551] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:26 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:26.724847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-48d4075e-f713-4674-9bb0-dd93fca246a9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:26.725474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-48d4075e-f713-4674-9bb0-dd93fca246a9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:26.732352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48d4075e-f713-4674-9bb0-dd93fca246a9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:26.732807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48d4075e-f713-4674-9bb0-dd93fca246a9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:26.733628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48d4075e-f713-4674-9bb0-dd93fca246a9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:26.734069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48d4075e-f713-4674-9bb0-dd93fca246a9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:26.897944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-48d4075e-f713-4674-9bb0-dd93fca246a9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:26.906935 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-48d4075e-f713-4674-9bb0-dd93fca246a9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.187051 Jul 14 15:40:26.908222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 256/552] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:26 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:26.916028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9b30f5a7-dcc3-4aac-9f3d-851e81d82879 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:26.916798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9b30f5a7-dcc3-4aac-9f3d-851e81d82879 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:26.924129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b30f5a7-dcc3-4aac-9f3d-851e81d82879 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:26.925431 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b30f5a7-dcc3-4aac-9f3d-851e81d82879 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:26.926504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b30f5a7-dcc3-4aac-9f3d-851e81d82879 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:26.926955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b30f5a7-dcc3-4aac-9f3d-851e81d82879 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:27.073989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9b30f5a7-dcc3-4aac-9f3d-851e81d82879 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:27.082102 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9b30f5a7-dcc3-4aac-9f3d-851e81d82879 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.170094 Jul 14 15:40:27.083099 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 297/553] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:26 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:27.163774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b0ace6eb-88de-4ac0-b2b7-c9c080f7ff9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:27.164391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b0ace6eb-88de-4ac0-b2b7-c9c080f7ff9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:27.170693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0ace6eb-88de-4ac0-b2b7-c9c080f7ff9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:27.171152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0ace6eb-88de-4ac0-b2b7-c9c080f7ff9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:27.171946 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0ace6eb-88de-4ac0-b2b7-c9c080f7ff9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:27.173051 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0ace6eb-88de-4ac0-b2b7-c9c080f7ff9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:27.322457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0ace6eb-88de-4ac0-b2b7-c9c080f7ff9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:27.335432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b0ace6eb-88de-4ac0-b2b7-c9c080f7ff9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.175502 Jul 14 15:40:27.336292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 257/554] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:27 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:27.724254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6ca150d0-911e-4152-adfd-86402098f9f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:27.725034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6ca150d0-911e-4152-adfd-86402098f9f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:27.734608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ca150d0-911e-4152-adfd-86402098f9f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:27.736287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ca150d0-911e-4152-adfd-86402098f9f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:27.739583 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ca150d0-911e-4152-adfd-86402098f9f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:27.740673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ca150d0-911e-4152-adfd-86402098f9f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:27.908174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6ca150d0-911e-4152-adfd-86402098f9f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:27.918080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6ca150d0-911e-4152-adfd-86402098f9f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:27.920375 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6ca150d0-911e-4152-adfd-86402098f9f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:27.923235 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6ca150d0-911e-4152-adfd-86402098f9f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.203251 Jul 14 15:40:27.925120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b70a091a-3908-4d16-94d2-8c0cfed5635b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:27.927097 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b70a091a-3908-4d16-94d2-8c0cfed5635b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:27.934389 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b70a091a-3908-4d16-94d2-8c0cfed5635b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:27.935085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b70a091a-3908-4d16-94d2-8c0cfed5635b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:27.935987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 298/555] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:27.936480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b70a091a-3908-4d16-94d2-8c0cfed5635b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:27.937110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b70a091a-3908-4d16-94d2-8c0cfed5635b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:28.093369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b70a091a-3908-4d16-94d2-8c0cfed5635b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:28.106467 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7869b015-0ef0-4a5e-b53b-add449b2486b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:28.107343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b70a091a-3908-4d16-94d2-8c0cfed5635b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.186471 Jul 14 15:40:28.119376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7869b015-0ef0-4a5e-b53b-add449b2486b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:28.125041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 258/556] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:27 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:28.135520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7869b015-0ef0-4a5e-b53b-add449b2486b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:28.136305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7869b015-0ef0-4a5e-b53b-add449b2486b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:28.138359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7869b015-0ef0-4a5e-b53b-add449b2486b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:28.138934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7869b015-0ef0-4a5e-b53b-add449b2486b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:28.301199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7869b015-0ef0-4a5e-b53b-add449b2486b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:28.304920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:28.309867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7869b015-0ef0-4a5e-b53b-add449b2486b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.210831 Jul 14 15:40:28.310441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 299/557] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:28 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:28.356568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2eef78f4-834e-43fe-95f3-d92266a57de5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:28.357483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2eef78f4-834e-43fe-95f3-d92266a57de5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:28.364065 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2eef78f4-834e-43fe-95f3-d92266a57de5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:28.364790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2eef78f4-834e-43fe-95f3-d92266a57de5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:28.365744 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2eef78f4-834e-43fe-95f3-d92266a57de5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:28.366446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2eef78f4-834e-43fe-95f3-d92266a57de5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:28.527902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2eef78f4-834e-43fe-95f3-d92266a57de5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:28.541041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2eef78f4-834e-43fe-95f3-d92266a57de5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.188426 Jul 14 15:40:28.541645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 259/558] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:28 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:28.945966 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9f4631da-254c-4429-b1e4-014232a9ef13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:28.947009 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9f4631da-254c-4429-b1e4-014232a9ef13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:28.956658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f4631da-254c-4429-b1e4-014232a9ef13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:28.957567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f4631da-254c-4429-b1e4-014232a9ef13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:28.958784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f4631da-254c-4429-b1e4-014232a9ef13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:28.959455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f4631da-254c-4429-b1e4-014232a9ef13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:29.142410 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f57ef760-ee10-4378-8697-ef31e8fb3df8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:29.144533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f57ef760-ee10-4378-8697-ef31e8fb3df8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:29.155621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f57ef760-ee10-4378-8697-ef31e8fb3df8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:29.156417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f57ef760-ee10-4378-8697-ef31e8fb3df8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:29.157841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f57ef760-ee10-4378-8697-ef31e8fb3df8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:29.158830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f57ef760-ee10-4378-8697-ef31e8fb3df8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:29.171940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9f4631da-254c-4429-b1e4-014232a9ef13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:29.184683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9f4631da-254c-4429-b1e4-014232a9ef13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:29.186528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9f4631da-254c-4429-b1e4-014232a9ef13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:29.189339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9f4631da-254c-4429-b1e4-014232a9ef13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.248447 Jul 14 15:40:29.190126 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 300/559] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:28 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:29.326335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f57ef760-ee10-4378-8697-ef31e8fb3df8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:29.331477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b2f16647-4267-4324-a279-e6e2f0530c2d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:29.332459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b2f16647-4267-4324-a279-e6e2f0530c2d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:29.336864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f57ef760-ee10-4378-8697-ef31e8fb3df8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.202882 Jul 14 15:40:29.346225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b2f16647-4267-4324-a279-e6e2f0530c2d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:29.346617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 260/560] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:29 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:29.346755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b2f16647-4267-4324-a279-e6e2f0530c2d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:29.348368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b2f16647-4267-4324-a279-e6e2f0530c2d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:29.349136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b2f16647-4267-4324-a279-e6e2f0530c2d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:29.538449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b2f16647-4267-4324-a279-e6e2f0530c2d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:29.547213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b2f16647-4267-4324-a279-e6e2f0530c2d tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.224263 Jul 14 15:40:29.548505 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 301/561] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:29 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:29.562471 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4ff9d8f0-f9b0-4e29-8202-c634e2c17b6a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:29.564393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4ff9d8f0-f9b0-4e29-8202-c634e2c17b6a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:29.572928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ff9d8f0-f9b0-4e29-8202-c634e2c17b6a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:29.573997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ff9d8f0-f9b0-4e29-8202-c634e2c17b6a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:29.575135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ff9d8f0-f9b0-4e29-8202-c634e2c17b6a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:29.575876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ff9d8f0-f9b0-4e29-8202-c634e2c17b6a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:29.720497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4ff9d8f0-f9b0-4e29-8202-c634e2c17b6a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:29.732684 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4ff9d8f0-f9b0-4e29-8202-c634e2c17b6a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.174176 Jul 14 15:40:29.733818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 261/562] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:29 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:30.208658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c9f57db4-2938-4b92-8f86-247748aab589 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:30.209935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c9f57db4-2938-4b92-8f86-247748aab589 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:30.217481 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c9f57db4-2938-4b92-8f86-247748aab589 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:30.218202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c9f57db4-2938-4b92-8f86-247748aab589 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:30.219773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c9f57db4-2938-4b92-8f86-247748aab589 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:30.220222 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c9f57db4-2938-4b92-8f86-247748aab589 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:30.353937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bccd4e41-15cd-4c82-adc0-f00945fcd288 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:30.354637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bccd4e41-15cd-4c82-adc0-f00945fcd288 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:30.361866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bccd4e41-15cd-4c82-adc0-f00945fcd288 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:30.362652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bccd4e41-15cd-4c82-adc0-f00945fcd288 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:30.363420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bccd4e41-15cd-4c82-adc0-f00945fcd288 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:30.363882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bccd4e41-15cd-4c82-adc0-f00945fcd288 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:30.378041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c9f57db4-2938-4b92-8f86-247748aab589 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:30.388120 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c9f57db4-2938-4b92-8f86-247748aab589 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:30.390392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c9f57db4-2938-4b92-8f86-247748aab589 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:30.392587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c9f57db4-2938-4b92-8f86-247748aab589 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.187450 Jul 14 15:40:30.399643 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 302/563] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:30 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:30.512880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bccd4e41-15cd-4c82-adc0-f00945fcd288 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:30.524316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bccd4e41-15cd-4c82-adc0-f00945fcd288 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.174170 Jul 14 15:40:30.525173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 262/564] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:30 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:30.569041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-227f2fb1-cb82-4a04-ae3c-da46124bfb50 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:30.570419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-227f2fb1-cb82-4a04-ae3c-da46124bfb50 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:30.588040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-227f2fb1-cb82-4a04-ae3c-da46124bfb50 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:30.588500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-227f2fb1-cb82-4a04-ae3c-da46124bfb50 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:30.589283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-227f2fb1-cb82-4a04-ae3c-da46124bfb50 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:30.589729 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-227f2fb1-cb82-4a04-ae3c-da46124bfb50 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:30.749110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3abc5ef4-23c9-45f0-bec9-d20ae2514b06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:30.749746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-227f2fb1-cb82-4a04-ae3c-da46124bfb50 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:30.754090 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3abc5ef4-23c9-45f0-bec9-d20ae2514b06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:30.758376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-227f2fb1-cb82-4a04-ae3c-da46124bfb50 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.196396 Jul 14 15:40:30.768084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 303/565] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:30 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:30.771659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3abc5ef4-23c9-45f0-bec9-d20ae2514b06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:30.772390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3abc5ef4-23c9-45f0-bec9-d20ae2514b06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:30.773832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3abc5ef4-23c9-45f0-bec9-d20ae2514b06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:30.774601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3abc5ef4-23c9-45f0-bec9-d20ae2514b06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:30.948095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3abc5ef4-23c9-45f0-bec9-d20ae2514b06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:30.961387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3abc5ef4-23c9-45f0-bec9-d20ae2514b06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.215884 Jul 14 15:40:30.963887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 263/566] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:30 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:31.411235 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-96011842-9591-4fe4-96a7-72437b1a0e6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:31.412681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-96011842-9591-4fe4-96a7-72437b1a0e6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:31.419554 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96011842-9591-4fe4-96a7-72437b1a0e6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:31.420252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96011842-9591-4fe4-96a7-72437b1a0e6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:31.420963 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96011842-9591-4fe4-96a7-72437b1a0e6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:31.421488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96011842-9591-4fe4-96a7-72437b1a0e6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:31.541916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4f699bab-fd69-4dcc-8b2c-6b02a79a8dc9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:31.542471 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4f699bab-fd69-4dcc-8b2c-6b02a79a8dc9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:31.550112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f699bab-fd69-4dcc-8b2c-6b02a79a8dc9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:31.550791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f699bab-fd69-4dcc-8b2c-6b02a79a8dc9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:31.551761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f699bab-fd69-4dcc-8b2c-6b02a79a8dc9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:31.552630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f699bab-fd69-4dcc-8b2c-6b02a79a8dc9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:31.569944 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-96011842-9591-4fe4-96a7-72437b1a0e6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:31.580937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-96011842-9591-4fe4-96a7-72437b1a0e6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:31.584490 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-96011842-9591-4fe4-96a7-72437b1a0e6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:31.587129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-96011842-9591-4fe4-96a7-72437b1a0e6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.180651 Jul 14 15:40:31.601398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 304/567] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:31 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:31.717110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4f699bab-fd69-4dcc-8b2c-6b02a79a8dc9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:31.725957 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4f699bab-fd69-4dcc-8b2c-6b02a79a8dc9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.187928 Jul 14 15:40:31.736034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 264/568] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:31 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:31.783588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2a408a6a-4352-40e3-84ac-1d393d8b3c1a tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:31.784653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2a408a6a-4352-40e3-84ac-1d393d8b3c1a tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:31.795687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a408a6a-4352-40e3-84ac-1d393d8b3c1a tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:31.796472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a408a6a-4352-40e3-84ac-1d393d8b3c1a tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:31.798440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a408a6a-4352-40e3-84ac-1d393d8b3c1a tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:31.799136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a408a6a-4352-40e3-84ac-1d393d8b3c1a tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:31.967930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2a408a6a-4352-40e3-84ac-1d393d8b3c1a tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:31.981354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-29b74cd2-e967-4818-8d5e-ccb2a3f0bddd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:31.982141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-29b74cd2-e967-4818-8d5e-ccb2a3f0bddd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:32.001755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2a408a6a-4352-40e3-84ac-1d393d8b3c1a tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.217583 Jul 14 15:40:32.004967 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 305/569] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:31 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:32.013977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29b74cd2-e967-4818-8d5e-ccb2a3f0bddd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:32.014533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29b74cd2-e967-4818-8d5e-ccb2a3f0bddd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:32.015345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29b74cd2-e967-4818-8d5e-ccb2a3f0bddd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:32.016622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29b74cd2-e967-4818-8d5e-ccb2a3f0bddd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:32.175350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-29b74cd2-e967-4818-8d5e-ccb2a3f0bddd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:32.183922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-29b74cd2-e967-4818-8d5e-ccb2a3f0bddd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.208119 Jul 14 15:40:32.184523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 265/570] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:31 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:32.608357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-40224a49-6941-45ba-80c0-cf3ccd0cba9a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:32.608971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-40224a49-6941-45ba-80c0-cf3ccd0cba9a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:32.616500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40224a49-6941-45ba-80c0-cf3ccd0cba9a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:32.616949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40224a49-6941-45ba-80c0-cf3ccd0cba9a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:32.617717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40224a49-6941-45ba-80c0-cf3ccd0cba9a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:32.618153 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40224a49-6941-45ba-80c0-cf3ccd0cba9a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:32.742512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d44d3fc0-f3b8-469e-a2b3-498d536bb39a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:32.743177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d44d3fc0-f3b8-469e-a2b3-498d536bb39a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:32.753401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d44d3fc0-f3b8-469e-a2b3-498d536bb39a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:32.753967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d44d3fc0-f3b8-469e-a2b3-498d536bb39a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:32.754809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d44d3fc0-f3b8-469e-a2b3-498d536bb39a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:32.763423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d44d3fc0-f3b8-469e-a2b3-498d536bb39a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:32.810046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-40224a49-6941-45ba-80c0-cf3ccd0cba9a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:32.819717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-40224a49-6941-45ba-80c0-cf3ccd0cba9a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:32.821525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-40224a49-6941-45ba-80c0-cf3ccd0cba9a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:32.822827 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-40224a49-6941-45ba-80c0-cf3ccd0cba9a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.218363 Jul 14 15:40:32.830106 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 306/571] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:32.857854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-f729cbb7-2db5-4a95-973e-975c9903638a req-24b35eef-8e80-4ca8-ae56-ed6ce281d4cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c8cb95-bde5-4c91-99de-27aa44a822bf", "name": "network-vif-unplugged", "status": "completed", "tag": "daed7bb6-45ad-49c9-829a-e0e2a0eca7f9"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:32.883651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-f729cbb7-2db5-4a95-973e-975c9903638a req-24b35eef-8e80-4ca8-ae56-ed6ce281d4cc service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:32.884119 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-f729cbb7-2db5-4a95-973e-975c9903638a req-24b35eef-8e80-4ca8-ae56-ed6ce281d4cc service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:32.904086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-f729cbb7-2db5-4a95-973e-975c9903638a req-24b35eef-8e80-4ca8-ae56-ed6ce281d4cc service nova] Creating event network-vif-unplugged:daed7bb6-45ad-49c9-829a-e0e2a0eca7f9 for instance e5c8cb95-bde5-4c91-99de-27aa44a822bf on hv-cinder-82651 Jul 14 15:40:32.913439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-f729cbb7-2db5-4a95-973e-975c9903638a req-24b35eef-8e80-4ca8-ae56-ed6ce281d4cc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.061976 Jul 14 15:40:32.914281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 307/572] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:40:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:40:32.966811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d44d3fc0-f3b8-469e-a2b3-498d536bb39a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:32.977875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d44d3fc0-f3b8-469e-a2b3-498d536bb39a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.238915 Jul 14 15:40:32.979204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 266/573] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:32 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:33.023159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fab8317a-f81a-4048-84f4-b821d6ea8f75 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:33.024549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fab8317a-f81a-4048-84f4-b821d6ea8f75 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:33.034507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fab8317a-f81a-4048-84f4-b821d6ea8f75 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:33.035065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fab8317a-f81a-4048-84f4-b821d6ea8f75 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:33.036728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fab8317a-f81a-4048-84f4-b821d6ea8f75 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:33.037084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fab8317a-f81a-4048-84f4-b821d6ea8f75 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:33.188816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fab8317a-f81a-4048-84f4-b821d6ea8f75 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:33.197549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fab8317a-f81a-4048-84f4-b821d6ea8f75 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.179498 Jul 14 15:40:33.198055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 308/574] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:33 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:33.201574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dbda94f6-4f5a-45ad-a5e0-e3d46e9aa9a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:33.202222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dbda94f6-4f5a-45ad-a5e0-e3d46e9aa9a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:33.209817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dbda94f6-4f5a-45ad-a5e0-e3d46e9aa9a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:33.210262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dbda94f6-4f5a-45ad-a5e0-e3d46e9aa9a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:33.211035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dbda94f6-4f5a-45ad-a5e0-e3d46e9aa9a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:33.211465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dbda94f6-4f5a-45ad-a5e0-e3d46e9aa9a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:33.352832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dbda94f6-4f5a-45ad-a5e0-e3d46e9aa9a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:33.355028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:33.362788 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dbda94f6-4f5a-45ad-a5e0-e3d46e9aa9a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.165539 Jul 14 15:40:33.363370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 267/575] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:33 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:33.842713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-df423f41-2f62-40a6-8c43-b234a8c2ea14 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:33.843329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-df423f41-2f62-40a6-8c43-b234a8c2ea14 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:33.850388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-df423f41-2f62-40a6-8c43-b234a8c2ea14 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:33.850901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-df423f41-2f62-40a6-8c43-b234a8c2ea14 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:33.851689 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-df423f41-2f62-40a6-8c43-b234a8c2ea14 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:33.852130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-df423f41-2f62-40a6-8c43-b234a8c2ea14 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:33.997092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0fde57e2-7387-4070-a1b9-393e8616e100 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:33.997092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0fde57e2-7387-4070-a1b9-393e8616e100 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:33.997644 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-df423f41-2f62-40a6-8c43-b234a8c2ea14 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:34.004026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0fde57e2-7387-4070-a1b9-393e8616e100 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:34.004484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0fde57e2-7387-4070-a1b9-393e8616e100 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:34.005249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0fde57e2-7387-4070-a1b9-393e8616e100 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:34.005511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-df423f41-2f62-40a6-8c43-b234a8c2ea14 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:34.005686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0fde57e2-7387-4070-a1b9-393e8616e100 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:34.007057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-df423f41-2f62-40a6-8c43-b234a8c2ea14 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:34.008280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-df423f41-2f62-40a6-8c43-b234a8c2ea14 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1738 microversion: 2.20 time: 0.170411 Jul 14 15:40:34.008837 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 309/576] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:33 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1738 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:34.138296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0fde57e2-7387-4070-a1b9-393e8616e100 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:34.146691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0fde57e2-7387-4070-a1b9-393e8616e100 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.155061 Jul 14 15:40:34.147261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 268/577] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:33 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:34.216527 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f69d06da-efb2-4019-9db6-005e2e8ecb91 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:34.216951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f69d06da-efb2-4019-9db6-005e2e8ecb91 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:34.223643 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f69d06da-efb2-4019-9db6-005e2e8ecb91 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:34.224100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f69d06da-efb2-4019-9db6-005e2e8ecb91 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:34.224864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f69d06da-efb2-4019-9db6-005e2e8ecb91 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:34.225301 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f69d06da-efb2-4019-9db6-005e2e8ecb91 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:34.371305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f69d06da-efb2-4019-9db6-005e2e8ecb91 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:34.380136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f69d06da-efb2-4019-9db6-005e2e8ecb91 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1314 microversion: 2.1 time: 0.167617 Jul 14 15:40:34.380657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0ac81981-794f-42af-91fd-45f0ea4caa18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:34.380829 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 310/578] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:34 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:34.381277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0ac81981-794f-42af-91fd-45f0ea4caa18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:34.387396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ac81981-794f-42af-91fd-45f0ea4caa18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:34.387888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ac81981-794f-42af-91fd-45f0ea4caa18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:34.388657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ac81981-794f-42af-91fd-45f0ea4caa18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:34.389101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0ac81981-794f-42af-91fd-45f0ea4caa18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:34.519417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0ac81981-794f-42af-91fd-45f0ea4caa18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:34.528189 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0ac81981-794f-42af-91fd-45f0ea4caa18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1722 microversion: 2.1 time: 0.151542 Jul 14 15:40:34.528783 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 269/579] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:34 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:35.027781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4db107d1-d539-4523-8ebd-d52ff2e8a570 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:35.028473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4db107d1-d539-4523-8ebd-d52ff2e8a570 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:35.036273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4db107d1-d539-4523-8ebd-d52ff2e8a570 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:35.036731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4db107d1-d539-4523-8ebd-d52ff2e8a570 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:35.037507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4db107d1-d539-4523-8ebd-d52ff2e8a570 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:35.037952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4db107d1-d539-4523-8ebd-d52ff2e8a570 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:35.164359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9db2c888-2028-4552-9317-92e968ef5684 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:35.165161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9db2c888-2028-4552-9317-92e968ef5684 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:35.173548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9db2c888-2028-4552-9317-92e968ef5684 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:35.174068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9db2c888-2028-4552-9317-92e968ef5684 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:35.174630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4db107d1-d539-4523-8ebd-d52ff2e8a570 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:35.174962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9db2c888-2028-4552-9317-92e968ef5684 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:35.175388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9db2c888-2028-4552-9317-92e968ef5684 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:35.182497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4db107d1-d539-4523-8ebd-d52ff2e8a570 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:35.184031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4db107d1-d539-4523-8ebd-d52ff2e8a570 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:35.185176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4db107d1-d539-4523-8ebd-d52ff2e8a570 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1720 microversion: 2.20 time: 0.161667 Jul 14 15:40:35.185731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 311/580] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:35 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1720 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:35.315195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9db2c888-2028-4552-9317-92e968ef5684 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:35.323335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9db2c888-2028-4552-9317-92e968ef5684 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.163256 Jul 14 15:40:35.324250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 270/581] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:35 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:35.397772 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-745903c1-2efc-45f4-9a69-ecb5f15f90f3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:35.398791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-745903c1-2efc-45f4-9a69-ecb5f15f90f3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:35.405073 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-745903c1-2efc-45f4-9a69-ecb5f15f90f3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:35.405418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-745903c1-2efc-45f4-9a69-ecb5f15f90f3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:35.406206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-745903c1-2efc-45f4-9a69-ecb5f15f90f3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:35.407423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-745903c1-2efc-45f4-9a69-ecb5f15f90f3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:35.545320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-618912da-bb75-4ec4-8f6b-563823360a25 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:35.545968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-618912da-bb75-4ec4-8f6b-563823360a25 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:35.546091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-745903c1-2efc-45f4-9a69-ecb5f15f90f3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:35.553696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-618912da-bb75-4ec4-8f6b-563823360a25 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:35.554069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-745903c1-2efc-45f4-9a69-ecb5f15f90f3 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1463 microversion: 2.1 time: 0.159998 Jul 14 15:40:35.554295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-618912da-bb75-4ec4-8f6b-563823360a25 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:35.566195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 312/582] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:35 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1463 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:35.566384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-618912da-bb75-4ec4-8f6b-563823360a25 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:35.566384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-618912da-bb75-4ec4-8f6b-563823360a25 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:35.596367 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-44b397fa-3798-4fd0-bbd0-cc7af644f142 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:35.596873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-44b397fa-3798-4fd0-bbd0-cc7af644f142 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:35.603761 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-44b397fa-3798-4fd0-bbd0-cc7af644f142 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:35.604293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-44b397fa-3798-4fd0-bbd0-cc7af644f142 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:35.605137 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-44b397fa-3798-4fd0-bbd0-cc7af644f142 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:35.605970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-44b397fa-3798-4fd0-bbd0-cc7af644f142 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:35.637926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-44b397fa-3798-4fd0-bbd0-cc7af644f142 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:40:35.725441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-44b397fa-3798-4fd0-bbd0-cc7af644f142 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "DELETE /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 204 len: 0 microversion: 2.1 time: 0.133044 Jul 14 15:40:35.726041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 313/583] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 15:40:35 2022] DELETE /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:40:35.745239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f1258daf-bbf1-42ff-b50e-0ec8639ef2c0 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:35.745239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f1258daf-bbf1-42ff-b50e-0ec8639ef2c0 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:35.745239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1258daf-bbf1-42ff-b50e-0ec8639ef2c0 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:35.745239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1258daf-bbf1-42ff-b50e-0ec8639ef2c0 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:35.745986 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1258daf-bbf1-42ff-b50e-0ec8639ef2c0 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:35.746509 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1258daf-bbf1-42ff-b50e-0ec8639ef2c0 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:35.970990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f1258daf-bbf1-42ff-b50e-0ec8639ef2c0 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:35.979196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f1258daf-bbf1-42ff-b50e-0ec8639ef2c0 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1469 microversion: 2.1 time: 0.248426 Jul 14 15:40:35.979813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 314/584] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:35 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1469 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:36.008542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-618912da-bb75-4ec4-8f6b-563823360a25 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:36.018576 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-618912da-bb75-4ec4-8f6b-563823360a25 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1699 microversion: 2.1 time: 0.477174 Jul 14 15:40:36.019539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 271/585] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:35 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1699 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:36.040168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fe53d7b1-5963-44d3-9c9c-7118c8c97d62 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:36.048271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe53d7b1-5963-44d3-9c9c-7118c8c97d62 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:36.048739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe53d7b1-5963-44d3-9c9c-7118c8c97d62 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:36.063795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:36.075719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fe53d7b1-5963-44d3-9c9c-7118c8c97d62 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Going to try to start instance {{(pid=124502) start /opt/stack/nova/nova/compute/api.py:2730}} Jul 14 15:40:36.124051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fe53d7b1-5963-44d3-9c9c-7118c8c97d62 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "POST /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/action" status: 202 len: 0 microversion: 2.1 time: 0.090010 Jul 14 15:40:36.125591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 315/586] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 15:40:36 2022] POST /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:40:36.134272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-01e96df7-12e7-41e9-9535-2702b5b7ab26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:36.134974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-01e96df7-12e7-41e9-9535-2702b5b7ab26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:36.142108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-01e96df7-12e7-41e9-9535-2702b5b7ab26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:36.142563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-01e96df7-12e7-41e9-9535-2702b5b7ab26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:36.143329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-01e96df7-12e7-41e9-9535-2702b5b7ab26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:36.144138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-01e96df7-12e7-41e9-9535-2702b5b7ab26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:36.205926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c1299441-8488-40d0-bb29-9b6b176bba84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:36.206853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c1299441-8488-40d0-bb29-9b6b176bba84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:36.213498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1299441-8488-40d0-bb29-9b6b176bba84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:36.213959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1299441-8488-40d0-bb29-9b6b176bba84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:36.214816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1299441-8488-40d0-bb29-9b6b176bba84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:36.215346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1299441-8488-40d0-bb29-9b6b176bba84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:36.286628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-01e96df7-12e7-41e9-9535-2702b5b7ab26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:36.294666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-01e96df7-12e7-41e9-9535-2702b5b7ab26 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1708 microversion: 2.1 time: 0.164346 Jul 14 15:40:36.295242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 272/587] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:36 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1708 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:36.342234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ee58ba4d-4c54-4ed2-9882-e363ee88a2c1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:36.342847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ee58ba4d-4c54-4ed2-9882-e363ee88a2c1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:36.349867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee58ba4d-4c54-4ed2-9882-e363ee88a2c1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:36.350319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee58ba4d-4c54-4ed2-9882-e363ee88a2c1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:36.351175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee58ba4d-4c54-4ed2-9882-e363ee88a2c1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:36.351930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee58ba4d-4c54-4ed2-9882-e363ee88a2c1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:36.353560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c1299441-8488-40d0-bb29-9b6b176bba84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:36.361989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c1299441-8488-40d0-bb29-9b6b176bba84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:36.363472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c1299441-8488-40d0-bb29-9b6b176bba84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:36.364824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c1299441-8488-40d0-bb29-9b6b176bba84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1720 microversion: 2.20 time: 0.164583 Jul 14 15:40:36.365385 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 316/588] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:36 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1720 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:36.489963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ee58ba4d-4c54-4ed2-9882-e363ee88a2c1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:36.497536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ee58ba4d-4c54-4ed2-9882-e363ee88a2c1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.159207 Jul 14 15:40:36.498101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 273/589] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:36 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:37.001899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-66ab562e-4f6f-425f-9ebb-a5eaf8cacb3e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:37.002541 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-66ab562e-4f6f-425f-9ebb-a5eaf8cacb3e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:37.008759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66ab562e-4f6f-425f-9ebb-a5eaf8cacb3e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:37.009209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66ab562e-4f6f-425f-9ebb-a5eaf8cacb3e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:37.010017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66ab562e-4f6f-425f-9ebb-a5eaf8cacb3e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:37.010484 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66ab562e-4f6f-425f-9ebb-a5eaf8cacb3e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:37.106594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-db98b82b-ae86-48d7-9d41-3eb56f3dc054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:37.107092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-db98b82b-ae86-48d7-9d41-3eb56f3dc054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:37.113662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db98b82b-ae86-48d7-9d41-3eb56f3dc054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:37.114113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db98b82b-ae86-48d7-9d41-3eb56f3dc054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:37.114883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db98b82b-ae86-48d7-9d41-3eb56f3dc054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:37.115313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db98b82b-ae86-48d7-9d41-3eb56f3dc054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:37.247022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-db98b82b-ae86-48d7-9d41-3eb56f3dc054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lazy-loading 'services' on Instance uuid eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:40:37.363553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-db98b82b-ae86-48d7-9d41-3eb56f3dc054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "DELETE /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7/os-volume_attachments/5aeb8c58-b548-4b0b-960e-c2b5564d5ff7" status: 202 len: 0 microversion: 2.1 time: 0.260779 Jul 14 15:40:37.367555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 274/590] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:40:37 2022] DELETE /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7/os-volume_attachments/5aeb8c58-b548-4b0b-960e-c2b5564d5ff7 => generated 0 bytes in 265 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 15:40:37.378433 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0d8153f3-98e0-4f7b-9b18-6d929a8961ce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:37.378719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0d8153f3-98e0-4f7b-9b18-6d929a8961ce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:37.387242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d8153f3-98e0-4f7b-9b18-6d929a8961ce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:37.387779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d8153f3-98e0-4f7b-9b18-6d929a8961ce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:37.388646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d8153f3-98e0-4f7b-9b18-6d929a8961ce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:37.389151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d8153f3-98e0-4f7b-9b18-6d929a8961ce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:37.468142 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-66ab562e-4f6f-425f-9ebb-a5eaf8cacb3e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:37.478311 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-66ab562e-4f6f-425f-9ebb-a5eaf8cacb3e tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1469 microversion: 2.1 time: 0.483706 Jul 14 15:40:37.478850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 317/591] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:36 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1469 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:37.491321 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3bb2cb65-f0f1-4c45-849b-5302090ccc69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:37.492090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3bb2cb65-f0f1-4c45-849b-5302090ccc69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:37.498313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bb2cb65-f0f1-4c45-849b-5302090ccc69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:37.498763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bb2cb65-f0f1-4c45-849b-5302090ccc69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:37.499533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bb2cb65-f0f1-4c45-849b-5302090ccc69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:37.500004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bb2cb65-f0f1-4c45-849b-5302090ccc69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:37.539070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0d8153f3-98e0-4f7b-9b18-6d929a8961ce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:37.547233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0d8153f3-98e0-4f7b-9b18-6d929a8961ce tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1708 microversion: 2.1 time: 0.178479 Jul 14 15:40:37.548338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 275/592] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:37 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1708 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:37.552950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7d18b3da-64c2-4aef-b9ce-ad4da7168652 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:37.553634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7d18b3da-64c2-4aef-b9ce-ad4da7168652 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:37.559334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d18b3da-64c2-4aef-b9ce-ad4da7168652 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:37.559816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d18b3da-64c2-4aef-b9ce-ad4da7168652 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:37.560563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d18b3da-64c2-4aef-b9ce-ad4da7168652 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:37.560991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d18b3da-64c2-4aef-b9ce-ad4da7168652 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:37.706409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7d18b3da-64c2-4aef-b9ce-ad4da7168652 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:37.713859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7d18b3da-64c2-4aef-b9ce-ad4da7168652 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.164571 Jul 14 15:40:37.714429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 276/593] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:37 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:37.800620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3bb2cb65-f0f1-4c45-849b-5302090ccc69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:37.809203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3bb2cb65-f0f1-4c45-849b-5302090ccc69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:37.810351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3bb2cb65-f0f1-4c45-849b-5302090ccc69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:37.811418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3bb2cb65-f0f1-4c45-849b-5302090ccc69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1720 microversion: 2.20 time: 0.331415 Jul 14 15:40:37.812169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 318/594] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:37 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1720 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:38.496899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e614f684-5d69-4971-af46-7bd513db3c0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:38.497533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e614f684-5d69-4971-af46-7bd513db3c0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:38.504610 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e614f684-5d69-4971-af46-7bd513db3c0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:38.505063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e614f684-5d69-4971-af46-7bd513db3c0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:38.505952 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e614f684-5d69-4971-af46-7bd513db3c0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:38.506340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e614f684-5d69-4971-af46-7bd513db3c0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:38.565689 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-430688ce-9a5a-4808-b768-8f68e94ccd8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:38.567530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-430688ce-9a5a-4808-b768-8f68e94ccd8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:38.582699 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-430688ce-9a5a-4808-b768-8f68e94ccd8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:38.583342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-430688ce-9a5a-4808-b768-8f68e94ccd8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:38.584516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-430688ce-9a5a-4808-b768-8f68e94ccd8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:38.585119 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-430688ce-9a5a-4808-b768-8f68e94ccd8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:38.757228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-430688ce-9a5a-4808-b768-8f68e94ccd8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:38.765929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-430688ce-9a5a-4808-b768-8f68e94ccd8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1708 microversion: 2.1 time: 0.204703 Jul 14 15:40:38.766512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 319/595] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:38 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1708 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:38.774192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-da8430a3-cc4e-4ab7-aa82-7a2bb5caccfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:38.775207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-da8430a3-cc4e-4ab7-aa82-7a2bb5caccfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:38.781976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-da8430a3-cc4e-4ab7-aa82-7a2bb5caccfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:38.789284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-da8430a3-cc4e-4ab7-aa82-7a2bb5caccfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:38.789692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e614f684-5d69-4971-af46-7bd513db3c0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:38.790955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-da8430a3-cc4e-4ab7-aa82-7a2bb5caccfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:38.798305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e614f684-5d69-4971-af46-7bd513db3c0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1469 microversion: 2.1 time: 0.304733 Jul 14 15:40:38.799229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 277/596] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:38 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1469 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:38.805048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-da8430a3-cc4e-4ab7-aa82-7a2bb5caccfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:38.829761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f34cdda2-1b94-4ada-a8fe-38f243ea11ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:38.830813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f34cdda2-1b94-4ada-a8fe-38f243ea11ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:38.840637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f34cdda2-1b94-4ada-a8fe-38f243ea11ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:38.841102 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f34cdda2-1b94-4ada-a8fe-38f243ea11ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:38.841875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f34cdda2-1b94-4ada-a8fe-38f243ea11ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:38.842311 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f34cdda2-1b94-4ada-a8fe-38f243ea11ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:38.958121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-da8430a3-cc4e-4ab7-aa82-7a2bb5caccfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:38.966757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-da8430a3-cc4e-4ab7-aa82-7a2bb5caccfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.198346 Jul 14 15:40:38.967644 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 320/597] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:38 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:38.993424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f34cdda2-1b94-4ada-a8fe-38f243ea11ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:39.005987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f34cdda2-1b94-4ada-a8fe-38f243ea11ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:39.007527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f34cdda2-1b94-4ada-a8fe-38f243ea11ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:39.008764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f34cdda2-1b94-4ada-a8fe-38f243ea11ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1720 microversion: 2.20 time: 0.183125 Jul 14 15:40:39.009538 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 278/598] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1720 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:40:39.783908 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7408c25b-194e-4544-8064-aef15f0ce24e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:39.784525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7408c25b-194e-4544-8064-aef15f0ce24e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:39.791632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7408c25b-194e-4544-8064-aef15f0ce24e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:39.792115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7408c25b-194e-4544-8064-aef15f0ce24e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:39.793090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7408c25b-194e-4544-8064-aef15f0ce24e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:39.793536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7408c25b-194e-4544-8064-aef15f0ce24e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:39.816208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d957a25f-857d-40eb-baa9-61a424295723 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:39.820706 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d957a25f-857d-40eb-baa9-61a424295723 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:39.835406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d957a25f-857d-40eb-baa9-61a424295723 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:39.840006 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d957a25f-857d-40eb-baa9-61a424295723 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:39.841214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d957a25f-857d-40eb-baa9-61a424295723 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:39.841760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d957a25f-857d-40eb-baa9-61a424295723 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:40.187807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7408c25b-194e-4544-8064-aef15f0ce24e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:40.205553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7408c25b-194e-4544-8064-aef15f0ce24e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1708 microversion: 2.1 time: 0.425706 Jul 14 15:40:40.206535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 321/599] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:39 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1708 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:40.211863 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0ceeb483-63f0-48b3-a510-e3eba1d0eac5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:40.216253 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0ceeb483-63f0-48b3-a510-e3eba1d0eac5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:40.229187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0ceeb483-63f0-48b3-a510-e3eba1d0eac5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:40.229641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0ceeb483-63f0-48b3-a510-e3eba1d0eac5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:40.230424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0ceeb483-63f0-48b3-a510-e3eba1d0eac5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:40.231322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0ceeb483-63f0-48b3-a510-e3eba1d0eac5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:40.284296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d957a25f-857d-40eb-baa9-61a424295723 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:40.301027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d957a25f-857d-40eb-baa9-61a424295723 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1469 microversion: 2.1 time: 0.489156 Jul 14 15:40:40.302623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 279/600] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:39 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1469 bytes in 491 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:40.315918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b0c17a0f-5410-4453-97c1-156975840bc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:40.317223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b0c17a0f-5410-4453-97c1-156975840bc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:40.327566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0c17a0f-5410-4453-97c1-156975840bc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:40.332283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0c17a0f-5410-4453-97c1-156975840bc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:40.333654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0c17a0f-5410-4453-97c1-156975840bc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:40.334292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0c17a0f-5410-4453-97c1-156975840bc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:40.514210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0ceeb483-63f0-48b3-a510-e3eba1d0eac5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:40.529016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0ceeb483-63f0-48b3-a510-e3eba1d0eac5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.321088 Jul 14 15:40:40.541398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 322/601] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:40 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:40.651024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a42a2706-5eda-41db-9114-80d8abd3e1a6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:40.651987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a42a2706-5eda-41db-9114-80d8abd3e1a6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:40.663337 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a42a2706-5eda-41db-9114-80d8abd3e1a6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:40.664097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a42a2706-5eda-41db-9114-80d8abd3e1a6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:40.665221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a42a2706-5eda-41db-9114-80d8abd3e1a6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:40.666347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a42a2706-5eda-41db-9114-80d8abd3e1a6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:40.718672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a42a2706-5eda-41db-9114-80d8abd3e1a6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:40:40.839225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0c17a0f-5410-4453-97c1-156975840bc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:40.845655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a42a2706-5eda-41db-9114-80d8abd3e1a6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "DELETE /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 204 len: 0 microversion: 2.1 time: 0.197504 Jul 14 15:40:40.850173 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 323/602] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 15:40:40 2022] DELETE /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:40:40.854201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0c17a0f-5410-4453-97c1-156975840bc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:40.856613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0c17a0f-5410-4453-97c1-156975840bc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:40.857835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b0c17a0f-5410-4453-97c1-156975840bc3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1720 microversion: 2.20 time: 0.554058 Jul 14 15:40:40.858286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-548a63f4-dc68-49af-a901-151ccf9c5f69 req-9445a940-35cd-4ecd-a7eb-770d3ff054f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2213f73d-c833-4f74-b8f7-72e0699c30f9", "name": "network-vif-deleted", "tag": "e9db016d-1273-4cca-b86b-04b2641d228a"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:40.858667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 280/603] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:40 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1720 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:40.868609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-548a63f4-dc68-49af-a901-151ccf9c5f69 req-9445a940-35cd-4ecd-a7eb-770d3ff054f2 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:40.869365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-548a63f4-dc68-49af-a901-151ccf9c5f69 req-9445a940-35cd-4ecd-a7eb-770d3ff054f2 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:40.877126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-177c99f6-8863-4dff-8c4d-b4abeb418054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:40.880422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-177c99f6-8863-4dff-8c4d-b4abeb418054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:40.883657 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-548a63f4-dc68-49af-a901-151ccf9c5f69 req-9445a940-35cd-4ecd-a7eb-770d3ff054f2 service nova] Creating event network-vif-deleted:e9db016d-1273-4cca-b86b-04b2641d228a for instance 2213f73d-c833-4f74-b8f7-72e0699c30f9 on hv-cinder-82651 Jul 14 15:40:40.888311 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-177c99f6-8863-4dff-8c4d-b4abeb418054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:40.888937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-177c99f6-8863-4dff-8c4d-b4abeb418054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:40.889077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-548a63f4-dc68-49af-a901-151ccf9c5f69 req-9445a940-35cd-4ecd-a7eb-770d3ff054f2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036038 Jul 14 15:40:40.890265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 324/604] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:40:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:40:40.893150 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-177c99f6-8863-4dff-8c4d-b4abeb418054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:40.893373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-177c99f6-8863-4dff-8c4d-b4abeb418054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:41.133917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-177c99f6-8863-4dff-8c4d-b4abeb418054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:41.142143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-177c99f6-8863-4dff-8c4d-b4abeb418054 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1559 microversion: 2.1 time: 0.282247 Jul 14 15:40:41.142724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 281/605] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:40 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1559 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:41.224017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2220be96-afec-4c52-bd7c-430639837b71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:41.225437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2220be96-afec-4c52-bd7c-430639837b71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:41.231793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2220be96-afec-4c52-bd7c-430639837b71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:41.232329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2220be96-afec-4c52-bd7c-430639837b71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:41.233112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2220be96-afec-4c52-bd7c-430639837b71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:41.233557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2220be96-afec-4c52-bd7c-430639837b71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:41.320132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2c62060c-e9c7-4c55-9769-8de7a7fb83a4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:41.320753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2c62060c-e9c7-4c55-9769-8de7a7fb83a4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:41.331947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2c62060c-e9c7-4c55-9769-8de7a7fb83a4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:41.332423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2c62060c-e9c7-4c55-9769-8de7a7fb83a4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:41.333202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2c62060c-e9c7-4c55-9769-8de7a7fb83a4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:41.333641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2c62060c-e9c7-4c55-9769-8de7a7fb83a4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:41.394458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2220be96-afec-4c52-bd7c-430639837b71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:41.404564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2220be96-afec-4c52-bd7c-430639837b71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1708 microversion: 2.1 time: 0.185874 Jul 14 15:40:41.405430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 325/606] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:41 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1708 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:41.457010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2c62060c-e9c7-4c55-9769-8de7a7fb83a4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:41.474950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2c62060c-e9c7-4c55-9769-8de7a7fb83a4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1427 microversion: 2.1 time: 0.160359 Jul 14 15:40:41.475975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 282/607] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:41 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1427 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:41.549683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c938f918-7cf1-4738-ac93-a4923126d8d6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:41.550991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c938f918-7cf1-4738-ac93-a4923126d8d6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:41.558461 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c938f918-7cf1-4738-ac93-a4923126d8d6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:41.559240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c938f918-7cf1-4738-ac93-a4923126d8d6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:41.560582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c938f918-7cf1-4738-ac93-a4923126d8d6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:41.561279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c938f918-7cf1-4738-ac93-a4923126d8d6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:41.727574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c938f918-7cf1-4738-ac93-a4923126d8d6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:41.737347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c938f918-7cf1-4738-ac93-a4923126d8d6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.191726 Jul 14 15:40:41.737943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 326/608] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:41 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:41.877118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e82bbd4a-b46b-4ebf-8461-3ca2b10097ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:41.877737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e82bbd4a-b46b-4ebf-8461-3ca2b10097ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:41.886387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e82bbd4a-b46b-4ebf-8461-3ca2b10097ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:41.887181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e82bbd4a-b46b-4ebf-8461-3ca2b10097ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:41.889606 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e82bbd4a-b46b-4ebf-8461-3ca2b10097ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:41.890619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e82bbd4a-b46b-4ebf-8461-3ca2b10097ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:42.118682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e82bbd4a-b46b-4ebf-8461-3ca2b10097ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:42.121124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:42.130414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e82bbd4a-b46b-4ebf-8461-3ca2b10097ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:42.132281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e82bbd4a-b46b-4ebf-8461-3ca2b10097ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:42.133757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e82bbd4a-b46b-4ebf-8461-3ca2b10097ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1720 microversion: 2.20 time: 0.261455 Jul 14 15:40:42.134555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 283/609] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:41 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1720 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:40:42.163363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-121b0544-086e-461c-8405-abee6d812d98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:42.164755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-121b0544-086e-461c-8405-abee6d812d98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:42.172407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-121b0544-086e-461c-8405-abee6d812d98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:42.173561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-121b0544-086e-461c-8405-abee6d812d98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:42.174417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-121b0544-086e-461c-8405-abee6d812d98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:42.175093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-121b0544-086e-461c-8405-abee6d812d98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:42.324884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-121b0544-086e-461c-8405-abee6d812d98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:42.334355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-121b0544-086e-461c-8405-abee6d812d98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1559 microversion: 2.1 time: 0.177789 Jul 14 15:40:42.338866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 327/610] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:42 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1559 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:42.425411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-db80ca23-588c-4b56-a16e-9f22f67d86c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:42.426221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-db80ca23-588c-4b56-a16e-9f22f67d86c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:42.434701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db80ca23-588c-4b56-a16e-9f22f67d86c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:42.435205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db80ca23-588c-4b56-a16e-9f22f67d86c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:42.435970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db80ca23-588c-4b56-a16e-9f22f67d86c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:42.436407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db80ca23-588c-4b56-a16e-9f22f67d86c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:42.492285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-933b38be-b169-4313-be2c-04ba851ba3b7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:42.492937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-933b38be-b169-4313-be2c-04ba851ba3b7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:42.499803 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-933b38be-b169-4313-be2c-04ba851ba3b7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:42.500295 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-933b38be-b169-4313-be2c-04ba851ba3b7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:42.501655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-933b38be-b169-4313-be2c-04ba851ba3b7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:42.502109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-933b38be-b169-4313-be2c-04ba851ba3b7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:42.574783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-933b38be-b169-4313-be2c-04ba851ba3b7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:42.584432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-933b38be-b169-4313-be2c-04ba851ba3b7 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1427 microversion: 2.1 time: 0.095961 Jul 14 15:40:42.596592 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 328/611] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:42 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1427 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:42.676058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-db80ca23-588c-4b56-a16e-9f22f67d86c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:42.684722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-db80ca23-588c-4b56-a16e-9f22f67d86c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1708 microversion: 2.1 time: 0.265853 Jul 14 15:40:42.685422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 284/612] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:42 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1708 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:42.754537 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3b749e9f-3db2-4cfa-8ac6-fd29da2c132a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:42.755238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3b749e9f-3db2-4cfa-8ac6-fd29da2c132a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:42.762288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b749e9f-3db2-4cfa-8ac6-fd29da2c132a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:42.762920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b749e9f-3db2-4cfa-8ac6-fd29da2c132a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:42.763908 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b749e9f-3db2-4cfa-8ac6-fd29da2c132a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:42.764522 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b749e9f-3db2-4cfa-8ac6-fd29da2c132a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:42.909582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3b749e9f-3db2-4cfa-8ac6-fd29da2c132a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:42.918037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3b749e9f-3db2-4cfa-8ac6-fd29da2c132a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.167715 Jul 14 15:40:42.918704 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 329/613] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:42 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:43.153716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-72828860-dcd0-4b3a-b358-11c901b8e756 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:43.155012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-72828860-dcd0-4b3a-b358-11c901b8e756 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:43.162644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-72828860-dcd0-4b3a-b358-11c901b8e756 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:43.163757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-72828860-dcd0-4b3a-b358-11c901b8e756 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:43.164765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-72828860-dcd0-4b3a-b358-11c901b8e756 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:43.165208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-72828860-dcd0-4b3a-b358-11c901b8e756 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:43.352090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3028c665-2292-4997-92cf-95b0b346079b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:43.354208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3028c665-2292-4997-92cf-95b0b346079b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:43.361233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3028c665-2292-4997-92cf-95b0b346079b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:43.362039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3028c665-2292-4997-92cf-95b0b346079b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:43.363066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3028c665-2292-4997-92cf-95b0b346079b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:43.363574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3028c665-2292-4997-92cf-95b0b346079b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:43.390702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:43.445748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-72828860-dcd0-4b3a-b358-11c901b8e756 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:43.459332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-72828860-dcd0-4b3a-b358-11c901b8e756 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:43.461578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-72828860-dcd0-4b3a-b358-11c901b8e756 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:43.481799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-72828860-dcd0-4b3a-b358-11c901b8e756 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1720 microversion: 2.20 time: 0.332439 Jul 14 15:40:43.499924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 285/614] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:43 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1720 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:43.551135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3028c665-2292-4997-92cf-95b0b346079b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:43.559761 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3028c665-2292-4997-92cf-95b0b346079b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1513 microversion: 2.1 time: 0.211633 Jul 14 15:40:43.569937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 330/615] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:43 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1513 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:43.603035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-96e00746-3b35-47b2-b2b3-dcd438660183 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:43.603752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-96e00746-3b35-47b2-b2b3-dcd438660183 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:43.610883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96e00746-3b35-47b2-b2b3-dcd438660183 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:43.611329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96e00746-3b35-47b2-b2b3-dcd438660183 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:43.612152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96e00746-3b35-47b2-b2b3-dcd438660183 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:43.612622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96e00746-3b35-47b2-b2b3-dcd438660183 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:43.651005 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96e00746-3b35-47b2-b2b3-dcd438660183 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:43.651680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96e00746-3b35-47b2-b2b3-dcd438660183 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:43.652319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-96e00746-3b35-47b2-b2b3-dcd438660183 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lazy-loading 'fault' on Instance uuid 2213f73d-c833-4f74-b8f7-72e0699c30f9 {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:40:43.704368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8009741f-b849-4711-b587-717fddded3b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:43.705595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8009741f-b849-4711-b587-717fddded3b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:43.715301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-96e00746-3b35-47b2-b2b3-dcd438660183 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:43.720281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8009741f-b849-4711-b587-717fddded3b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:43.725501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-96e00746-3b35-47b2-b2b3-dcd438660183 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1304 microversion: 2.1 time: 0.126833 Jul 14 15:40:43.726357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8009741f-b849-4711-b587-717fddded3b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:43.727201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 286/616] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:43 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1304 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:43.728809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8009741f-b849-4711-b587-717fddded3b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:43.729447 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8009741f-b849-4711-b587-717fddded3b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:43.896135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8009741f-b849-4711-b587-717fddded3b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:43.906043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8009741f-b849-4711-b587-717fddded3b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1708 microversion: 2.1 time: 0.206456 Jul 14 15:40:43.906625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 331/617] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:43 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1708 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:43.935778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-15a7bb28-f592-4085-aa64-f5f12915811e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:43.936394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-15a7bb28-f592-4085-aa64-f5f12915811e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:43.943165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15a7bb28-f592-4085-aa64-f5f12915811e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:43.943857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15a7bb28-f592-4085-aa64-f5f12915811e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:43.944845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15a7bb28-f592-4085-aa64-f5f12915811e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:43.945424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15a7bb28-f592-4085-aa64-f5f12915811e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:44.198263 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-15a7bb28-f592-4085-aa64-f5f12915811e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:44.208161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-15a7bb28-f592-4085-aa64-f5f12915811e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.276266 Jul 14 15:40:44.208777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 287/618] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:43 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:44.507329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-68458b9f-1ab2-4770-a992-333dcc4e334d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:44.508145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-68458b9f-1ab2-4770-a992-333dcc4e334d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:44.514449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68458b9f-1ab2-4770-a992-333dcc4e334d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:44.515407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68458b9f-1ab2-4770-a992-333dcc4e334d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:44.516606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68458b9f-1ab2-4770-a992-333dcc4e334d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:44.517418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68458b9f-1ab2-4770-a992-333dcc4e334d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:44.577135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-10abdf53-0751-43dd-bc68-b1848f284a40 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:44.577932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-10abdf53-0751-43dd-bc68-b1848f284a40 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:44.585614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-10abdf53-0751-43dd-bc68-b1848f284a40 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:44.586181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-10abdf53-0751-43dd-bc68-b1848f284a40 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:44.587038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-10abdf53-0751-43dd-bc68-b1848f284a40 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:44.587547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-10abdf53-0751-43dd-bc68-b1848f284a40 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:44.710426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-68458b9f-1ab2-4770-a992-333dcc4e334d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:44.720968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-68458b9f-1ab2-4770-a992-333dcc4e334d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:44.724731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-68458b9f-1ab2-4770-a992-333dcc4e334d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:44.729747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-68458b9f-1ab2-4770-a992-333dcc4e334d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1720 microversion: 2.20 time: 0.225716 Jul 14 15:40:44.731641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 332/619] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1720 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:44.743260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-10abdf53-0751-43dd-bc68-b1848f284a40 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:44.744723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-33cde3ec-f2a5-43fc-bdec-3984ee519e0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:44.745334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-33cde3ec-f2a5-43fc-bdec-3984ee519e0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:44.752709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-10abdf53-0751-43dd-bc68-b1848f284a40 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1513 microversion: 2.1 time: 0.178510 Jul 14 15:40:44.754499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33cde3ec-f2a5-43fc-bdec-3984ee519e0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:44.754956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33cde3ec-f2a5-43fc-bdec-3984ee519e0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:44.755756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33cde3ec-f2a5-43fc-bdec-3984ee519e0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:44.756195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33cde3ec-f2a5-43fc-bdec-3984ee519e0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:44.761701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 288/620] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:44 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1513 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:44.794268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33cde3ec-f2a5-43fc-bdec-3984ee519e0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:44.795009 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33cde3ec-f2a5-43fc-bdec-3984ee519e0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:44.796309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-33cde3ec-f2a5-43fc-bdec-3984ee519e0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lazy-loading 'fault' on Instance uuid 2213f73d-c833-4f74-b8f7-72e0699c30f9 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:40:44.842857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-33cde3ec-f2a5-43fc-bdec-3984ee519e0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:44.851787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-33cde3ec-f2a5-43fc-bdec-3984ee519e0b tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1304 microversion: 2.1 time: 0.110751 Jul 14 15:40:44.852369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 333/621] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:44 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:44.923887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-804d0f21-dd25-4ee1-83cd-99004de9c300 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:44.924500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-804d0f21-dd25-4ee1-83cd-99004de9c300 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:44.930453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-804d0f21-dd25-4ee1-83cd-99004de9c300 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:44.930906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-804d0f21-dd25-4ee1-83cd-99004de9c300 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:44.931698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-804d0f21-dd25-4ee1-83cd-99004de9c300 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:44.932141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-804d0f21-dd25-4ee1-83cd-99004de9c300 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:45.073168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-804d0f21-dd25-4ee1-83cd-99004de9c300 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:45.083279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-804d0f21-dd25-4ee1-83cd-99004de9c300 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1708 microversion: 2.1 time: 0.163752 Jul 14 15:40:45.083989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 289/622] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:44 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1708 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:45.226045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-847a9a8c-1497-448a-8b3e-50ea6664114e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:45.226662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-847a9a8c-1497-448a-8b3e-50ea6664114e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:45.233979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-847a9a8c-1497-448a-8b3e-50ea6664114e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:45.234439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-847a9a8c-1497-448a-8b3e-50ea6664114e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:45.235783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-847a9a8c-1497-448a-8b3e-50ea6664114e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:45.236259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-847a9a8c-1497-448a-8b3e-50ea6664114e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:45.462404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-847a9a8c-1497-448a-8b3e-50ea6664114e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:45.472247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-847a9a8c-1497-448a-8b3e-50ea6664114e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.250010 Jul 14 15:40:45.472834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 334/623] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:45 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:45.749570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b0e3c0e3-6484-4d25-92c1-95e93a0ce815 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:45.751082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b0e3c0e3-6484-4d25-92c1-95e93a0ce815 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:45.758318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0e3c0e3-6484-4d25-92c1-95e93a0ce815 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:45.759069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0e3c0e3-6484-4d25-92c1-95e93a0ce815 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:45.760060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0e3c0e3-6484-4d25-92c1-95e93a0ce815 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:45.761463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0e3c0e3-6484-4d25-92c1-95e93a0ce815 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:45.772465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2fec6a2c-eda8-48ca-8520-7a3eb30490e7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:45.773145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2fec6a2c-eda8-48ca-8520-7a3eb30490e7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:45.783493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2fec6a2c-eda8-48ca-8520-7a3eb30490e7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:45.783947 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2fec6a2c-eda8-48ca-8520-7a3eb30490e7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:45.784732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2fec6a2c-eda8-48ca-8520-7a3eb30490e7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:45.795654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2fec6a2c-eda8-48ca-8520-7a3eb30490e7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:46.012448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2fec6a2c-eda8-48ca-8520-7a3eb30490e7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:46.020243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0e3c0e3-6484-4d25-92c1-95e93a0ce815 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:46.021760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2fec6a2c-eda8-48ca-8520-7a3eb30490e7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1513 microversion: 2.1 time: 0.255910 Jul 14 15:40:46.022858 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 335/624] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:45 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1513 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:46.029691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-283a0afa-80aa-46dc-97a8-ecb0a561a2c4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:46.030686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-283a0afa-80aa-46dc-97a8-ecb0a561a2c4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:46.032742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0e3c0e3-6484-4d25-92c1-95e93a0ce815 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:46.037615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0e3c0e3-6484-4d25-92c1-95e93a0ce815 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:46.038043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-283a0afa-80aa-46dc-97a8-ecb0a561a2c4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:46.038824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-283a0afa-80aa-46dc-97a8-ecb0a561a2c4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:46.040023 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-283a0afa-80aa-46dc-97a8-ecb0a561a2c4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:46.040139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b0e3c0e3-6484-4d25-92c1-95e93a0ce815 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1720 microversion: 2.20 time: 0.294554 Jul 14 15:40:46.051406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 290/625] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:45 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1720 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:40:46.052121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-283a0afa-80aa-46dc-97a8-ecb0a561a2c4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:46.089370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-283a0afa-80aa-46dc-97a8-ecb0a561a2c4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:46.090152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-283a0afa-80aa-46dc-97a8-ecb0a561a2c4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:46.090684 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-283a0afa-80aa-46dc-97a8-ecb0a561a2c4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lazy-loading 'fault' on Instance uuid 2213f73d-c833-4f74-b8f7-72e0699c30f9 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:40:46.108767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d6eb22e3-534b-48a5-9bad-153ef9ab09c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:46.109407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d6eb22e3-534b-48a5-9bad-153ef9ab09c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:46.129753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6eb22e3-534b-48a5-9bad-153ef9ab09c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:46.130208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6eb22e3-534b-48a5-9bad-153ef9ab09c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:46.131507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6eb22e3-534b-48a5-9bad-153ef9ab09c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:46.131984 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6eb22e3-534b-48a5-9bad-153ef9ab09c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:46.159660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-283a0afa-80aa-46dc-97a8-ecb0a561a2c4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:46.167631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-283a0afa-80aa-46dc-97a8-ecb0a561a2c4 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1304 microversion: 2.1 time: 0.142875 Jul 14 15:40:46.180187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 336/626] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:46 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1304 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:46.493362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b8dabd7a-3aca-49fb-843e-87f5092179b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:46.494370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b8dabd7a-3aca-49fb-843e-87f5092179b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:46.502285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:46.504628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8dabd7a-3aca-49fb-843e-87f5092179b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:46.505381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8dabd7a-3aca-49fb-843e-87f5092179b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:46.506637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8dabd7a-3aca-49fb-843e-87f5092179b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:46.507289 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8dabd7a-3aca-49fb-843e-87f5092179b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:46.529463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d6eb22e3-534b-48a5-9bad-153ef9ab09c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:46.543820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d6eb22e3-534b-48a5-9bad-153ef9ab09c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1708 microversion: 2.1 time: 0.445436 Jul 14 15:40:46.547029 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 291/627] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:46 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1708 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:46.850697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b8dabd7a-3aca-49fb-843e-87f5092179b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:46.866649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b8dabd7a-3aca-49fb-843e-87f5092179b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.380115 Jul 14 15:40:46.867433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 337/628] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:46 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:47.041165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-556d2a9f-3598-42c4-8341-10dabcca006e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:47.041955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-556d2a9f-3598-42c4-8341-10dabcca006e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:47.083426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0d7b3644-5100-4a59-9aa1-764210aa7b22 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:47.087492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0d7b3644-5100-4a59-9aa1-764210aa7b22 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:47.092674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-556d2a9f-3598-42c4-8341-10dabcca006e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:47.099182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-556d2a9f-3598-42c4-8341-10dabcca006e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:47.100491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-556d2a9f-3598-42c4-8341-10dabcca006e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:47.102033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-556d2a9f-3598-42c4-8341-10dabcca006e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:47.102974 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d7b3644-5100-4a59-9aa1-764210aa7b22 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:47.108016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d7b3644-5100-4a59-9aa1-764210aa7b22 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:47.108917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d7b3644-5100-4a59-9aa1-764210aa7b22 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:47.109433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d7b3644-5100-4a59-9aa1-764210aa7b22 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:47.380349 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0d7b3644-5100-4a59-9aa1-764210aa7b22 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:47.390593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0d7b3644-5100-4a59-9aa1-764210aa7b22 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:47.393854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0d7b3644-5100-4a59-9aa1-764210aa7b22 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:47.397772 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0d7b3644-5100-4a59-9aa1-764210aa7b22 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1723 microversion: 2.20 time: 0.339996 Jul 14 15:40:47.412236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 338/629] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:47 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1723 bytes in 355 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:40:47.419251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a65dfb4a-2497-4fdd-8149-1009f516a9f8 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:47.420157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a65dfb4a-2497-4fdd-8149-1009f516a9f8 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:47.433935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a65dfb4a-2497-4fdd-8149-1009f516a9f8 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:47.434398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a65dfb4a-2497-4fdd-8149-1009f516a9f8 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:47.437905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-556d2a9f-3598-42c4-8341-10dabcca006e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:47.443112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a65dfb4a-2497-4fdd-8149-1009f516a9f8 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:47.443803 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a65dfb4a-2497-4fdd-8149-1009f516a9f8 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:47.448564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-556d2a9f-3598-42c4-8341-10dabcca006e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1513 microversion: 2.1 time: 0.411910 Jul 14 15:40:47.449247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 292/630] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:47 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1513 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:47.464919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5b0f2ebc-4920-4116-93d6-da828aa7ee81 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d9ef1e62-5b7a-4c13-b6d3-7f1ca828085a"}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:47.473181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5b0f2ebc-4920-4116-93d6-da828aa7ee81 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:47.482081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5b0f2ebc-4920-4116-93d6-da828aa7ee81 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:47.486185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5b0f2ebc-4920-4116-93d6-da828aa7ee81 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:47.488789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5b0f2ebc-4920-4116-93d6-da828aa7ee81 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:47.492823 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5b0f2ebc-4920-4116-93d6-da828aa7ee81 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:47.515118 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a65dfb4a-2497-4fdd-8149-1009f516a9f8 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:47.517896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a65dfb4a-2497-4fdd-8149-1009f516a9f8 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:47.518390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-a65dfb4a-2497-4fdd-8149-1009f516a9f8 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lazy-loading 'fault' on Instance uuid 2213f73d-c833-4f74-b8f7-72e0699c30f9 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:40:47.579825 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a65dfb4a-2497-4fdd-8149-1009f516a9f8 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:47.592836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a65dfb4a-2497-4fdd-8149-1009f516a9f8 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1304 microversion: 2.1 time: 0.178725 Jul 14 15:40:47.593543 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 339/631] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:47 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1304 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:47.609448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bdf904b4-00b0-420c-94f4-c1f7936f52da tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:47.610676 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bdf904b4-00b0-420c-94f4-c1f7936f52da tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:47.626620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bdf904b4-00b0-420c-94f4-c1f7936f52da tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:47.627128 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bdf904b4-00b0-420c-94f4-c1f7936f52da tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:47.628212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bdf904b4-00b0-420c-94f4-c1f7936f52da tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:47.629273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bdf904b4-00b0-420c-94f4-c1f7936f52da tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:47.978833 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bdf904b4-00b0-420c-94f4-c1f7936f52da tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:47.996497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bdf904b4-00b0-420c-94f4-c1f7936f52da tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1708 microversion: 2.1 time: 0.400768 Jul 14 15:40:47.998288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 340/632] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:47 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1708 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:48.005594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4c53534f-202f-4d4f-b01f-f135af137771 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:48.006615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4c53534f-202f-4d4f-b01f-f135af137771 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:48.020885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4c53534f-202f-4d4f-b01f-f135af137771 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:48.021365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4c53534f-202f-4d4f-b01f-f135af137771 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:48.022179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4c53534f-202f-4d4f-b01f-f135af137771 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:48.025730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4c53534f-202f-4d4f-b01f-f135af137771 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:48.114070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5b0f2ebc-4920-4116-93d6-da828aa7ee81 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "POST /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.663416 Jul 14 15:40:48.115065 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 293/633] 10.222.0.99 () {62 vars in 1363 bytes} [Thu Jul 14 15:40:47 2022] POST /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 188 bytes in 665 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:40:48.277156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4c53534f-202f-4d4f-b01f-f135af137771 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:48.293208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4c53534f-202f-4d4f-b01f-f135af137771 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.293495 Jul 14 15:40:48.304164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 341/634] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:47 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:48.374534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-98f94f7d-bb21-475d-9683-4a75c5a6099e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:48.375108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-98f94f7d-bb21-475d-9683-4a75c5a6099e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:48.377424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:48.389703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-98f94f7d-bb21-475d-9683-4a75c5a6099e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:48.390534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-98f94f7d-bb21-475d-9683-4a75c5a6099e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:48.391880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-98f94f7d-bb21-475d-9683-4a75c5a6099e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:48.392590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-98f94f7d-bb21-475d-9683-4a75c5a6099e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:48.466479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fdb5ee75-e2e6-4c6a-af98-e2c3f087b839 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:48.467105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fdb5ee75-e2e6-4c6a-af98-e2c3f087b839 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:48.477773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdb5ee75-e2e6-4c6a-af98-e2c3f087b839 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:48.478148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdb5ee75-e2e6-4c6a-af98-e2c3f087b839 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:48.478934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdb5ee75-e2e6-4c6a-af98-e2c3f087b839 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:48.479368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdb5ee75-e2e6-4c6a-af98-e2c3f087b839 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:48.522353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-98f94f7d-bb21-475d-9683-4a75c5a6099e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "POST /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/action" status: 202 len: 0 microversion: 2.20 time: 0.156828 Jul 14 15:40:48.526697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 294/635] 10.222.0.99 () {62 vars in 1318 bytes} [Thu Jul 14 15:40:48 2022] POST /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/action => generated 0 bytes in 162 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:40:48.531691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-790fe67a-d03a-4229-a513-40a21c0b0a87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:48.533007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-790fe67a-d03a-4229-a513-40a21c0b0a87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:48.540865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-790fe67a-d03a-4229-a513-40a21c0b0a87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:48.541383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-790fe67a-d03a-4229-a513-40a21c0b0a87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:48.542168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-790fe67a-d03a-4229-a513-40a21c0b0a87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:48.542608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-790fe67a-d03a-4229-a513-40a21c0b0a87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:48.752152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fdb5ee75-e2e6-4c6a-af98-e2c3f087b839 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:48.760868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fdb5ee75-e2e6-4c6a-af98-e2c3f087b839 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1513 microversion: 2.1 time: 0.298353 Jul 14 15:40:48.767766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 342/636] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:48 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1513 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:48.772872 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0d52f4bb-bd88-4d45-b5a4-5688ac91b755 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:48.774124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0d52f4bb-bd88-4d45-b5a4-5688ac91b755 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:48.783131 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d52f4bb-bd88-4d45-b5a4-5688ac91b755 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:48.786433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d52f4bb-bd88-4d45-b5a4-5688ac91b755 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:48.787493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d52f4bb-bd88-4d45-b5a4-5688ac91b755 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:48.788154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d52f4bb-bd88-4d45-b5a4-5688ac91b755 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:48.825532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d52f4bb-bd88-4d45-b5a4-5688ac91b755 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:48.826143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d52f4bb-bd88-4d45-b5a4-5688ac91b755 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:48.826894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-0d52f4bb-bd88-4d45-b5a4-5688ac91b755 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lazy-loading 'fault' on Instance uuid 2213f73d-c833-4f74-b8f7-72e0699c30f9 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:40:48.862537 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-790fe67a-d03a-4229-a513-40a21c0b0a87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:48.872021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-790fe67a-d03a-4229-a513-40a21c0b0a87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:48.875765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-790fe67a-d03a-4229-a513-40a21c0b0a87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:48.877431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-790fe67a-d03a-4229-a513-40a21c0b0a87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1809 microversion: 2.20 time: 0.349463 Jul 14 15:40:48.878217 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 295/637] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:48 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1809 bytes in 351 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:48.896752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0d52f4bb-bd88-4d45-b5a4-5688ac91b755 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '4689786287394deb9ecafb9f2cdbca89', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '75292a36c8354a2dbd28428efb2e9df9', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:48.908010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0d52f4bb-bd88-4d45-b5a4-5688ac91b755 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 200 len: 1304 microversion: 2.1 time: 0.142507 Jul 14 15:40:48.909053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 343/638] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:48 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 1304 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:49.014453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fb2e31d6-3381-4476-9d86-9d11903b3f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:49.015178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fb2e31d6-3381-4476-9d86-9d11903b3f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:49.025632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb2e31d6-3381-4476-9d86-9d11903b3f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:49.026507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb2e31d6-3381-4476-9d86-9d11903b3f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:49.028720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb2e31d6-3381-4476-9d86-9d11903b3f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:49.030641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb2e31d6-3381-4476-9d86-9d11903b3f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:49.090264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:49.320879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3b4c9429-0aee-4687-a33a-4088fbff7eda tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:49.322431 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3b4c9429-0aee-4687-a33a-4088fbff7eda tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:49.337985 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b4c9429-0aee-4687-a33a-4088fbff7eda tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:49.340436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b4c9429-0aee-4687-a33a-4088fbff7eda tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:49.341814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b4c9429-0aee-4687-a33a-4088fbff7eda tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:49.344916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b4c9429-0aee-4687-a33a-4088fbff7eda tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:49.390636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fb2e31d6-3381-4476-9d86-9d11903b3f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:49.402514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fb2e31d6-3381-4476-9d86-9d11903b3f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1708 microversion: 2.1 time: 0.392106 Jul 14 15:40:49.403090 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 296/639] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:49 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1708 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:49.700921 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3b4c9429-0aee-4687-a33a-4088fbff7eda tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:49.721524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3b4c9429-0aee-4687-a33a-4088fbff7eda tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.402891 Jul 14 15:40:49.723024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 344/640] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:49 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 408 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:49.779346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-06abdda2-c480-4ef3-bca1-10178b17e073 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:49.779998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-06abdda2-c480-4ef3-bca1-10178b17e073 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:49.792852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06abdda2-c480-4ef3-bca1-10178b17e073 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:49.793393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06abdda2-c480-4ef3-bca1-10178b17e073 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:49.796302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06abdda2-c480-4ef3-bca1-10178b17e073 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:49.796869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06abdda2-c480-4ef3-bca1-10178b17e073 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:49.898160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-72fd124b-a95e-4e43-9d38-343d9b22854e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:49.899413 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-72fd124b-a95e-4e43-9d38-343d9b22854e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:49.906229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-72fd124b-a95e-4e43-9d38-343d9b22854e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:49.906676 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-72fd124b-a95e-4e43-9d38-343d9b22854e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:49.917563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-72fd124b-a95e-4e43-9d38-343d9b22854e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:49.918386 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-72fd124b-a95e-4e43-9d38-343d9b22854e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:49.946485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:40:50.211788 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-06abdda2-c480-4ef3-bca1-10178b17e073 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:50.219758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-06abdda2-c480-4ef3-bca1-10178b17e073 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1513 microversion: 2.1 time: 0.444712 Jul 14 15:40:50.229784 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 297/641] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:49 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1513 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:50.277941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9165ed1c-305a-4535-8053-8d201551c374 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:50.279921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9165ed1c-305a-4535-8053-8d201551c374 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] [instance: 2213f73d-c833-4f74-b8f7-72e0699c30f9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:50.286911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9165ed1c-305a-4535-8053-8d201551c374 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:50.300092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9165ed1c-305a-4535-8053-8d201551c374 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:50.301503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9165ed1c-305a-4535-8053-8d201551c374 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:50.304228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9165ed1c-305a-4535-8053-8d201551c374 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:50.323393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-9165ed1c-305a-4535-8053-8d201551c374 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] HTTP exception thrown: Instance 2213f73d-c833-4f74-b8f7-72e0699c30f9 could not be found. Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9165ed1c-305a-4535-8053-8d201551c374 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Request method failure captured: Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 HTTP/1.1 Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DjFVuQ3EWb2gPVzWo9b4QPdDYuw3Y0_J1I6t4ZzxZFBsVO_QlUeIPNmJaVz0Wf1yLak2uC7W68_yeDXJlWQQBQtM6uURQGtjyf-PXvsu-OGEkW5rVjguDODgkqdw3yW4U3pYDAOS8kxS7vQLuwY1AQEkZnzWeU1Miikx40dBdmSdU0 Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 75292a36c8354a2dbd28428efb2e9df9 Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-VolumesNegativeTest-1575504494 Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 15:40:50.326025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 15:40:50.327395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_75292a36c8354a2dbd28428efb2e9df9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/75292a36c8354a2dbd28428efb2e9df9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/75292a36c8354a2dbd28428efb2e9df9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/75292a36c8354a2dbd28428efb2e9df9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:40:50.327395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-VolumesNegativeTest-1575504494 Jul 14 15:40:50.327395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 75292a36c8354a2dbd28428efb2e9df9 Jul 14 15:40:50.327395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-VolumesNegativeTest-1575504494 Jul 14 15:40:50.327395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-VolumesNegativeTest-1575504494-project Jul 14 15:40:50.327395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 15:40:50.327395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 15:40:50.327395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 4689786287394deb9ecafb9f2cdbca89 Jul 14 15:40:50.327395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-VolumesNegativeTest-1575504494-project Jul 14 15:40:50.327395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 15:40:50.327395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance 2213f73d-c833-4f74-b8f7-72e0699c30f9 could not be found. Jul 14 15:40:50.327395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': '2213f73d-c833-4f74-b8f7-72e0699c30f9'} Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2213f73d-c833-4f74-b8f7-72e0699c30f9 could not be found. Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:40:50.328280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2213f73d-c833-4f74-b8f7-72e0699c30f9 could not be found. Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2213f73d-c833-4f74-b8f7-72e0699c30f9 could not be found. Jul 14 15:40:50.330081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:40:50.331396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9165ed1c-305a-4535-8053-8d201551c374 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] Returning 404 to user: Instance 2213f73d-c833-4f74-b8f7-72e0699c30f9 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:40:50.331396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9165ed1c-305a-4535-8053-8d201551c374 tempest-VolumesNegativeTest-1575504494 tempest-VolumesNegativeTest-1575504494-project] 10.222.0.99 "GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9" status: 404 len: 111 microversion: 2.1 time: 0.074877 Jul 14 15:40:50.331396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 298/642] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:50 2022] GET /compute/v2.1/servers/2213f73d-c833-4f74-b8f7-72e0699c30f9 => generated 111 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 15:40:50.420010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2a9bb682-808d-450a-8dcb-c49a3bb2eb71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:50.421310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2a9bb682-808d-450a-8dcb-c49a3bb2eb71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:50.433169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a9bb682-808d-450a-8dcb-c49a3bb2eb71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:50.434036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a9bb682-808d-450a-8dcb-c49a3bb2eb71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:50.435290 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a9bb682-808d-450a-8dcb-c49a3bb2eb71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:50.442436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a9bb682-808d-450a-8dcb-c49a3bb2eb71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:50.710883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-72fd124b-a95e-4e43-9d38-343d9b22854e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:50.720365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-72fd124b-a95e-4e43-9d38-343d9b22854e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:50.725339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-72fd124b-a95e-4e43-9d38-343d9b22854e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:50.731015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-72fd124b-a95e-4e43-9d38-343d9b22854e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1749 microversion: 2.20 time: 0.836767 Jul 14 15:40:50.731804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 345/643] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:49 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1749 bytes in 839 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:50.748147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-f8ab46cf-bb68-40f4-a819-665b997a2260 req-5b4718c1-202e-4f2e-ab3f-d0fd2672d65b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7", "name": "network-vif-deleted", "tag": "cd5d78dd-d14b-4a46-802a-66a92af42839"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:50.757471 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-f8ab46cf-bb68-40f4-a819-665b997a2260 req-5b4718c1-202e-4f2e-ab3f-d0fd2672d65b service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:50.758202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-f8ab46cf-bb68-40f4-a819-665b997a2260 req-5b4718c1-202e-4f2e-ab3f-d0fd2672d65b service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:50.768238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2a9bb682-808d-450a-8dcb-c49a3bb2eb71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:50.770993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-f8ab46cf-bb68-40f4-a819-665b997a2260 req-5b4718c1-202e-4f2e-ab3f-d0fd2672d65b service nova] Creating event network-vif-deleted:cd5d78dd-d14b-4a46-802a-66a92af42839 for instance eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 on hv-cinder-82651 Jul 14 15:40:50.776667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-f8ab46cf-bb68-40f4-a819-665b997a2260 req-5b4718c1-202e-4f2e-ab3f-d0fd2672d65b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032098 Jul 14 15:40:50.778009 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 346/644] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:40:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:40:50.780337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2a9bb682-808d-450a-8dcb-c49a3bb2eb71 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1712 microversion: 2.1 time: 0.364564 Jul 14 15:40:50.780820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 299/645] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:50 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1712 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:40:50.785036 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-33f25bd0-f6d9-493f-827e-a54c0f8e5ef9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:50.786138 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-33f25bd0-f6d9-493f-827e-a54c0f8e5ef9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:50.798439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33f25bd0-f6d9-493f-827e-a54c0f8e5ef9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:50.799148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33f25bd0-f6d9-493f-827e-a54c0f8e5ef9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:50.800439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33f25bd0-f6d9-493f-827e-a54c0f8e5ef9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:50.801375 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33f25bd0-f6d9-493f-827e-a54c0f8e5ef9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:51.037768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-33f25bd0-f6d9-493f-827e-a54c0f8e5ef9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:51.051652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-33f25bd0-f6d9-493f-827e-a54c0f8e5ef9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.270976 Jul 14 15:40:51.052532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 347/646] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:50 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:51.242283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f2bd2bf8-692d-4706-91f6-20865f57d37a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:51.247096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f2bd2bf8-692d-4706-91f6-20865f57d37a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:51.280929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f2bd2bf8-692d-4706-91f6-20865f57d37a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:51.281369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f2bd2bf8-692d-4706-91f6-20865f57d37a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:51.290996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f2bd2bf8-692d-4706-91f6-20865f57d37a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:51.291503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f2bd2bf8-692d-4706-91f6-20865f57d37a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:51.496905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f2bd2bf8-692d-4706-91f6-20865f57d37a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:51.532447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f2bd2bf8-692d-4706-91f6-20865f57d37a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 200 len: 1303 microversion: 2.1 time: 0.294391 Jul 14 15:40:51.537297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 300/647] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:51 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 1303 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:51.752237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7e9310fc-dbe0-4764-a897-3799193fe6df tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:51.753469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7e9310fc-dbe0-4764-a897-3799193fe6df tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:51.760384 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e9310fc-dbe0-4764-a897-3799193fe6df tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:51.760836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e9310fc-dbe0-4764-a897-3799193fe6df tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:51.761779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e9310fc-dbe0-4764-a897-3799193fe6df tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:51.762248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e9310fc-dbe0-4764-a897-3799193fe6df tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:52.025891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7e9310fc-dbe0-4764-a897-3799193fe6df tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:52.041309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7e9310fc-dbe0-4764-a897-3799193fe6df tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:52.043178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7e9310fc-dbe0-4764-a897-3799193fe6df tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:52.044796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7e9310fc-dbe0-4764-a897-3799193fe6df tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1751 microversion: 2.20 time: 0.297203 Jul 14 15:40:52.045879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 348/648] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:51 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1751 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:40:52.077741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b4f368f3-52d4-47cc-b2b7-bd9af75809f9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:52.078873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b4f368f3-52d4-47cc-b2b7-bd9af75809f9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:52.097338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4f368f3-52d4-47cc-b2b7-bd9af75809f9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:52.097791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4f368f3-52d4-47cc-b2b7-bd9af75809f9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:52.098569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4f368f3-52d4-47cc-b2b7-bd9af75809f9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:52.099006 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4f368f3-52d4-47cc-b2b7-bd9af75809f9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:52.522606 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b4f368f3-52d4-47cc-b2b7-bd9af75809f9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:52.533599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b4f368f3-52d4-47cc-b2b7-bd9af75809f9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.467817 Jul 14 15:40:52.550957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-23d85088-c232-40a3-aec8-5b90f0cd2bf1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:52.551559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-23d85088-c232-40a3-aec8-5b90f0cd2bf1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:52.556240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 301/649] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:52 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:52.564552 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23d85088-c232-40a3-aec8-5b90f0cd2bf1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:52.565368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23d85088-c232-40a3-aec8-5b90f0cd2bf1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:52.566426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23d85088-c232-40a3-aec8-5b90f0cd2bf1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:52.567408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23d85088-c232-40a3-aec8-5b90f0cd2bf1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:52.589929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-23d85088-c232-40a3-aec8-5b90f0cd2bf1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] HTTP exception thrown: Instance eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 could not be found. Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-23d85088-c232-40a3-aec8-5b90f0cd2bf1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Request method failure captured: Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 HTTP/1.1 Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0Dh-OnjgsX7oqQQNhgIDd2Id9QBoxzEw71St--jFuY59_FWrT8o0xifBEAh4tiT9uEN6NKtRvZKVFa8ijs9mZVlsB_oya6bTxN09k3urFjY_khy9Z2f6PkYlx_yNfc1Fu9ml67Wtce0XZUA7bHhQeOSF4Y9w3ufMuC-4_1jHFDTjD2k Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 858bb49b6e1e48568e2055eacc1ee7e5 Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2074780834 Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:40:52.592139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:40:52.593721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:40:52.593721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-VolumesSnapshotTestJSON-2074780834 Jul 14 15:40:52.593721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 858bb49b6e1e48568e2055eacc1ee7e5 Jul 14 15:40:52.593721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2074780834 Jul 14 15:40:52.593721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-VolumesSnapshotTestJSON-2074780834-project Jul 14 15:40:52.593721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:40:52.593721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:40:52.593721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 71bc270c6253426baa4f79638d466b20 Jul 14 15:40:52.593721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-VolumesSnapshotTestJSON-2074780834-project Jul 14 15:40:52.593721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 15:40:52.593721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 could not be found. Jul 14 15:40:52.593721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7'} Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 could not be found. Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:40:52.595260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 could not be found. Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 could not be found. Jul 14 15:40:52.597333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:40:52.598532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-23d85088-c232-40a3-aec8-5b90f0cd2bf1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Returning 404 to user: Instance eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:40:52.598532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-23d85088-c232-40a3-aec8-5b90f0cd2bf1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7" status: 404 len: 111 microversion: 2.1 time: 0.047833 Jul 14 15:40:52.598532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 349/650] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:52 2022] GET /compute/v2.1/servers/eec5dd0a-77d3-46e0-b2e8-5e18a6c8f9f7 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 15:40:52.841979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ccbd7afe-2729-44e3-86df-aa6c45293cd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Action: 'create', calling method: .version_select at 0x7f35776a9790>, body: {"keypair": {"name": "tempest-TestShelveInstance-1048475031", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBB+wtVh2sxjZjGwTK0IiBE3LSzLgSFR4vvkaeb+Gbo51/A5lMMqvEWptxkW+jQxBiuu1b17MOwt2/0qPajkGPODI35nuqBulWDQoTpRbLD2SEpLhigYjvBL1zRulBThapg=="}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:52.862354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-ccbd7afe-2729-44e3-86df-aa6c45293cd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Getting quotas for project 16f5da37d8ec473dafd80531f7f60c89. Resources: {'key_pairs'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:40:52.868569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-ccbd7afe-2729-44e3-86df-aa6c45293cd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Getting quotas for user dbeb3476ffee4611896156633c84265c and project 16f5da37d8ec473dafd80531f7f60c89. Resources: {'key_pairs'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:40:52.899372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ccbd7afe-2729-44e3-86df-aa6c45293cd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.195582 Jul 14 15:40:52.900411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 302/651] 10.222.0.99 () {60 vars in 1158 bytes} [Thu Jul 14 15:40:52 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:40:53.067977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ce3af05c-b39d-4feb-a318-01992a959ff0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:53.072079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ce3af05c-b39d-4feb-a318-01992a959ff0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:53.083585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ce3af05c-b39d-4feb-a318-01992a959ff0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:53.084429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ce3af05c-b39d-4feb-a318-01992a959ff0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:53.085614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ce3af05c-b39d-4feb-a318-01992a959ff0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:53.086139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ce3af05c-b39d-4feb-a318-01992a959ff0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:53.331572 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ce3af05c-b39d-4feb-a318-01992a959ff0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:53.342859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ce3af05c-b39d-4feb-a318-01992a959ff0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:53.346764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ce3af05c-b39d-4feb-a318-01992a959ff0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:53.351296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ce3af05c-b39d-4feb-a318-01992a959ff0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1751 microversion: 2.20 time: 0.287457 Jul 14 15:40:53.363245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 350/652] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:53 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1751 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:53.550849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-de8aa684-77b7-4ba6-b15c-c5bf820e18cc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:53.551577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-de8aa684-77b7-4ba6-b15c-c5bf820e18cc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:53.567014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de8aa684-77b7-4ba6-b15c-c5bf820e18cc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:53.567480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de8aa684-77b7-4ba6-b15c-c5bf820e18cc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:53.568591 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de8aa684-77b7-4ba6-b15c-c5bf820e18cc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:53.569038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de8aa684-77b7-4ba6-b15c-c5bf820e18cc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:53.799675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-de8aa684-77b7-4ba6-b15c-c5bf820e18cc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:53.807805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-de8aa684-77b7-4ba6-b15c-c5bf820e18cc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.262330 Jul 14 15:40:53.808374 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 303/653] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:53 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:54.372000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6f40461e-0d3e-4308-85d1-193a558624f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:54.373153 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6f40461e-0d3e-4308-85d1-193a558624f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:54.381277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f40461e-0d3e-4308-85d1-193a558624f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:54.381731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f40461e-0d3e-4308-85d1-193a558624f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:54.382703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f40461e-0d3e-4308-85d1-193a558624f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:54.383117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f40461e-0d3e-4308-85d1-193a558624f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:54.558435 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6f40461e-0d3e-4308-85d1-193a558624f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:54.562498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6f40461e-0d3e-4308-85d1-193a558624f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:54.566258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6f40461e-0d3e-4308-85d1-193a558624f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:54.567692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6f40461e-0d3e-4308-85d1-193a558624f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.200909 Jul 14 15:40:54.568441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 351/654] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:54 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:54.827413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bc2a5e34-c448-41ba-a296-98b008cb22fe tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:54.828112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bc2a5e34-c448-41ba-a296-98b008cb22fe tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:54.835485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc2a5e34-c448-41ba-a296-98b008cb22fe tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:54.835969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc2a5e34-c448-41ba-a296-98b008cb22fe tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:54.836743 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc2a5e34-c448-41ba-a296-98b008cb22fe tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:54.837177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc2a5e34-c448-41ba-a296-98b008cb22fe tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:54.996565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bc2a5e34-c448-41ba-a296-98b008cb22fe tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:55.004471 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bc2a5e34-c448-41ba-a296-98b008cb22fe tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.180978 Jul 14 15:40:55.005052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 304/655] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:54 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:55.586614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7709a3a9-f9d5-478c-a18b-59c0bc5d806e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:55.587856 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7709a3a9-f9d5-478c-a18b-59c0bc5d806e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:55.594576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7709a3a9-f9d5-478c-a18b-59c0bc5d806e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:55.595089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7709a3a9-f9d5-478c-a18b-59c0bc5d806e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:55.596193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7709a3a9-f9d5-478c-a18b-59c0bc5d806e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:55.596674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7709a3a9-f9d5-478c-a18b-59c0bc5d806e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:55.731081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7709a3a9-f9d5-478c-a18b-59c0bc5d806e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:55.740518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7709a3a9-f9d5-478c-a18b-59c0bc5d806e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:55.742025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7709a3a9-f9d5-478c-a18b-59c0bc5d806e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:55.743263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7709a3a9-f9d5-478c-a18b-59c0bc5d806e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.160986 Jul 14 15:40:55.743862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 352/656] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:55 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:56.021989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2b2a5759-0822-4f73-a207-b5dcce4bc65d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:56.023403 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2b2a5759-0822-4f73-a207-b5dcce4bc65d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:56.031135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b2a5759-0822-4f73-a207-b5dcce4bc65d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:56.031838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b2a5759-0822-4f73-a207-b5dcce4bc65d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:56.033502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b2a5759-0822-4f73-a207-b5dcce4bc65d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:56.034154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b2a5759-0822-4f73-a207-b5dcce4bc65d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:56.481867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2b2a5759-0822-4f73-a207-b5dcce4bc65d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:56.490494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2b2a5759-0822-4f73-a207-b5dcce4bc65d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.472601 Jul 14 15:40:56.491108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 305/657] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:56 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:56.763719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b4241e3c-958f-4e23-93cf-603cdd99819f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:56.764309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b4241e3c-958f-4e23-93cf-603cdd99819f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:56.772577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b4241e3c-958f-4e23-93cf-603cdd99819f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:56.773107 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b4241e3c-958f-4e23-93cf-603cdd99819f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:56.774064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b4241e3c-958f-4e23-93cf-603cdd99819f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:56.774517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b4241e3c-958f-4e23-93cf-603cdd99819f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:56.916650 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b4241e3c-958f-4e23-93cf-603cdd99819f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:56.926808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b4241e3c-958f-4e23-93cf-603cdd99819f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:56.928387 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b4241e3c-958f-4e23-93cf-603cdd99819f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:56.929581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b4241e3c-958f-4e23-93cf-603cdd99819f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.171214 Jul 14 15:40:56.930168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 353/658] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:56 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:57.507111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b80a359f-e97c-40c6-a479-4b4197c07af8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:57.507796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b80a359f-e97c-40c6-a479-4b4197c07af8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:57.514396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b80a359f-e97c-40c6-a479-4b4197c07af8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:57.514847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b80a359f-e97c-40c6-a479-4b4197c07af8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:57.515760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b80a359f-e97c-40c6-a479-4b4197c07af8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:57.516186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b80a359f-e97c-40c6-a479-4b4197c07af8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:57.649435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b80a359f-e97c-40c6-a479-4b4197c07af8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:57.657926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b80a359f-e97c-40c6-a479-4b4197c07af8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.154660 Jul 14 15:40:57.658502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 306/659] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:57 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:57.948913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c680ae03-be57-42db-90d4-d81042041126 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:57.949635 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c680ae03-be57-42db-90d4-d81042041126 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:57.956210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c680ae03-be57-42db-90d4-d81042041126 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:57.956663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c680ae03-be57-42db-90d4-d81042041126 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:57.957432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c680ae03-be57-42db-90d4-d81042041126 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:57.957868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c680ae03-be57-42db-90d4-d81042041126 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:58.104564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c680ae03-be57-42db-90d4-d81042041126 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:58.114538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c680ae03-be57-42db-90d4-d81042041126 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:58.116227 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c680ae03-be57-42db-90d4-d81042041126 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:58.117398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c680ae03-be57-42db-90d4-d81042041126 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.172431 Jul 14 15:40:58.117963 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 354/660] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:57 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:58.446996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-28223c16-9b19-42ae-a88d-ed7e39584886 req-52ed6612-8127-4f83-9c41-b2574eceb593 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea27265-d9b4-48a9-80e7-00f4be8ca323", "name": "network-vif-plugged", "status": "completed", "tag": "404d8f87-7e6c-41cf-b6ba-764dede489c9"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:40:58.456558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-28223c16-9b19-42ae-a88d-ed7e39584886 req-52ed6612-8127-4f83-9c41-b2574eceb593 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:58.457133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-28223c16-9b19-42ae-a88d-ed7e39584886 req-52ed6612-8127-4f83-9c41-b2574eceb593 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:58.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-28223c16-9b19-42ae-a88d-ed7e39584886 req-52ed6612-8127-4f83-9c41-b2574eceb593 service nova] Creating event network-vif-plugged:404d8f87-7e6c-41cf-b6ba-764dede489c9 for instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 on hv-cinder-82651 Jul 14 15:40:58.477166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-28223c16-9b19-42ae-a88d-ed7e39584886 req-52ed6612-8127-4f83-9c41-b2574eceb593 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033988 Jul 14 15:40:58.478391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 307/661] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:40:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:40:58.675748 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9e719f11-8733-4d87-9eca-39957835e74e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:58.676359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9e719f11-8733-4d87-9eca-39957835e74e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:58.682317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e719f11-8733-4d87-9eca-39957835e74e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:58.682759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e719f11-8733-4d87-9eca-39957835e74e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:58.683508 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e719f11-8733-4d87-9eca-39957835e74e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:58.683965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e719f11-8733-4d87-9eca-39957835e74e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:58.938143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9e719f11-8733-4d87-9eca-39957835e74e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:58.954129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9e719f11-8733-4d87-9eca-39957835e74e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.281537 Jul 14 15:40:58.957191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 355/662] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:58 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:40:59.138210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0700df2f-fbea-4248-95fd-1b33488453d9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:59.138911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0700df2f-fbea-4248-95fd-1b33488453d9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:59.146402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0700df2f-fbea-4248-95fd-1b33488453d9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:59.146850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0700df2f-fbea-4248-95fd-1b33488453d9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:59.147838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0700df2f-fbea-4248-95fd-1b33488453d9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:59.148393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0700df2f-fbea-4248-95fd-1b33488453d9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:59.343617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0700df2f-fbea-4248-95fd-1b33488453d9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:59.352508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0700df2f-fbea-4248-95fd-1b33488453d9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:59.354035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0700df2f-fbea-4248-95fd-1b33488453d9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:40:59.355281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0700df2f-fbea-4248-95fd-1b33488453d9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.221908 Jul 14 15:40:59.355917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 308/663] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:40:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:40:59.970322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-01e0fba0-7b03-4b6e-85fd-94dcafebd198 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:40:59.970940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-01e0fba0-7b03-4b6e-85fd-94dcafebd198 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:40:59.977430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01e0fba0-7b03-4b6e-85fd-94dcafebd198 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:59.977887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01e0fba0-7b03-4b6e-85fd-94dcafebd198 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:40:59.978655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01e0fba0-7b03-4b6e-85fd-94dcafebd198 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:40:59.979098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01e0fba0-7b03-4b6e-85fd-94dcafebd198 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:00.126062 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-01e0fba0-7b03-4b6e-85fd-94dcafebd198 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:00.133619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-01e0fba0-7b03-4b6e-85fd-94dcafebd198 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.167268 Jul 14 15:41:00.134434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 356/664] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:40:59 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:00.374497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6db57cca-48da-4130-9878-cfabffa6bd7a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:00.377575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6db57cca-48da-4130-9878-cfabffa6bd7a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:00.388097 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6db57cca-48da-4130-9878-cfabffa6bd7a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:00.389030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6db57cca-48da-4130-9878-cfabffa6bd7a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:00.390159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6db57cca-48da-4130-9878-cfabffa6bd7a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:00.390874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6db57cca-48da-4130-9878-cfabffa6bd7a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:00.524600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6db57cca-48da-4130-9878-cfabffa6bd7a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:00.533208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6db57cca-48da-4130-9878-cfabffa6bd7a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:00.534700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6db57cca-48da-4130-9878-cfabffa6bd7a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:00.535918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6db57cca-48da-4130-9878-cfabffa6bd7a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.166667 Jul 14 15:41:00.536476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 309/665] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:00 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:01.153034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a0072c49-0755-4194-8e40-cbd7162a4a69 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:01.153824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a0072c49-0755-4194-8e40-cbd7162a4a69 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:01.162448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a0072c49-0755-4194-8e40-cbd7162a4a69 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:01.162448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a0072c49-0755-4194-8e40-cbd7162a4a69 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:01.162448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a0072c49-0755-4194-8e40-cbd7162a4a69 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:01.163220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a0072c49-0755-4194-8e40-cbd7162a4a69 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:01.302016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a0072c49-0755-4194-8e40-cbd7162a4a69 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:01.309477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a0072c49-0755-4194-8e40-cbd7162a4a69 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.161666 Jul 14 15:41:01.310042 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 357/666] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:01 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:01.554069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-111e9c88-1d9a-4b71-8d79-303a588cd08a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:01.554645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-111e9c88-1d9a-4b71-8d79-303a588cd08a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:01.561347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-111e9c88-1d9a-4b71-8d79-303a588cd08a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:01.561793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-111e9c88-1d9a-4b71-8d79-303a588cd08a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:01.562601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-111e9c88-1d9a-4b71-8d79-303a588cd08a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:01.563498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-111e9c88-1d9a-4b71-8d79-303a588cd08a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:01.697265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-111e9c88-1d9a-4b71-8d79-303a588cd08a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:01.707161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-111e9c88-1d9a-4b71-8d79-303a588cd08a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:01.708683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-111e9c88-1d9a-4b71-8d79-303a588cd08a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:01.709872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-111e9c88-1d9a-4b71-8d79-303a588cd08a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.159750 Jul 14 15:41:01.710514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 310/667] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:01 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:02.327531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-52e9bb28-715c-4a13-b13a-2e4b119a4799 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:02.328079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-52e9bb28-715c-4a13-b13a-2e4b119a4799 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:02.335489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52e9bb28-715c-4a13-b13a-2e4b119a4799 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:02.336199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52e9bb28-715c-4a13-b13a-2e4b119a4799 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:02.336972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52e9bb28-715c-4a13-b13a-2e4b119a4799 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:02.337501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52e9bb28-715c-4a13-b13a-2e4b119a4799 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:02.471208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-52e9bb28-715c-4a13-b13a-2e4b119a4799 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:02.480187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-52e9bb28-715c-4a13-b13a-2e4b119a4799 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.156364 Jul 14 15:41:02.481102 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 358/668] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:02 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:02.728414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-30b890d7-706b-4c62-86c8-27b0f639e688 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:02.729053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-30b890d7-706b-4c62-86c8-27b0f639e688 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:02.736237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30b890d7-706b-4c62-86c8-27b0f639e688 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:02.736682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30b890d7-706b-4c62-86c8-27b0f639e688 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:02.737430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30b890d7-706b-4c62-86c8-27b0f639e688 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:02.737860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30b890d7-706b-4c62-86c8-27b0f639e688 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:02.875851 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-30b890d7-706b-4c62-86c8-27b0f639e688 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:02.878079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=4 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:02.885713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-30b890d7-706b-4c62-86c8-27b0f639e688 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:02.887187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-30b890d7-706b-4c62-86c8-27b0f639e688 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:02.888369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-30b890d7-706b-4c62-86c8-27b0f639e688 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.163835 Jul 14 15:41:02.888918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 311/669] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:03.499085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-784e751b-b11b-47b1-bafd-cca277566b6a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:03.499788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-784e751b-b11b-47b1-bafd-cca277566b6a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:03.508695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-784e751b-b11b-47b1-bafd-cca277566b6a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:03.509171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-784e751b-b11b-47b1-bafd-cca277566b6a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:03.509994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-784e751b-b11b-47b1-bafd-cca277566b6a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:03.510383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-784e751b-b11b-47b1-bafd-cca277566b6a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:03.649312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-784e751b-b11b-47b1-bafd-cca277566b6a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:03.658339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-784e751b-b11b-47b1-bafd-cca277566b6a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.163491 Jul 14 15:41:03.658339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 359/670] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:03 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:03.906910 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e12c304-d6cd-4725-b1d2-e19a3c019567 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:03.908714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e12c304-d6cd-4725-b1d2-e19a3c019567 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:03.915269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e12c304-d6cd-4725-b1d2-e19a3c019567 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:03.915754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e12c304-d6cd-4725-b1d2-e19a3c019567 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:03.916522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e12c304-d6cd-4725-b1d2-e19a3c019567 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:03.916960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e12c304-d6cd-4725-b1d2-e19a3c019567 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:04.058256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e12c304-d6cd-4725-b1d2-e19a3c019567 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:04.067855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e12c304-d6cd-4725-b1d2-e19a3c019567 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:04.069350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e12c304-d6cd-4725-b1d2-e19a3c019567 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:04.070510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e12c304-d6cd-4725-b1d2-e19a3c019567 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.167648 Jul 14 15:41:04.071067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 312/671] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:04.676719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-478fd02a-8ebd-4320-b62c-392379bd714c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:04.677334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-478fd02a-8ebd-4320-b62c-392379bd714c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:04.683933 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-478fd02a-8ebd-4320-b62c-392379bd714c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:04.684380 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-478fd02a-8ebd-4320-b62c-392379bd714c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:04.685149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-478fd02a-8ebd-4320-b62c-392379bd714c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:04.685720 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-478fd02a-8ebd-4320-b62c-392379bd714c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:04.818706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-478fd02a-8ebd-4320-b62c-392379bd714c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:04.826054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-478fd02a-8ebd-4320-b62c-392379bd714c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.155941 Jul 14 15:41:04.826611 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 360/672] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:04 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:05.090763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0df11581-2b4f-42c6-a2da-8b0a026fab02 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:05.093237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0df11581-2b4f-42c6-a2da-8b0a026fab02 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:05.102492 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0df11581-2b4f-42c6-a2da-8b0a026fab02 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:05.102952 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0df11581-2b4f-42c6-a2da-8b0a026fab02 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:05.103786 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0df11581-2b4f-42c6-a2da-8b0a026fab02 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:05.104229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0df11581-2b4f-42c6-a2da-8b0a026fab02 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:05.251512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0df11581-2b4f-42c6-a2da-8b0a026fab02 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:05.261134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0df11581-2b4f-42c6-a2da-8b0a026fab02 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:05.262621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0df11581-2b4f-42c6-a2da-8b0a026fab02 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:05.263823 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0df11581-2b4f-42c6-a2da-8b0a026fab02 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.178158 Jul 14 15:41:05.265123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 313/673] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:05 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:05.842904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e5c988a3-1fbf-4caa-9e61-0d2d24aeb1b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:05.844273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e5c988a3-1fbf-4caa-9e61-0d2d24aeb1b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:05.853451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e5c988a3-1fbf-4caa-9e61-0d2d24aeb1b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:05.854150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e5c988a3-1fbf-4caa-9e61-0d2d24aeb1b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:05.857199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e5c988a3-1fbf-4caa-9e61-0d2d24aeb1b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:05.857850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e5c988a3-1fbf-4caa-9e61-0d2d24aeb1b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:05.957895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1313103176", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "networks": [{"uuid": "258b9bba-4eb1-4783-8230-c7499f78cf5e"}]}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:06.021452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e5c988a3-1fbf-4caa-9e61-0d2d24aeb1b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:06.029501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e5c988a3-1fbf-4caa-9e61-0d2d24aeb1b7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.190547 Jul 14 15:41:06.030259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 361/674] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:05 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:06.283129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d66a347f-0705-49ba-8958-5fb13e87483a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:06.285548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d66a347f-0705-49ba-8958-5fb13e87483a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:06.292198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d66a347f-0705-49ba-8958-5fb13e87483a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:06.292775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d66a347f-0705-49ba-8958-5fb13e87483a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:06.293622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d66a347f-0705-49ba-8958-5fb13e87483a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:06.294132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d66a347f-0705-49ba-8958-5fb13e87483a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:06.442640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d66a347f-0705-49ba-8958-5fb13e87483a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:06.451446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d66a347f-0705-49ba-8958-5fb13e87483a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:06.453067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d66a347f-0705-49ba-8958-5fb13e87483a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:06.454418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d66a347f-0705-49ba-8958-5fb13e87483a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.175711 Jul 14 15:41:06.454976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 362/675] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:06 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:07.047660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-753e6daa-56e1-4f73-ba2d-04648cc92279 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:07.048486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-753e6daa-56e1-4f73-ba2d-04648cc92279 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:07.054949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-753e6daa-56e1-4f73-ba2d-04648cc92279 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:07.055398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-753e6daa-56e1-4f73-ba2d-04648cc92279 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:07.056282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-753e6daa-56e1-4f73-ba2d-04648cc92279 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:07.056698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-753e6daa-56e1-4f73-ba2d-04648cc92279 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:07.072142 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:07.195691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-753e6daa-56e1-4f73-ba2d-04648cc92279 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:07.203097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-753e6daa-56e1-4f73-ba2d-04648cc92279 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.159832 Jul 14 15:41:07.203688 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 363/676] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:07 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:07.472558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-eea3445d-881e-45dc-8913-d2c391c9b51e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:07.473176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-eea3445d-881e-45dc-8913-d2c391c9b51e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:07.479856 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eea3445d-881e-45dc-8913-d2c391c9b51e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:07.480318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eea3445d-881e-45dc-8913-d2c391c9b51e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:07.481141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eea3445d-881e-45dc-8913-d2c391c9b51e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:07.481669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eea3445d-881e-45dc-8913-d2c391c9b51e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:07.623184 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-eea3445d-881e-45dc-8913-d2c391c9b51e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:07.632388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-eea3445d-881e-45dc-8913-d2c391c9b51e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:07.633894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-eea3445d-881e-45dc-8913-d2c391c9b51e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:07.635056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-eea3445d-881e-45dc-8913-d2c391c9b51e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.166546 Jul 14 15:41:07.635631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 364/677] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:07 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:08.220546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-75b53d8e-e607-4b02-8349-15b1dae4b283 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:08.221574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-75b53d8e-e607-4b02-8349-15b1dae4b283 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:08.228715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-75b53d8e-e607-4b02-8349-15b1dae4b283 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:08.229156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-75b53d8e-e607-4b02-8349-15b1dae4b283 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:08.229960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-75b53d8e-e607-4b02-8349-15b1dae4b283 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:08.230391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-75b53d8e-e607-4b02-8349-15b1dae4b283 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:08.377285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-75b53d8e-e607-4b02-8349-15b1dae4b283 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:08.385135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-75b53d8e-e607-4b02-8349-15b1dae4b283 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.168505 Jul 14 15:41:08.385732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 365/678] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:08 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:08.656161 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-53a7f815-2133-4cde-a4ab-13bed006a5e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:08.656815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-53a7f815-2133-4cde-a4ab-13bed006a5e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:08.663791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-53a7f815-2133-4cde-a4ab-13bed006a5e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:08.664246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-53a7f815-2133-4cde-a4ab-13bed006a5e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:08.665031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-53a7f815-2133-4cde-a4ab-13bed006a5e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:08.665629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-53a7f815-2133-4cde-a4ab-13bed006a5e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:08.811157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-53a7f815-2133-4cde-a4ab-13bed006a5e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:08.820839 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-53a7f815-2133-4cde-a4ab-13bed006a5e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:08.822366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-53a7f815-2133-4cde-a4ab-13bed006a5e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:08.823626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-53a7f815-2133-4cde-a4ab-13bed006a5e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.171530 Jul 14 15:41:08.824150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 366/679] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:08 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:09.402709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1f3255a5-7c66-466d-8540-b24b58f22daa tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:09.403407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1f3255a5-7c66-466d-8540-b24b58f22daa tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:09.410452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f3255a5-7c66-466d-8540-b24b58f22daa tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:09.410898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f3255a5-7c66-466d-8540-b24b58f22daa tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:09.411705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f3255a5-7c66-466d-8540-b24b58f22daa tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:09.412143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f3255a5-7c66-466d-8540-b24b58f22daa tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:09.573993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1f3255a5-7c66-466d-8540-b24b58f22daa tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:09.580060 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1f3255a5-7c66-466d-8540-b24b58f22daa tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.181328 Jul 14 15:41:09.581058 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 367/680] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:09 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:09.845465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9ada6eff-4397-4c44-90da-57fbedd58163 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:09.845465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9ada6eff-4397-4c44-90da-57fbedd58163 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:09.850581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9ada6eff-4397-4c44-90da-57fbedd58163 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:09.851031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9ada6eff-4397-4c44-90da-57fbedd58163 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:09.851842 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9ada6eff-4397-4c44-90da-57fbedd58163 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:09.852289 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9ada6eff-4397-4c44-90da-57fbedd58163 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:09.994207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9ada6eff-4397-4c44-90da-57fbedd58163 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:10.011578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9ada6eff-4397-4c44-90da-57fbedd58163 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:10.013191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9ada6eff-4397-4c44-90da-57fbedd58163 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:10.014395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9ada6eff-4397-4c44-90da-57fbedd58163 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.175987 Jul 14 15:41:10.014959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 368/681] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:09 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:10.597616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6c2c0a51-1e1f-4f7a-a15b-181afa5b014b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:10.598322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6c2c0a51-1e1f-4f7a-a15b-181afa5b014b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:10.604220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c2c0a51-1e1f-4f7a-a15b-181afa5b014b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:10.604670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c2c0a51-1e1f-4f7a-a15b-181afa5b014b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:10.605428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c2c0a51-1e1f-4f7a-a15b-181afa5b014b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:10.605867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c2c0a51-1e1f-4f7a-a15b-181afa5b014b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:10.754122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6c2c0a51-1e1f-4f7a-a15b-181afa5b014b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:10.762417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6c2c0a51-1e1f-4f7a-a15b-181afa5b014b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.169354 Jul 14 15:41:10.763051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 369/682] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:10 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:11.035959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-322025d1-2752-4c7b-80d6-c397a1a1edcc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:11.036315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-322025d1-2752-4c7b-80d6-c397a1a1edcc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:11.042683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-322025d1-2752-4c7b-80d6-c397a1a1edcc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:11.043168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-322025d1-2752-4c7b-80d6-c397a1a1edcc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:11.043975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-322025d1-2752-4c7b-80d6-c397a1a1edcc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:11.044413 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-322025d1-2752-4c7b-80d6-c397a1a1edcc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:11.184951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-322025d1-2752-4c7b-80d6-c397a1a1edcc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:11.194976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-322025d1-2752-4c7b-80d6-c397a1a1edcc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:11.196511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-322025d1-2752-4c7b-80d6-c397a1a1edcc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:11.197903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-322025d1-2752-4c7b-80d6-c397a1a1edcc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.168272 Jul 14 15:41:11.198779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 370/683] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:11 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:11.780327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7a3fc1e4-0d5e-4618-a273-3ee75a9e1551 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:11.781051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7a3fc1e4-0d5e-4618-a273-3ee75a9e1551 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:11.789225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a3fc1e4-0d5e-4618-a273-3ee75a9e1551 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:11.789672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a3fc1e4-0d5e-4618-a273-3ee75a9e1551 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:11.790442 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a3fc1e4-0d5e-4618-a273-3ee75a9e1551 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:11.790877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a3fc1e4-0d5e-4618-a273-3ee75a9e1551 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:11.946892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7a3fc1e4-0d5e-4618-a273-3ee75a9e1551 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:11.954821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7a3fc1e4-0d5e-4618-a273-3ee75a9e1551 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.178456 Jul 14 15:41:11.955423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 371/684] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:11 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:12.216907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-55366375-ec9e-48ec-a78f-582a036f2c0f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:12.217910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-55366375-ec9e-48ec-a78f-582a036f2c0f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:12.225302 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55366375-ec9e-48ec-a78f-582a036f2c0f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:12.225745 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55366375-ec9e-48ec-a78f-582a036f2c0f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:12.226516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55366375-ec9e-48ec-a78f-582a036f2c0f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:12.226948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55366375-ec9e-48ec-a78f-582a036f2c0f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:12.382594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-55366375-ec9e-48ec-a78f-582a036f2c0f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:12.391723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-55366375-ec9e-48ec-a78f-582a036f2c0f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:12.393238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-55366375-ec9e-48ec-a78f-582a036f2c0f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:12.395102 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-55366375-ec9e-48ec-a78f-582a036f2c0f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.182153 Jul 14 15:41:12.402470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 372/685] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:12 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:12.977874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-70a33a2e-3212-46d4-9b3d-f8b07a909e1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:12.978722 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-70a33a2e-3212-46d4-9b3d-f8b07a909e1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:12.996350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70a33a2e-3212-46d4-9b3d-f8b07a909e1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:12.996574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70a33a2e-3212-46d4-9b3d-f8b07a909e1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:12.997344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70a33a2e-3212-46d4-9b3d-f8b07a909e1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:13.000703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70a33a2e-3212-46d4-9b3d-f8b07a909e1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:13.138810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-70a33a2e-3212-46d4-9b3d-f8b07a909e1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:13.147549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-70a33a2e-3212-46d4-9b3d-f8b07a909e1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.178052 Jul 14 15:41:13.148168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 373/686] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:12 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:13.417236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-059e7c7a-c54e-4eb4-97aa-577eabe7469e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:13.417879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-059e7c7a-c54e-4eb4-97aa-577eabe7469e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:13.424354 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-059e7c7a-c54e-4eb4-97aa-577eabe7469e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:13.424935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-059e7c7a-c54e-4eb4-97aa-577eabe7469e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:13.426564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-059e7c7a-c54e-4eb4-97aa-577eabe7469e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:13.427005 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-059e7c7a-c54e-4eb4-97aa-577eabe7469e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:13.569830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-059e7c7a-c54e-4eb4-97aa-577eabe7469e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:13.579476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-059e7c7a-c54e-4eb4-97aa-577eabe7469e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:13.581641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-059e7c7a-c54e-4eb4-97aa-577eabe7469e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:13.582903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-059e7c7a-c54e-4eb4-97aa-577eabe7469e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.171738 Jul 14 15:41:13.583470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 374/687] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:13 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:14.167109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-89dbfa16-cdb5-4883-89db-4d250ccb4bc1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:14.167847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-89dbfa16-cdb5-4883-89db-4d250ccb4bc1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:14.174618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-89dbfa16-cdb5-4883-89db-4d250ccb4bc1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:14.175796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-89dbfa16-cdb5-4883-89db-4d250ccb4bc1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:14.176573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-89dbfa16-cdb5-4883-89db-4d250ccb4bc1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:14.177008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-89dbfa16-cdb5-4883-89db-4d250ccb4bc1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:14.315505 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-89dbfa16-cdb5-4883-89db-4d250ccb4bc1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:14.322915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-89dbfa16-cdb5-4883-89db-4d250ccb4bc1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.160465 Jul 14 15:41:14.323476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 375/688] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:14 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:14.601533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1351bd69-4b8d-495c-b014-4f062cc074f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:14.602040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1351bd69-4b8d-495c-b014-4f062cc074f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:14.608159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1351bd69-4b8d-495c-b014-4f062cc074f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:14.608662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1351bd69-4b8d-495c-b014-4f062cc074f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:14.609462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1351bd69-4b8d-495c-b014-4f062cc074f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:14.609898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1351bd69-4b8d-495c-b014-4f062cc074f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:14.748276 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1351bd69-4b8d-495c-b014-4f062cc074f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:14.757999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1351bd69-4b8d-495c-b014-4f062cc074f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:14.759554 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1351bd69-4b8d-495c-b014-4f062cc074f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:14.760764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1351bd69-4b8d-495c-b014-4f062cc074f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.163917 Jul 14 15:41:14.761775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 376/689] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:14 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:15.257003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=91 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:15.340092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-21d39596-25a7-45e9-8abb-966ba6c50d06 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:15.340895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-21d39596-25a7-45e9-8abb-966ba6c50d06 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:15.348424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21d39596-25a7-45e9-8abb-966ba6c50d06 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:15.348871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21d39596-25a7-45e9-8abb-966ba6c50d06 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:15.349710 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21d39596-25a7-45e9-8abb-966ba6c50d06 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:15.350156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21d39596-25a7-45e9-8abb-966ba6c50d06 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:15.502039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-21d39596-25a7-45e9-8abb-966ba6c50d06 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:15.512647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-21d39596-25a7-45e9-8abb-966ba6c50d06 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.176328 Jul 14 15:41:15.513335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 377/690] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:15 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:15.781016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5b2b28ec-2c0c-4ccd-bd7a-255c2f722295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:15.781545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5b2b28ec-2c0c-4ccd-bd7a-255c2f722295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:15.788305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b2b28ec-2c0c-4ccd-bd7a-255c2f722295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:15.788759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b2b28ec-2c0c-4ccd-bd7a-255c2f722295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:15.789520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b2b28ec-2c0c-4ccd-bd7a-255c2f722295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:15.789956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b2b28ec-2c0c-4ccd-bd7a-255c2f722295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:15.925029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5b2b28ec-2c0c-4ccd-bd7a-255c2f722295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:15.933969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5b2b28ec-2c0c-4ccd-bd7a-255c2f722295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:15.935474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5b2b28ec-2c0c-4ccd-bd7a-255c2f722295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:15.936679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5b2b28ec-2c0c-4ccd-bd7a-255c2f722295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.159667 Jul 14 15:41:15.937243 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 378/691] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:15 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:15.968043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=52,nova_api:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:16.529730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-70e195e2-53f1-44ba-a271-8797b421fbb8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:16.530664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-70e195e2-53f1-44ba-a271-8797b421fbb8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:16.537663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70e195e2-53f1-44ba-a271-8797b421fbb8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:16.538113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70e195e2-53f1-44ba-a271-8797b421fbb8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:16.538946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70e195e2-53f1-44ba-a271-8797b421fbb8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:16.539329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70e195e2-53f1-44ba-a271-8797b421fbb8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:16.678850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-70e195e2-53f1-44ba-a271-8797b421fbb8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:16.686847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-70e195e2-53f1-44ba-a271-8797b421fbb8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.161095 Jul 14 15:41:16.687425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 379/692] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:16 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:16.957279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-aa6e1f01-d453-4cff-a883-3825547a5afe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:16.958062 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-aa6e1f01-d453-4cff-a883-3825547a5afe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:16.959987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=90 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:16.965584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aa6e1f01-d453-4cff-a883-3825547a5afe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:16.966131 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aa6e1f01-d453-4cff-a883-3825547a5afe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:16.966987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aa6e1f01-d453-4cff-a883-3825547a5afe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:16.967424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aa6e1f01-d453-4cff-a883-3825547a5afe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:16.978865 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:16.991937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.network.neutron [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] validate_networks() for [('258b9bba-4eb1-4783-8230-c7499f78cf5e', None, None, None, None, None)] {{(pid=124503) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:41:17.139749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aa6e1f01-d453-4cff-a883-3825547a5afe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:17.151702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aa6e1f01-d453-4cff-a883-3825547a5afe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:17.153158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aa6e1f01-d453-4cff-a883-3825547a5afe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:17.154327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-aa6e1f01-d453-4cff-a883-3825547a5afe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.201762 Jul 14 15:41:17.154896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 380/693] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:16 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:17.391307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Flavor limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:41:17.391840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Image limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:41:17.392442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Flavor pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:41:17.392863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Image pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:41:17.393334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:41:17.403687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:17.404270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:17.405063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:17.405705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:17.425221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Getting quotas for project 858bb49b6e1e48568e2055eacc1ee7e5. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:41:17.431722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Getting quotas for user 71bc270c6253426baa4f79638d466b20 and project 858bb49b6e1e48568e2055eacc1ee7e5. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:41:17.447962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Going to run 1 instances... {{(pid=124503) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:41:17.450235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124503) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:41:17.496573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ccc7d8e5-bc66-4689-bd8f-7e841d2d6ca5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 11.542613 Jul 14 15:41:17.497589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 314/694] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 15:41:05 2022] POST /compute/v2.1/servers => generated 380 bytes in 11544 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:41:17.508697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-20b324c3-b123-4e7b-b832-37da9204f0a7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:17.509342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-20b324c3-b123-4e7b-b832-37da9204f0a7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:17.567306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-20b324c3-b123-4e7b-b832-37da9204f0a7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:17.574352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-20b324c3-b123-4e7b-b832-37da9204f0a7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1219 microversion: 2.1 time: 0.070814 Jul 14 15:41:17.575127 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 381/695] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:17 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1219 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:17.705216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-38aaca2b-345a-4a84-aff9-06b9ad70ada3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:17.705862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-38aaca2b-345a-4a84-aff9-06b9ad70ada3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:17.713550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38aaca2b-345a-4a84-aff9-06b9ad70ada3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:17.714009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38aaca2b-345a-4a84-aff9-06b9ad70ada3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:17.714776 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38aaca2b-345a-4a84-aff9-06b9ad70ada3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:17.715209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38aaca2b-345a-4a84-aff9-06b9ad70ada3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:17.873928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-38aaca2b-345a-4a84-aff9-06b9ad70ada3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:17.882666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-38aaca2b-345a-4a84-aff9-06b9ad70ada3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.181291 Jul 14 15:41:17.883237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 315/696] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:17 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:18.173754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7d6d120c-bdf3-43df-a457-40580cc6f760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:18.174282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7d6d120c-bdf3-43df-a457-40580cc6f760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:18.180539 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d6d120c-bdf3-43df-a457-40580cc6f760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:18.180996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d6d120c-bdf3-43df-a457-40580cc6f760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:18.181805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d6d120c-bdf3-43df-a457-40580cc6f760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:18.182249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d6d120c-bdf3-43df-a457-40580cc6f760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:18.324860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7d6d120c-bdf3-43df-a457-40580cc6f760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:18.333798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7d6d120c-bdf3-43df-a457-40580cc6f760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:18.335307 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7d6d120c-bdf3-43df-a457-40580cc6f760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:18.336535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7d6d120c-bdf3-43df-a457-40580cc6f760 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.166886 Jul 14 15:41:18.337207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 382/697] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:18 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:18.591128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f6fc37cd-76b1-483e-be93-b4d1fb36eb46 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:18.591716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f6fc37cd-76b1-483e-be93-b4d1fb36eb46 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:18.599172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f6fc37cd-76b1-483e-be93-b4d1fb36eb46 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:18.599643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f6fc37cd-76b1-483e-be93-b4d1fb36eb46 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:18.600409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f6fc37cd-76b1-483e-be93-b4d1fb36eb46 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:18.600843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f6fc37cd-76b1-483e-be93-b4d1fb36eb46 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:18.665112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f6fc37cd-76b1-483e-be93-b4d1fb36eb46 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:18.672619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f6fc37cd-76b1-483e-be93-b4d1fb36eb46 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1223 microversion: 2.1 time: 0.085508 Jul 14 15:41:18.673186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 316/698] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:18 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:18.900986 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-76173977-0c9e-4c32-86e1-5fc43b3b2ab8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:18.901685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-76173977-0c9e-4c32-86e1-5fc43b3b2ab8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:18.908184 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-76173977-0c9e-4c32-86e1-5fc43b3b2ab8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:18.908641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-76173977-0c9e-4c32-86e1-5fc43b3b2ab8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:18.909416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-76173977-0c9e-4c32-86e1-5fc43b3b2ab8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:18.909931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-76173977-0c9e-4c32-86e1-5fc43b3b2ab8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:19.052299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-76173977-0c9e-4c32-86e1-5fc43b3b2ab8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:19.059953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-76173977-0c9e-4c32-86e1-5fc43b3b2ab8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.163062 Jul 14 15:41:19.060543 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 383/699] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:18 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:19.355244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0403ee11-ce1d-4e52-840c-f1c3151978b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:19.355888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0403ee11-ce1d-4e52-840c-f1c3151978b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:19.362375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0403ee11-ce1d-4e52-840c-f1c3151978b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:19.362824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0403ee11-ce1d-4e52-840c-f1c3151978b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:19.364368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0403ee11-ce1d-4e52-840c-f1c3151978b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:19.364812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0403ee11-ce1d-4e52-840c-f1c3151978b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:19.510187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0403ee11-ce1d-4e52-840c-f1c3151978b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:19.518531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0403ee11-ce1d-4e52-840c-f1c3151978b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:19.520608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0403ee11-ce1d-4e52-840c-f1c3151978b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:19.521746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0403ee11-ce1d-4e52-840c-f1c3151978b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.170631 Jul 14 15:41:19.522304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 317/700] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:19 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:19.690393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-298e2bf8-ade9-4495-8b9e-4041a79ab6f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:19.691003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-298e2bf8-ade9-4495-8b9e-4041a79ab6f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:19.697927 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-298e2bf8-ade9-4495-8b9e-4041a79ab6f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:19.698376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-298e2bf8-ade9-4495-8b9e-4041a79ab6f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:19.699186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-298e2bf8-ade9-4495-8b9e-4041a79ab6f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:19.699646 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-298e2bf8-ade9-4495-8b9e-4041a79ab6f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:19.766221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-298e2bf8-ade9-4495-8b9e-4041a79ab6f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:19.776136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-298e2bf8-ade9-4495-8b9e-4041a79ab6f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1223 microversion: 2.1 time: 0.089526 Jul 14 15:41:19.776462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 384/701] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:19 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:20.076780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-437dcab7-ca48-4efc-8182-932e7a888831 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:20.077489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-437dcab7-ca48-4efc-8182-932e7a888831 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:20.085777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-437dcab7-ca48-4efc-8182-932e7a888831 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:20.086555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-437dcab7-ca48-4efc-8182-932e7a888831 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:20.087833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-437dcab7-ca48-4efc-8182-932e7a888831 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:20.088833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-437dcab7-ca48-4efc-8182-932e7a888831 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:20.250714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-437dcab7-ca48-4efc-8182-932e7a888831 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:20.260446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-437dcab7-ca48-4efc-8182-932e7a888831 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.187248 Jul 14 15:41:20.261431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 318/702] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:20 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:20.541625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c1a02b6a-0bd1-4237-bb32-24c0d3a0213d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:20.542247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c1a02b6a-0bd1-4237-bb32-24c0d3a0213d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:20.548742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1a02b6a-0bd1-4237-bb32-24c0d3a0213d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:20.549189 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1a02b6a-0bd1-4237-bb32-24c0d3a0213d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:20.549957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1a02b6a-0bd1-4237-bb32-24c0d3a0213d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:20.550395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1a02b6a-0bd1-4237-bb32-24c0d3a0213d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:20.684828 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c1a02b6a-0bd1-4237-bb32-24c0d3a0213d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:20.693891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c1a02b6a-0bd1-4237-bb32-24c0d3a0213d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:20.695405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c1a02b6a-0bd1-4237-bb32-24c0d3a0213d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:20.696695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c1a02b6a-0bd1-4237-bb32-24c0d3a0213d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.159163 Jul 14 15:41:20.697263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 385/703] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:20.796376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cf7894e9-9c3d-477e-a41b-f7869a37039e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:20.797020 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cf7894e9-9c3d-477e-a41b-f7869a37039e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:20.808535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cf7894e9-9c3d-477e-a41b-f7869a37039e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:20.809007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cf7894e9-9c3d-477e-a41b-f7869a37039e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:20.810076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cf7894e9-9c3d-477e-a41b-f7869a37039e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:20.810794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cf7894e9-9c3d-477e-a41b-f7869a37039e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:20.889606 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cf7894e9-9c3d-477e-a41b-f7869a37039e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:20.898565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cf7894e9-9c3d-477e-a41b-f7869a37039e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1223 microversion: 2.1 time: 0.109109 Jul 14 15:41:20.899430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 319/704] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:20 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1223 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:21.278433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-26219c16-0ac9-4ebe-8754-46af2a577d17 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:21.278935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-26219c16-0ac9-4ebe-8754-46af2a577d17 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:21.286077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26219c16-0ac9-4ebe-8754-46af2a577d17 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:21.286533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26219c16-0ac9-4ebe-8754-46af2a577d17 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:21.287313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26219c16-0ac9-4ebe-8754-46af2a577d17 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:21.287793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26219c16-0ac9-4ebe-8754-46af2a577d17 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:21.428039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-26219c16-0ac9-4ebe-8754-46af2a577d17 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:21.435372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-26219c16-0ac9-4ebe-8754-46af2a577d17 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1263 microversion: 2.1 time: 0.161109 Jul 14 15:41:21.435970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 386/705] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:21 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1263 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:21.715498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f73b59a4-3899-4ebb-bddd-156e266a1ca1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:21.716151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f73b59a4-3899-4ebb-bddd-156e266a1ca1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:21.723993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f73b59a4-3899-4ebb-bddd-156e266a1ca1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:21.723993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f73b59a4-3899-4ebb-bddd-156e266a1ca1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:21.724703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f73b59a4-3899-4ebb-bddd-156e266a1ca1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:21.725140 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f73b59a4-3899-4ebb-bddd-156e266a1ca1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:21.861213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f73b59a4-3899-4ebb-bddd-156e266a1ca1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:21.870243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f73b59a4-3899-4ebb-bddd-156e266a1ca1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:21.871803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f73b59a4-3899-4ebb-bddd-156e266a1ca1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:21.872965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f73b59a4-3899-4ebb-bddd-156e266a1ca1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.161464 Jul 14 15:41:21.873524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 320/706] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:21 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:21.916188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fe37489c-83fb-4761-a8a6-7a3a409f830f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:21.916917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fe37489c-83fb-4761-a8a6-7a3a409f830f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:21.923302 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe37489c-83fb-4761-a8a6-7a3a409f830f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:21.923792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe37489c-83fb-4761-a8a6-7a3a409f830f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:21.924559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe37489c-83fb-4761-a8a6-7a3a409f830f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:21.924998 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe37489c-83fb-4761-a8a6-7a3a409f830f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:21.991493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fe37489c-83fb-4761-a8a6-7a3a409f830f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:22.000797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fe37489c-83fb-4761-a8a6-7a3a409f830f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1223 microversion: 2.1 time: 0.088033 Jul 14 15:41:22.001172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 387/707] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:21 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:22.452845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cc761175-758f-4061-9093-815f5b7c8f1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:22.453470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cc761175-758f-4061-9093-815f5b7c8f1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:22.460208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc761175-758f-4061-9093-815f5b7c8f1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:22.460657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc761175-758f-4061-9093-815f5b7c8f1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:22.461406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc761175-758f-4061-9093-815f5b7c8f1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:22.461839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc761175-758f-4061-9093-815f5b7c8f1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:22.600661 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cc761175-758f-4061-9093-815f5b7c8f1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:22.611996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cc761175-758f-4061-9093-815f5b7c8f1e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1451 microversion: 2.1 time: 0.163054 Jul 14 15:41:22.612557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 321/708] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:22 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1451 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:22.628420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-30af3119-fcd8-4c40-a5f9-10ac27fe4955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:22.629703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-30af3119-fcd8-4c40-a5f9-10ac27fe4955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:22.635839 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30af3119-fcd8-4c40-a5f9-10ac27fe4955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:22.636385 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30af3119-fcd8-4c40-a5f9-10ac27fe4955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:22.637161 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30af3119-fcd8-4c40-a5f9-10ac27fe4955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:22.637607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-30af3119-fcd8-4c40-a5f9-10ac27fe4955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:22.789748 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-30af3119-fcd8-4c40-a5f9-10ac27fe4955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:22.798531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-30af3119-fcd8-4c40-a5f9-10ac27fe4955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1451 microversion: 2.1 time: 0.173935 Jul 14 15:41:22.799151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 388/709] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:22 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1451 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:22.890714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8eb276f8-06cf-43d2-9e8b-7eb7de27e692 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:22.891402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8eb276f8-06cf-43d2-9e8b-7eb7de27e692 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:22.900063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8eb276f8-06cf-43d2-9e8b-7eb7de27e692 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:22.900521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8eb276f8-06cf-43d2-9e8b-7eb7de27e692 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:22.901299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8eb276f8-06cf-43d2-9e8b-7eb7de27e692 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:22.902088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8eb276f8-06cf-43d2-9e8b-7eb7de27e692 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:23.017779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3329e4f1-eb47-408d-bb36-2a7e3ed33192 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:23.018393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3329e4f1-eb47-408d-bb36-2a7e3ed33192 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:23.026301 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3329e4f1-eb47-408d-bb36-2a7e3ed33192 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:23.026875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3329e4f1-eb47-408d-bb36-2a7e3ed33192 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:23.027519 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3329e4f1-eb47-408d-bb36-2a7e3ed33192 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:23.028117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3329e4f1-eb47-408d-bb36-2a7e3ed33192 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:23.107479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8eb276f8-06cf-43d2-9e8b-7eb7de27e692 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:23.112335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3329e4f1-eb47-408d-bb36-2a7e3ed33192 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:23.116694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8eb276f8-06cf-43d2-9e8b-7eb7de27e692 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:23.118569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8eb276f8-06cf-43d2-9e8b-7eb7de27e692 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:23.119804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8eb276f8-06cf-43d2-9e8b-7eb7de27e692 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.233224 Jul 14 15:41:23.120549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 322/710] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:22 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:23.121486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3329e4f1-eb47-408d-bb36-2a7e3ed33192 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1215 microversion: 2.1 time: 0.107413 Jul 14 15:41:23.123950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 389/711] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:23 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1215 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:24.140085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f8ccd7e2-b22d-42b8-b93e-0d10760632fd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:24.140706 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f8ccd7e2-b22d-42b8-b93e-0d10760632fd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:24.141410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-62b66202-2699-49da-b9d7-874fb2f9122e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:24.142097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-62b66202-2699-49da-b9d7-874fb2f9122e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:24.148596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8ccd7e2-b22d-42b8-b93e-0d10760632fd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:24.149724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8ccd7e2-b22d-42b8-b93e-0d10760632fd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:24.150794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8ccd7e2-b22d-42b8-b93e-0d10760632fd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:24.151573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8ccd7e2-b22d-42b8-b93e-0d10760632fd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:24.151878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62b66202-2699-49da-b9d7-874fb2f9122e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:24.152444 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62b66202-2699-49da-b9d7-874fb2f9122e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:24.153279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62b66202-2699-49da-b9d7-874fb2f9122e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:24.153789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62b66202-2699-49da-b9d7-874fb2f9122e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:24.233615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-62b66202-2699-49da-b9d7-874fb2f9122e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:24.242763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-62b66202-2699-49da-b9d7-874fb2f9122e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1271 microversion: 2.1 time: 0.106036 Jul 14 15:41:24.243780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 390/712] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:24 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1271 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:24.423904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f8ccd7e2-b22d-42b8-b93e-0d10760632fd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:24.434432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f8ccd7e2-b22d-42b8-b93e-0d10760632fd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:24.435965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f8ccd7e2-b22d-42b8-b93e-0d10760632fd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:24.437150 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f8ccd7e2-b22d-42b8-b93e-0d10760632fd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.301830 Jul 14 15:41:24.438339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 323/713] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:24 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:24.828221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-de6ddc64-bdfb-46de-8612-71b62c9f444f req-6e115a91-43ae-4745-84a2-4f4793435def service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7ea27265-d9b4-48a9-80e7-00f4be8ca323", "tag": "404d8f87-7e6c-41cf-b6ba-764dede489c9"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:24.841810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-de6ddc64-bdfb-46de-8612-71b62c9f444f req-6e115a91-43ae-4745-84a2-4f4793435def service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:24.842249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-de6ddc64-bdfb-46de-8612-71b62c9f444f req-6e115a91-43ae-4745-84a2-4f4793435def service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:24.853607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-de6ddc64-bdfb-46de-8612-71b62c9f444f req-6e115a91-43ae-4745-84a2-4f4793435def service nova] Creating event network-changed:404d8f87-7e6c-41cf-b6ba-764dede489c9 for instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 on hv-cinder-82651 Jul 14 15:41:24.858973 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-de6ddc64-bdfb-46de-8612-71b62c9f444f req-6e115a91-43ae-4745-84a2-4f4793435def service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034403 Jul 14 15:41:24.859569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 391/714] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:41:25.261205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1948abe4-44e6-43ec-999d-1bc2aa7ec83b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:25.261965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1948abe4-44e6-43ec-999d-1bc2aa7ec83b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:25.270868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1948abe4-44e6-43ec-999d-1bc2aa7ec83b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:25.271813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1948abe4-44e6-43ec-999d-1bc2aa7ec83b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:25.275029 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1948abe4-44e6-43ec-999d-1bc2aa7ec83b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:25.290401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1948abe4-44e6-43ec-999d-1bc2aa7ec83b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:25.350131 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-172622881", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1048475031", "security_groups": [{"name": "tempest-secgroup-smoke-507582801"}], "networks": [{"uuid": "f73b093d-86d8-4079-9664-c2c7103a074f"}], "block_device_mapping_v2": [{"uuid": "95f408fa-e10c-4a21-a69e-720f32e91dca", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:25.392648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1948abe4-44e6-43ec-999d-1bc2aa7ec83b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:25.402058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1948abe4-44e6-43ec-999d-1bc2aa7ec83b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1277 microversion: 2.1 time: 0.144700 Jul 14 15:41:25.402659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 324/715] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:25 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1277 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:25.462317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2552eb2c-d10f-4a70-90e6-397b0e597a05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:25.463243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2552eb2c-d10f-4a70-90e6-397b0e597a05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:25.469807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2552eb2c-d10f-4a70-90e6-397b0e597a05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:25.470264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2552eb2c-d10f-4a70-90e6-397b0e597a05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:25.471049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2552eb2c-d10f-4a70-90e6-397b0e597a05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:25.471487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2552eb2c-d10f-4a70-90e6-397b0e597a05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:25.570771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.network.neutron [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] validate_networks() for [('f73b093d-86d8-4079-9664-c2c7103a074f', None, None, None, None, None)] {{(pid=124502) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 15:41:25.635391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2552eb2c-d10f-4a70-90e6-397b0e597a05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:25.645941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2552eb2c-d10f-4a70-90e6-397b0e597a05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:25.647513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2552eb2c-d10f-4a70-90e6-397b0e597a05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:25.648868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2552eb2c-d10f-4a70-90e6-397b0e597a05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.193132 Jul 14 15:41:25.650863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 325/716] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:25 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:26.420517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-871974ec-6283-4c69-a493-5f62f6f0616f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:26.421328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-871974ec-6283-4c69-a493-5f62f6f0616f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:26.428635 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-871974ec-6283-4c69-a493-5f62f6f0616f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:26.429219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-871974ec-6283-4c69-a493-5f62f6f0616f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:26.430009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-871974ec-6283-4c69-a493-5f62f6f0616f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:26.430594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-871974ec-6283-4c69-a493-5f62f6f0616f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:26.508970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-871974ec-6283-4c69-a493-5f62f6f0616f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:26.516591 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-871974ec-6283-4c69-a493-5f62f6f0616f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1277 microversion: 2.1 time: 0.100001 Jul 14 15:41:26.517274 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 326/717] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:26 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1277 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:26.668144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1cfff996-fc7b-4cf9-85cb-f57747ce1ce7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:26.669455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1cfff996-fc7b-4cf9-85cb-f57747ce1ce7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:26.677816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1cfff996-fc7b-4cf9-85cb-f57747ce1ce7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:26.678190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1cfff996-fc7b-4cf9-85cb-f57747ce1ce7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:26.678955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1cfff996-fc7b-4cf9-85cb-f57747ce1ce7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:26.679396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1cfff996-fc7b-4cf9-85cb-f57747ce1ce7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:26.800092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Flavor limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 15:41:26.801394 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Image limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 15:41:26.802196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Flavor pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 15:41:26.803760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Image pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 15:41:26.804207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 15:41:26.815970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:26.817321 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:26.818149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:26.818585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:26.834447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1cfff996-fc7b-4cf9-85cb-f57747ce1ce7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:26.837965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Getting quotas for project 16f5da37d8ec473dafd80531f7f60c89. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 15:41:26.843053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Getting quotas for user dbeb3476ffee4611896156633c84265c and project 16f5da37d8ec473dafd80531f7f60c89. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 15:41:26.845032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1cfff996-fc7b-4cf9-85cb-f57747ce1ce7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:26.847166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1cfff996-fc7b-4cf9-85cb-f57747ce1ce7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:26.848697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1cfff996-fc7b-4cf9-85cb-f57747ce1ce7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.184275 Jul 14 15:41:26.849446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 327/718] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:26 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:26.907283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Going to run 1 instances... {{(pid=124502) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 15:41:26.909504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='95f408fa-e10c-4a21-a69e-720f32e91dca',volume_size=None,volume_type=None)] {{(pid=124502) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 15:41:27.068578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b2c13367-bcd3-4e79-9855-baa26dc85126 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.724202 Jul 14 15:41:27.069523 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 392/719] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 15:41:25 2022] POST /compute/v2.1/servers => generated 405 bytes in 1726 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 15:41:27.078938 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8f6911f9-ad01-4293-9af4-2dc63eed726a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:27.079964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8f6911f9-ad01-4293-9af4-2dc63eed726a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:27.152885 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8f6911f9-ad01-4293-9af4-2dc63eed726a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:27.159802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8f6911f9-ad01-4293-9af4-2dc63eed726a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1088 microversion: 2.1 time: 0.084548 Jul 14 15:41:27.160619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 328/720] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:27 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1088 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:27.534707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4ddbc683-dd22-44dd-8648-e9df1d6935fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:27.535991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4ddbc683-dd22-44dd-8648-e9df1d6935fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:27.543226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4ddbc683-dd22-44dd-8648-e9df1d6935fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:27.543699 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4ddbc683-dd22-44dd-8648-e9df1d6935fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:27.544476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4ddbc683-dd22-44dd-8648-e9df1d6935fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:27.544916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4ddbc683-dd22-44dd-8648-e9df1d6935fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:27.725516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-a1d39561-9c1d-4641-9b5d-dc3c4cbc7783 req-397ad8b9-f21f-4e2f-9788-c3bcd4f376a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "58c05da0-6e6d-422a-b119-197a7a41a2b9", "tag": "48e0854c-0f5f-413b-9fa6-152194242978"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:27.742477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:27.758317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-a1d39561-9c1d-4641-9b5d-dc3c4cbc7783 req-397ad8b9-f21f-4e2f-9788-c3bcd4f376a8 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:27.759376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-a1d39561-9c1d-4641-9b5d-dc3c4cbc7783 req-397ad8b9-f21f-4e2f-9788-c3bcd4f376a8 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:27.768164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4ddbc683-dd22-44dd-8648-e9df1d6935fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:27.783579 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4ddbc683-dd22-44dd-8648-e9df1d6935fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1319 microversion: 2.1 time: 0.253165 Jul 14 15:41:27.783873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-a1d39561-9c1d-4641-9b5d-dc3c4cbc7783 req-397ad8b9-f21f-4e2f-9788-c3bcd4f376a8 service nova] Creating event network-changed:48e0854c-0f5f-413b-9fa6-152194242978 for instance 58c05da0-6e6d-422a-b119-197a7a41a2b9 on hv-cinder-82651 Jul 14 15:41:27.792736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-a1d39561-9c1d-4641-9b5d-dc3c4cbc7783 req-397ad8b9-f21f-4e2f-9788-c3bcd4f376a8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.072219 Jul 14 15:41:27.793919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 329/721] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:27.796679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 393/722] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:27 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1319 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:27.868639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-413393a9-85ee-4ef5-866c-90d8f9c948b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:27.869441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-413393a9-85ee-4ef5-866c-90d8f9c948b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:27.876072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-413393a9-85ee-4ef5-866c-90d8f9c948b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:27.876528 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-413393a9-85ee-4ef5-866c-90d8f9c948b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:27.877299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-413393a9-85ee-4ef5-866c-90d8f9c948b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:27.877732 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-413393a9-85ee-4ef5-866c-90d8f9c948b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:28.021098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-413393a9-85ee-4ef5-866c-90d8f9c948b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:28.029856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-413393a9-85ee-4ef5-866c-90d8f9c948b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:28.031364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-413393a9-85ee-4ef5-866c-90d8f9c948b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:28.032714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-413393a9-85ee-4ef5-866c-90d8f9c948b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.169387 Jul 14 15:41:28.033123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 330/723] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:28.177715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4108f479-449a-453c-8190-c31f2d0a2546 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:28.179855 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4108f479-449a-453c-8190-c31f2d0a2546 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:28.186120 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4108f479-449a-453c-8190-c31f2d0a2546 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:28.186602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4108f479-449a-453c-8190-c31f2d0a2546 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:28.187384 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4108f479-449a-453c-8190-c31f2d0a2546 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:28.187898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4108f479-449a-453c-8190-c31f2d0a2546 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:28.256935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4108f479-449a-453c-8190-c31f2d0a2546 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:28.265188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4108f479-449a-453c-8190-c31f2d0a2546 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1186 microversion: 2.1 time: 0.092031 Jul 14 15:41:28.265993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 394/724] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:28 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1186 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:28.804061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b479e66a-c53f-4993-8599-0367cab9162f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:28.804852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b479e66a-c53f-4993-8599-0367cab9162f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:28.811757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b479e66a-c53f-4993-8599-0367cab9162f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:28.812210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b479e66a-c53f-4993-8599-0367cab9162f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:28.812983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b479e66a-c53f-4993-8599-0367cab9162f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:28.813424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b479e66a-c53f-4993-8599-0367cab9162f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:28.980347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b479e66a-c53f-4993-8599-0367cab9162f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:28.989445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b479e66a-c53f-4993-8599-0367cab9162f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1319 microversion: 2.1 time: 0.190197 Jul 14 15:41:28.990242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 331/725] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:28 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1319 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:29.053322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-aed767d0-feba-414f-b6f9-d85ccf2c68b2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:29.054056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-aed767d0-feba-414f-b6f9-d85ccf2c68b2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:29.064428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aed767d0-feba-414f-b6f9-d85ccf2c68b2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:29.065671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aed767d0-feba-414f-b6f9-d85ccf2c68b2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:29.067077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aed767d0-feba-414f-b6f9-d85ccf2c68b2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:29.067573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aed767d0-feba-414f-b6f9-d85ccf2c68b2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:29.284536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a001dc15-2267-40ed-875a-8819b39d9140 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:29.286484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a001dc15-2267-40ed-875a-8819b39d9140 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:29.299216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a001dc15-2267-40ed-875a-8819b39d9140 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:29.300118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a001dc15-2267-40ed-875a-8819b39d9140 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:29.302323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a001dc15-2267-40ed-875a-8819b39d9140 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:29.303407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a001dc15-2267-40ed-875a-8819b39d9140 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:29.338544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aed767d0-feba-414f-b6f9-d85ccf2c68b2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:29.350115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aed767d0-feba-414f-b6f9-d85ccf2c68b2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:29.351864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aed767d0-feba-414f-b6f9-d85ccf2c68b2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:29.353308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-aed767d0-feba-414f-b6f9-d85ccf2c68b2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.305588 Jul 14 15:41:29.354422 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 395/726] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:29 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:29.391116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a001dc15-2267-40ed-875a-8819b39d9140 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:29.396979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:29.403233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a001dc15-2267-40ed-875a-8819b39d9140 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1204 microversion: 2.1 time: 0.124652 Jul 14 15:41:29.404098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 332/727] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:29 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1204 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:30.008488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2a426208-959f-48e4-83b5-993dd2cf732b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:30.009569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2a426208-959f-48e4-83b5-993dd2cf732b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:30.017008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a426208-959f-48e4-83b5-993dd2cf732b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:30.017454 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a426208-959f-48e4-83b5-993dd2cf732b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:30.018218 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a426208-959f-48e4-83b5-993dd2cf732b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:30.018653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a426208-959f-48e4-83b5-993dd2cf732b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:30.278900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2a426208-959f-48e4-83b5-993dd2cf732b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:30.286268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2a426208-959f-48e4-83b5-993dd2cf732b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1319 microversion: 2.1 time: 0.283576 Jul 14 15:41:30.286840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 396/728] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:30 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1319 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:30.378675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-91039486-1bc8-406b-801d-6ec82f199729 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:30.380633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-91039486-1bc8-406b-801d-6ec82f199729 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:30.387989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91039486-1bc8-406b-801d-6ec82f199729 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:30.388244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91039486-1bc8-406b-801d-6ec82f199729 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:30.389725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91039486-1bc8-406b-801d-6ec82f199729 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:30.389725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91039486-1bc8-406b-801d-6ec82f199729 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:30.430733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-21635f86-401c-44df-aacb-ea138a0dc23a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:30.431339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-21635f86-401c-44df-aacb-ea138a0dc23a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:30.438045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21635f86-401c-44df-aacb-ea138a0dc23a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:30.438497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21635f86-401c-44df-aacb-ea138a0dc23a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:30.439274 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21635f86-401c-44df-aacb-ea138a0dc23a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:30.439737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21635f86-401c-44df-aacb-ea138a0dc23a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:30.528074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-91039486-1bc8-406b-801d-6ec82f199729 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:30.537511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-91039486-1bc8-406b-801d-6ec82f199729 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:30.539108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-91039486-1bc8-406b-801d-6ec82f199729 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:30.540418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-91039486-1bc8-406b-801d-6ec82f199729 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.165863 Jul 14 15:41:30.541062 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 333/729] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:30 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:30.643903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-21635f86-401c-44df-aacb-ea138a0dc23a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:30.652273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-21635f86-401c-44df-aacb-ea138a0dc23a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1271 microversion: 2.1 time: 0.225229 Jul 14 15:41:30.652847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 397/730] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:30 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1271 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:31.240651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-0e102e31-3cfb-4b9f-9c93-d25bc17e7162 req-56bf008f-d453-45be-a290-a74bcfc9fbef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde2fb02-e844-471d-b2bc-81fc89534875", "tag": "fed6f852-a2ff-4105-8fe1-d37f2cf9b9cd"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:31.249168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-0e102e31-3cfb-4b9f-9c93-d25bc17e7162 req-56bf008f-d453-45be-a290-a74bcfc9fbef service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:31.249620 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-0e102e31-3cfb-4b9f-9c93-d25bc17e7162 req-56bf008f-d453-45be-a290-a74bcfc9fbef service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:31.261801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-0e102e31-3cfb-4b9f-9c93-d25bc17e7162 req-56bf008f-d453-45be-a290-a74bcfc9fbef service nova] Creating event network-changed:fed6f852-a2ff-4105-8fe1-d37f2cf9b9cd for instance fde2fb02-e844-471d-b2bc-81fc89534875 on hv-cinder-82651 Jul 14 15:41:31.266744 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-0e102e31-3cfb-4b9f-9c93-d25bc17e7162 req-56bf008f-d453-45be-a290-a74bcfc9fbef service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031102 Jul 14 15:41:31.267660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 334/731] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:31.302492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-92276bbc-b5cd-4244-b73f-4a329d352d47 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:31.303794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-92276bbc-b5cd-4244-b73f-4a329d352d47 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:31.310298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92276bbc-b5cd-4244-b73f-4a329d352d47 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:31.310743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92276bbc-b5cd-4244-b73f-4a329d352d47 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:31.311610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92276bbc-b5cd-4244-b73f-4a329d352d47 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:31.312086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92276bbc-b5cd-4244-b73f-4a329d352d47 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:31.449262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-92276bbc-b5cd-4244-b73f-4a329d352d47 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:31.456759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-92276bbc-b5cd-4244-b73f-4a329d352d47 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1319 microversion: 2.1 time: 0.158303 Jul 14 15:41:31.457338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 398/732] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:31 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1319 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:31.560722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0a533ba0-887e-49b1-bca3-046e27c94cad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:31.561405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0a533ba0-887e-49b1-bca3-046e27c94cad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:31.567953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a533ba0-887e-49b1-bca3-046e27c94cad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:31.568402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a533ba0-887e-49b1-bca3-046e27c94cad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:31.569160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a533ba0-887e-49b1-bca3-046e27c94cad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:31.569596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a533ba0-887e-49b1-bca3-046e27c94cad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:31.669278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-035e049e-913d-431e-a078-4415663a456b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:31.669900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-035e049e-913d-431e-a078-4415663a456b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:31.676138 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-035e049e-913d-431e-a078-4415663a456b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:31.676649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-035e049e-913d-431e-a078-4415663a456b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:31.677426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-035e049e-913d-431e-a078-4415663a456b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:31.677867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-035e049e-913d-431e-a078-4415663a456b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:31.680585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:31.756271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0a533ba0-887e-49b1-bca3-046e27c94cad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:31.764711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0a533ba0-887e-49b1-bca3-046e27c94cad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:31.766571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0a533ba0-887e-49b1-bca3-046e27c94cad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:31.767775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0a533ba0-887e-49b1-bca3-046e27c94cad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.211932 Jul 14 15:41:31.768497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 335/733] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:31 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:31.822114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-035e049e-913d-431e-a078-4415663a456b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:31.831433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-035e049e-913d-431e-a078-4415663a456b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1271 microversion: 2.1 time: 0.166011 Jul 14 15:41:31.832740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 399/734] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:31 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1271 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:32.474831 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-febe9a20-10fd-430e-a7d1-4edd1bf39f6d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:32.475509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-febe9a20-10fd-430e-a7d1-4edd1bf39f6d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:32.484890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-febe9a20-10fd-430e-a7d1-4edd1bf39f6d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:32.485352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-febe9a20-10fd-430e-a7d1-4edd1bf39f6d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:32.486461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-febe9a20-10fd-430e-a7d1-4edd1bf39f6d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:32.487084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-febe9a20-10fd-430e-a7d1-4edd1bf39f6d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:32.708319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-febe9a20-10fd-430e-a7d1-4edd1bf39f6d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:32.715953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-febe9a20-10fd-430e-a7d1-4edd1bf39f6d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1319 microversion: 2.1 time: 0.245446 Jul 14 15:41:32.716543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 336/735] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:32 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1319 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:32.788368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6a9d961e-1bec-4715-a2eb-097440f80f43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:32.789078 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6a9d961e-1bec-4715-a2eb-097440f80f43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:32.796246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a9d961e-1bec-4715-a2eb-097440f80f43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:32.797082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a9d961e-1bec-4715-a2eb-097440f80f43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:32.798028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a9d961e-1bec-4715-a2eb-097440f80f43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:32.798511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a9d961e-1bec-4715-a2eb-097440f80f43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:32.850576 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-da25aeba-7bd3-4348-a5d3-726be29f044f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:32.851507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-da25aeba-7bd3-4348-a5d3-726be29f044f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:32.858045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da25aeba-7bd3-4348-a5d3-726be29f044f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:32.858813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da25aeba-7bd3-4348-a5d3-726be29f044f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:32.859897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da25aeba-7bd3-4348-a5d3-726be29f044f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:32.860550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da25aeba-7bd3-4348-a5d3-726be29f044f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:33.033249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-da25aeba-7bd3-4348-a5d3-726be29f044f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:33.042721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-da25aeba-7bd3-4348-a5d3-726be29f044f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.197074 Jul 14 15:41:33.043326 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 337/736] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:32 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:33.074470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6a9d961e-1bec-4715-a2eb-097440f80f43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:33.083019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6a9d961e-1bec-4715-a2eb-097440f80f43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:33.084730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6a9d961e-1bec-4715-a2eb-097440f80f43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:33.085976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6a9d961e-1bec-4715-a2eb-097440f80f43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.302351 Jul 14 15:41:33.086951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 400/737] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:33.733429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-66c443d7-1c8e-414b-91d2-982651385989 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:33.734040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-66c443d7-1c8e-414b-91d2-982651385989 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:33.740414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66c443d7-1c8e-414b-91d2-982651385989 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:33.740865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66c443d7-1c8e-414b-91d2-982651385989 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:33.741644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66c443d7-1c8e-414b-91d2-982651385989 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:33.742085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66c443d7-1c8e-414b-91d2-982651385989 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:33.876352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-66c443d7-1c8e-414b-91d2-982651385989 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:33.884299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-66c443d7-1c8e-414b-91d2-982651385989 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1319 microversion: 2.1 time: 0.154898 Jul 14 15:41:33.884861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 338/738] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:33 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:34.060659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-31d38529-3773-41af-8228-1ee04042cb03 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:34.061263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-31d38529-3773-41af-8228-1ee04042cb03 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:34.068822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-31d38529-3773-41af-8228-1ee04042cb03 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:34.069278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-31d38529-3773-41af-8228-1ee04042cb03 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:34.070039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-31d38529-3773-41af-8228-1ee04042cb03 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:34.070473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-31d38529-3773-41af-8228-1ee04042cb03 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:34.110016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-674cf50b-763a-484b-be70-41765bd85af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:34.110919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-674cf50b-763a-484b-be70-41765bd85af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:34.118475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-674cf50b-763a-484b-be70-41765bd85af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:34.118920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-674cf50b-763a-484b-be70-41765bd85af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:34.119762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-674cf50b-763a-484b-be70-41765bd85af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:34.120245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-674cf50b-763a-484b-be70-41765bd85af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:34.208870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-31d38529-3773-41af-8228-1ee04042cb03 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:34.216648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-31d38529-3773-41af-8228-1ee04042cb03 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.159924 Jul 14 15:41:34.217231 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 401/739] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:34 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:34.256852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-674cf50b-763a-484b-be70-41765bd85af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:34.265372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-674cf50b-763a-484b-be70-41765bd85af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:34.266863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-674cf50b-763a-484b-be70-41765bd85af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:34.268050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-674cf50b-763a-484b-be70-41765bd85af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.162020 Jul 14 15:41:34.268602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 339/740] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:34 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:34.681487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-9ae8b82b-028f-4e50-9f44-7751ded4e2f0 req-f3f9cf4b-9407-402b-8221-8836ec3bf8c4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c05da0-6e6d-422a-b119-197a7a41a2b9", "name": "network-vif-plugged", "status": "completed", "tag": "48e0854c-0f5f-413b-9fa6-152194242978"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:34.690095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-9ae8b82b-028f-4e50-9f44-7751ded4e2f0 req-f3f9cf4b-9407-402b-8221-8836ec3bf8c4 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:34.690589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-9ae8b82b-028f-4e50-9f44-7751ded4e2f0 req-f3f9cf4b-9407-402b-8221-8836ec3bf8c4 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:34.704053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-9ae8b82b-028f-4e50-9f44-7751ded4e2f0 req-f3f9cf4b-9407-402b-8221-8836ec3bf8c4 service nova] Creating event network-vif-plugged:48e0854c-0f5f-413b-9fa6-152194242978 for instance 58c05da0-6e6d-422a-b119-197a7a41a2b9 on hv-cinder-82651 Jul 14 15:41:34.709594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-9ae8b82b-028f-4e50-9f44-7751ded4e2f0 req-f3f9cf4b-9407-402b-8221-8836ec3bf8c4 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031672 Jul 14 15:41:34.710208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 402/741] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:34.901566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-76a399e2-c924-41e5-8ddc-92b716953e41 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:34.902406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-76a399e2-c924-41e5-8ddc-92b716953e41 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:34.908724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76a399e2-c924-41e5-8ddc-92b716953e41 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:34.909167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76a399e2-c924-41e5-8ddc-92b716953e41 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:34.909973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76a399e2-c924-41e5-8ddc-92b716953e41 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:34.910398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76a399e2-c924-41e5-8ddc-92b716953e41 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:35.051271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-76a399e2-c924-41e5-8ddc-92b716953e41 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:35.059698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-76a399e2-c924-41e5-8ddc-92b716953e41 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1319 microversion: 2.1 time: 0.161512 Jul 14 15:41:35.059698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 340/742] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:34 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:35.237240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9b0fc94a-e5a7-4a14-a8ef-7d028574c372 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:35.238559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9b0fc94a-e5a7-4a14-a8ef-7d028574c372 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:35.245033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b0fc94a-e5a7-4a14-a8ef-7d028574c372 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:35.245486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b0fc94a-e5a7-4a14-a8ef-7d028574c372 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:35.246254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b0fc94a-e5a7-4a14-a8ef-7d028574c372 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:35.246690 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b0fc94a-e5a7-4a14-a8ef-7d028574c372 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:35.286754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-440f595d-a17a-412b-b3c5-5e6c9814f31a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:35.287372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-440f595d-a17a-412b-b3c5-5e6c9814f31a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:35.293611 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-440f595d-a17a-412b-b3c5-5e6c9814f31a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:35.294146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-440f595d-a17a-412b-b3c5-5e6c9814f31a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:35.294811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-440f595d-a17a-412b-b3c5-5e6c9814f31a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:35.295242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-440f595d-a17a-412b-b3c5-5e6c9814f31a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:35.452168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-440f595d-a17a-412b-b3c5-5e6c9814f31a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:35.461516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-440f595d-a17a-412b-b3c5-5e6c9814f31a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:35.463023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-440f595d-a17a-412b-b3c5-5e6c9814f31a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:35.464281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-440f595d-a17a-412b-b3c5-5e6c9814f31a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.181906 Jul 14 15:41:35.464867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 341/743] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:35 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:35.646899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9b0fc94a-e5a7-4a14-a8ef-7d028574c372 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:35.654602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9b0fc94a-e5a7-4a14-a8ef-7d028574c372 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.422108 Jul 14 15:41:35.655179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 403/744] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:35 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:36.074941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9066c995-4130-4080-800c-fe68641fef01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:36.075542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9066c995-4130-4080-800c-fe68641fef01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:36.082119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9066c995-4130-4080-800c-fe68641fef01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:36.082672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9066c995-4130-4080-800c-fe68641fef01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:36.083434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9066c995-4130-4080-800c-fe68641fef01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:36.083890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9066c995-4130-4080-800c-fe68641fef01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:36.230270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9066c995-4130-4080-800c-fe68641fef01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:36.238293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9066c995-4130-4080-800c-fe68641fef01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1319 microversion: 2.1 time: 0.166916 Jul 14 15:41:36.239572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 342/745] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:36 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:36.483110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3adbf737-fa0f-4cbe-99cb-6a6f4b8b7de9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:36.483744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3adbf737-fa0f-4cbe-99cb-6a6f4b8b7de9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:36.490436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3adbf737-fa0f-4cbe-99cb-6a6f4b8b7de9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:36.490890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3adbf737-fa0f-4cbe-99cb-6a6f4b8b7de9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:36.491678 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3adbf737-fa0f-4cbe-99cb-6a6f4b8b7de9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:36.492123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3adbf737-fa0f-4cbe-99cb-6a6f4b8b7de9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:36.626671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3adbf737-fa0f-4cbe-99cb-6a6f4b8b7de9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:36.635638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3adbf737-fa0f-4cbe-99cb-6a6f4b8b7de9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:36.637269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3adbf737-fa0f-4cbe-99cb-6a6f4b8b7de9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:36.638415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3adbf737-fa0f-4cbe-99cb-6a6f4b8b7de9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.159236 Jul 14 15:41:36.638968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 404/746] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:36 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:36.671450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b98f46f7-8d5c-4817-8e1d-0a25080b27e3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:36.672105 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b98f46f7-8d5c-4817-8e1d-0a25080b27e3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:36.678342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b98f46f7-8d5c-4817-8e1d-0a25080b27e3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:36.678787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b98f46f7-8d5c-4817-8e1d-0a25080b27e3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:36.679547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b98f46f7-8d5c-4817-8e1d-0a25080b27e3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:36.680015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b98f46f7-8d5c-4817-8e1d-0a25080b27e3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:36.818287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b98f46f7-8d5c-4817-8e1d-0a25080b27e3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:36.825731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b98f46f7-8d5c-4817-8e1d-0a25080b27e3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.158070 Jul 14 15:41:36.826228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 343/747] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:36 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:36.891538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-9a81ca6f-419e-4560-a5ba-493a6b4a3dbf req-065b72d5-2bc6-46d4-b242-47a9b556db66 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c8cb95-bde5-4c91-99de-27aa44a822bf", "name": "network-vif-plugged", "status": "completed", "tag": "daed7bb6-45ad-49c9-829a-e0e2a0eca7f9"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:36.896184 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:36.897155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=8 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:36.904223 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-9a81ca6f-419e-4560-a5ba-493a6b4a3dbf req-065b72d5-2bc6-46d4-b242-47a9b556db66 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:36.904688 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-9a81ca6f-419e-4560-a5ba-493a6b4a3dbf req-065b72d5-2bc6-46d4-b242-47a9b556db66 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:36.916687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-9a81ca6f-419e-4560-a5ba-493a6b4a3dbf req-065b72d5-2bc6-46d4-b242-47a9b556db66 service nova] Creating event network-vif-plugged:daed7bb6-45ad-49c9-829a-e0e2a0eca7f9 for instance e5c8cb95-bde5-4c91-99de-27aa44a822bf on hv-cinder-82651 Jul 14 15:41:36.921440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-9a81ca6f-419e-4560-a5ba-493a6b4a3dbf req-065b72d5-2bc6-46d4-b242-47a9b556db66 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033594 Jul 14 15:41:36.922027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 405/748] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:37.257157 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-29b94dd6-bede-46d1-a7ed-4c4d9c9b773e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:37.257879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-29b94dd6-bede-46d1-a7ed-4c4d9c9b773e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:37.260546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=8 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:37.266287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29b94dd6-bede-46d1-a7ed-4c4d9c9b773e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:37.266741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29b94dd6-bede-46d1-a7ed-4c4d9c9b773e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:37.267522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29b94dd6-bede-46d1-a7ed-4c4d9c9b773e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:37.268001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29b94dd6-bede-46d1-a7ed-4c4d9c9b773e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:37.418488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-29b94dd6-bede-46d1-a7ed-4c4d9c9b773e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:37.426139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-29b94dd6-bede-46d1-a7ed-4c4d9c9b773e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1319 microversion: 2.1 time: 0.173426 Jul 14 15:41:37.426719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 344/749] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:37 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1319 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:37.658794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2f335a92-ba7e-4377-a765-8f92c8d7a749 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:37.659442 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2f335a92-ba7e-4377-a765-8f92c8d7a749 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:37.666948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2f335a92-ba7e-4377-a765-8f92c8d7a749 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:37.666948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2f335a92-ba7e-4377-a765-8f92c8d7a749 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:37.667819 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2f335a92-ba7e-4377-a765-8f92c8d7a749 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:37.668387 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2f335a92-ba7e-4377-a765-8f92c8d7a749 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:37.809226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2f335a92-ba7e-4377-a765-8f92c8d7a749 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:37.818237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2f335a92-ba7e-4377-a765-8f92c8d7a749 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:37.819761 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2f335a92-ba7e-4377-a765-8f92c8d7a749 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:37.820923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2f335a92-ba7e-4377-a765-8f92c8d7a749 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.167081 Jul 14 15:41:37.821478 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 406/750] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:37 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:37.842474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d2c80639-696a-4842-a224-55e8119db8cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:37.843081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d2c80639-696a-4842-a224-55e8119db8cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:37.849931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2c80639-696a-4842-a224-55e8119db8cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:37.850380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2c80639-696a-4842-a224-55e8119db8cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:37.851138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2c80639-696a-4842-a224-55e8119db8cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:37.851571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2c80639-696a-4842-a224-55e8119db8cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:37.985303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d2c80639-696a-4842-a224-55e8119db8cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:37.993929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d2c80639-696a-4842-a224-55e8119db8cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.155223 Jul 14 15:41:37.994502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 345/751] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:37 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:38.443603 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d5bf81dc-4003-46a7-a6c2-5d5edcfb7b35 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:38.444402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d5bf81dc-4003-46a7-a6c2-5d5edcfb7b35 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:38.450689 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d5bf81dc-4003-46a7-a6c2-5d5edcfb7b35 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:38.451129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d5bf81dc-4003-46a7-a6c2-5d5edcfb7b35 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:38.451915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d5bf81dc-4003-46a7-a6c2-5d5edcfb7b35 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:38.452347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d5bf81dc-4003-46a7-a6c2-5d5edcfb7b35 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:38.584199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d5bf81dc-4003-46a7-a6c2-5d5edcfb7b35 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:38.591816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d5bf81dc-4003-46a7-a6c2-5d5edcfb7b35 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1319 microversion: 2.1 time: 0.152768 Jul 14 15:41:38.592388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 407/752] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:38 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:38.838633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c0a37d5e-814b-410b-a7d3-71cf9582a3ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:38.839214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c0a37d5e-814b-410b-a7d3-71cf9582a3ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:38.845784 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0a37d5e-814b-410b-a7d3-71cf9582a3ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:38.846239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0a37d5e-814b-410b-a7d3-71cf9582a3ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:38.847011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0a37d5e-814b-410b-a7d3-71cf9582a3ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:38.848088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0a37d5e-814b-410b-a7d3-71cf9582a3ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:38.985113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c0a37d5e-814b-410b-a7d3-71cf9582a3ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:38.995243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c0a37d5e-814b-410b-a7d3-71cf9582a3ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:38.996684 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c0a37d5e-814b-410b-a7d3-71cf9582a3ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:38.997859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c0a37d5e-814b-410b-a7d3-71cf9582a3ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.163291 Jul 14 15:41:38.998876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 346/753] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:39.010661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6728d812-38ad-4aaf-abe8-c1573b549f1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:39.011269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6728d812-38ad-4aaf-abe8-c1573b549f1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:39.017902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6728d812-38ad-4aaf-abe8-c1573b549f1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:39.018347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6728d812-38ad-4aaf-abe8-c1573b549f1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:39.019102 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6728d812-38ad-4aaf-abe8-c1573b549f1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:39.019538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6728d812-38ad-4aaf-abe8-c1573b549f1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:39.153329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6728d812-38ad-4aaf-abe8-c1573b549f1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:39.161988 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6728d812-38ad-4aaf-abe8-c1573b549f1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.154842 Jul 14 15:41:39.162584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 408/754] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:39 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:39.608841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0173f628-7e35-4daf-8c04-243885ac9682 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:39.609456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0173f628-7e35-4daf-8c04-243885ac9682 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:39.615578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0173f628-7e35-4daf-8c04-243885ac9682 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:39.616057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0173f628-7e35-4daf-8c04-243885ac9682 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:39.616815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0173f628-7e35-4daf-8c04-243885ac9682 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:39.617253 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0173f628-7e35-4daf-8c04-243885ac9682 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:39.745237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0173f628-7e35-4daf-8c04-243885ac9682 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:39.753251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0173f628-7e35-4daf-8c04-243885ac9682 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1507 microversion: 2.1 time: 0.148268 Jul 14 15:41:39.754309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 347/755] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:39 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1507 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:39.772827 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-495476ff-563e-4908-b310-706b30543181 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd59aa1e-6759-47fa-bf04-eaa6bc8732fb", "device": "/dev/sdb"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:39.775180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-495476ff-563e-4908-b310-706b30543181 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:39.781562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-495476ff-563e-4908-b310-706b30543181 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:39.782019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-495476ff-563e-4908-b310-706b30543181 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:39.782803 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-495476ff-563e-4908-b310-706b30543181 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:39.783248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-495476ff-563e-4908-b310-706b30543181 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:40.015729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e7da7a53-9418-4c18-94e9-23da56109f07 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:40.016773 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e7da7a53-9418-4c18-94e9-23da56109f07 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:40.022887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e7da7a53-9418-4c18-94e9-23da56109f07 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:40.023332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e7da7a53-9418-4c18-94e9-23da56109f07 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:40.024115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e7da7a53-9418-4c18-94e9-23da56109f07 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:40.024856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e7da7a53-9418-4c18-94e9-23da56109f07 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:40.161203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e7da7a53-9418-4c18-94e9-23da56109f07 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:40.170270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e7da7a53-9418-4c18-94e9-23da56109f07 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:40.171749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e7da7a53-9418-4c18-94e9-23da56109f07 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:40.172933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e7da7a53-9418-4c18-94e9-23da56109f07 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.161116 Jul 14 15:41:40.173507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 348/756] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:40 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:40.178753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-394dae99-1a6c-49c7-8528-f9dc9184801b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:40.179362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-394dae99-1a6c-49c7-8528-f9dc9184801b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:40.185465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-394dae99-1a6c-49c7-8528-f9dc9184801b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:40.185918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-394dae99-1a6c-49c7-8528-f9dc9184801b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:40.186676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-394dae99-1a6c-49c7-8528-f9dc9184801b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:40.187118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-394dae99-1a6c-49c7-8528-f9dc9184801b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:40.323172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-394dae99-1a6c-49c7-8528-f9dc9184801b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:40.330725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-394dae99-1a6c-49c7-8528-f9dc9184801b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.156280 Jul 14 15:41:40.331287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 349/757] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:40 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:40.605623 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-495476ff-563e-4908-b310-706b30543181 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "POST /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.838569 Jul 14 15:41:40.607954 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 409/758] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 15:41:39 2022] POST /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments => generated 194 bytes in 841 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:41.191197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-da079183-bd48-41a2-8ee4-4cdbc2c31228 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:41.191848 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-da079183-bd48-41a2-8ee4-4cdbc2c31228 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:41.198482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da079183-bd48-41a2-8ee4-4cdbc2c31228 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:41.198919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da079183-bd48-41a2-8ee4-4cdbc2c31228 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:41.199732 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da079183-bd48-41a2-8ee4-4cdbc2c31228 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:41.200503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da079183-bd48-41a2-8ee4-4cdbc2c31228 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:41.205002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:41.336650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-da079183-bd48-41a2-8ee4-4cdbc2c31228 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:41.345119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-da079183-bd48-41a2-8ee4-4cdbc2c31228 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:41.346625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-da079183-bd48-41a2-8ee4-4cdbc2c31228 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:41.347383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-668ea91c-e1f6-4fd4-a3c8-5e3a333abc4b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:41.348314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-da079183-bd48-41a2-8ee4-4cdbc2c31228 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.160468 Jul 14 15:41:41.348660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-668ea91c-e1f6-4fd4-a3c8-5e3a333abc4b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:41.349627 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 350/759] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:41 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 15:41:41.355008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-668ea91c-e1f6-4fd4-a3c8-5e3a333abc4b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:41.355460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-668ea91c-e1f6-4fd4-a3c8-5e3a333abc4b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:41.356264 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-668ea91c-e1f6-4fd4-a3c8-5e3a333abc4b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:41.356702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-668ea91c-e1f6-4fd4-a3c8-5e3a333abc4b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:41.494073 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-668ea91c-e1f6-4fd4-a3c8-5e3a333abc4b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:41.501620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-668ea91c-e1f6-4fd4-a3c8-5e3a333abc4b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.158939 Jul 14 15:41:41.502185 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 410/760] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:41 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:42.366872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2b39a37d-7a65-4dbb-b4b8-b57e34076980 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:42.367417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2b39a37d-7a65-4dbb-b4b8-b57e34076980 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:42.374062 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b39a37d-7a65-4dbb-b4b8-b57e34076980 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:42.374501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b39a37d-7a65-4dbb-b4b8-b57e34076980 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:42.375252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b39a37d-7a65-4dbb-b4b8-b57e34076980 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:42.375713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b39a37d-7a65-4dbb-b4b8-b57e34076980 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:42.511902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2b39a37d-7a65-4dbb-b4b8-b57e34076980 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:42.518820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c4c2ca37-feb6-49e2-bf59-09997bf3f56f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:42.519507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c4c2ca37-feb6-49e2-bf59-09997bf3f56f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:42.521226 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2b39a37d-7a65-4dbb-b4b8-b57e34076980 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:42.522758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2b39a37d-7a65-4dbb-b4b8-b57e34076980 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:42.523976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2b39a37d-7a65-4dbb-b4b8-b57e34076980 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.161541 Jul 14 15:41:42.524790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 351/761] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:42 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:42.527169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c4c2ca37-feb6-49e2-bf59-09997bf3f56f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:42.527649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c4c2ca37-feb6-49e2-bf59-09997bf3f56f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:42.528493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c4c2ca37-feb6-49e2-bf59-09997bf3f56f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:42.528937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c4c2ca37-feb6-49e2-bf59-09997bf3f56f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:42.665439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c4c2ca37-feb6-49e2-bf59-09997bf3f56f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:42.672911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c4c2ca37-feb6-49e2-bf59-09997bf3f56f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.158044 Jul 14 15:41:42.673477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 411/762] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:42 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:41:43.543551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7e91b5f8-2f25-43f9-a6d4-fdeb1747e922 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:43.544193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7e91b5f8-2f25-43f9-a6d4-fdeb1747e922 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:43.553217 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e91b5f8-2f25-43f9-a6d4-fdeb1747e922 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:43.553792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e91b5f8-2f25-43f9-a6d4-fdeb1747e922 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:43.554847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e91b5f8-2f25-43f9-a6d4-fdeb1747e922 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:43.555299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e91b5f8-2f25-43f9-a6d4-fdeb1747e922 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:43.690679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7974dddb-68d7-4b82-86eb-065b8d6d4f01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:43.692893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7974dddb-68d7-4b82-86eb-065b8d6d4f01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:43.702317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7974dddb-68d7-4b82-86eb-065b8d6d4f01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:43.702920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7974dddb-68d7-4b82-86eb-065b8d6d4f01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:43.703831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7974dddb-68d7-4b82-86eb-065b8d6d4f01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:43.704395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7974dddb-68d7-4b82-86eb-065b8d6d4f01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:43.787012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:41:43.787491 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:41:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (ip 10.222.0.99) !!! Jul 14 15:41:43.811927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7e91b5f8-2f25-43f9-a6d4-fdeb1747e922 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:43.820623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7e91b5f8-2f25-43f9-a6d4-fdeb1747e922 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:43.822125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7e91b5f8-2f25-43f9-a6d4-fdeb1747e922 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:43.824712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7e91b5f8-2f25-43f9-a6d4-fdeb1747e922 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1807 microversion: 2.20 time: 0.286260 Jul 14 15:41:43.825834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 352/763] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:43 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1807 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:43.864909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7974dddb-68d7-4b82-86eb-065b8d6d4f01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:43.880207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7974dddb-68d7-4b82-86eb-065b8d6d4f01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.193738 Jul 14 15:41:43.881313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 412/764] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:43 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:44.844148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-afa01178-0597-47c0-9faa-473585cc930f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:44.844755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-afa01178-0597-47c0-9faa-473585cc930f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:44.851792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-afa01178-0597-47c0-9faa-473585cc930f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:44.852243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-afa01178-0597-47c0-9faa-473585cc930f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:44.852996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-afa01178-0597-47c0-9faa-473585cc930f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:44.853434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-afa01178-0597-47c0-9faa-473585cc930f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:44.898782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-23afe07c-db82-4566-a7d5-e9676ef64156 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:44.903305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-23afe07c-db82-4566-a7d5-e9676ef64156 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:44.910112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23afe07c-db82-4566-a7d5-e9676ef64156 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:44.910666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23afe07c-db82-4566-a7d5-e9676ef64156 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:44.912062 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23afe07c-db82-4566-a7d5-e9676ef64156 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:44.912921 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23afe07c-db82-4566-a7d5-e9676ef64156 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:45.002675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-afa01178-0597-47c0-9faa-473585cc930f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:45.012563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-afa01178-0597-47c0-9faa-473585cc930f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:45.014117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-afa01178-0597-47c0-9faa-473585cc930f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:45.015283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-afa01178-0597-47c0-9faa-473585cc930f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1794 microversion: 2.20 time: 0.175030 Jul 14 15:41:45.015892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 353/765] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 15:41:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1794 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 15:41:45.058741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-23afe07c-db82-4566-a7d5-e9676ef64156 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:45.066245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-23afe07c-db82-4566-a7d5-e9676ef64156 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.172907 Jul 14 15:41:45.067522 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 413/766] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:44 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:45.682110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-9aca132c-88ff-48e8-a757-256bf859ee19 req-917f8247-d0d9-4cad-957c-292725fe920c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde2fb02-e844-471d-b2bc-81fc89534875", "name": "network-vif-plugged", "status": "completed", "tag": "fed6f852-a2ff-4105-8fe1-d37f2cf9b9cd"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:45.691262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-9aca132c-88ff-48e8-a757-256bf859ee19 req-917f8247-d0d9-4cad-957c-292725fe920c service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:45.692252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-9aca132c-88ff-48e8-a757-256bf859ee19 req-917f8247-d0d9-4cad-957c-292725fe920c service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:45.704017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-9aca132c-88ff-48e8-a757-256bf859ee19 req-917f8247-d0d9-4cad-957c-292725fe920c service nova] Creating event network-vif-plugged:fed6f852-a2ff-4105-8fe1-d37f2cf9b9cd for instance fde2fb02-e844-471d-b2bc-81fc89534875 on hv-cinder-82651 Jul 14 15:41:45.710315 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-9aca132c-88ff-48e8-a757-256bf859ee19 req-917f8247-d0d9-4cad-957c-292725fe920c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031808 Jul 14 15:41:45.710926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 354/767] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:46.083473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-db292283-e632-4d9f-958a-9d0127916882 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:46.084216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-db292283-e632-4d9f-958a-9d0127916882 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:46.091487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db292283-e632-4d9f-958a-9d0127916882 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:46.091961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db292283-e632-4d9f-958a-9d0127916882 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:46.092735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db292283-e632-4d9f-958a-9d0127916882 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:46.093168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db292283-e632-4d9f-958a-9d0127916882 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:46.232862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-db292283-e632-4d9f-958a-9d0127916882 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:46.240898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-db292283-e632-4d9f-958a-9d0127916882 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.161308 Jul 14 15:41:46.241469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 414/768] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:46 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:47.258447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d8d785c0-ed91-4718-94de-79dd2bc706ec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:47.259064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d8d785c0-ed91-4718-94de-79dd2bc706ec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:47.261557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:47.267168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8d785c0-ed91-4718-94de-79dd2bc706ec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:47.267634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8d785c0-ed91-4718-94de-79dd2bc706ec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:47.268398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8d785c0-ed91-4718-94de-79dd2bc706ec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:47.268834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8d785c0-ed91-4718-94de-79dd2bc706ec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:47.403293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d8d785c0-ed91-4718-94de-79dd2bc706ec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:47.411356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d8d785c0-ed91-4718-94de-79dd2bc706ec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.156910 Jul 14 15:41:47.412138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 355/769] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:47 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:48.429463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fe309a3e-e90e-401c-a88f-3563a157517e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:48.430071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fe309a3e-e90e-401c-a88f-3563a157517e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:48.432701 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=85,nova_api:INSERT=3 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:48.438309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe309a3e-e90e-401c-a88f-3563a157517e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:48.438751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe309a3e-e90e-401c-a88f-3563a157517e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:48.439513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe309a3e-e90e-401c-a88f-3563a157517e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:48.439971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe309a3e-e90e-401c-a88f-3563a157517e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:48.579523 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fe309a3e-e90e-401c-a88f-3563a157517e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:48.581756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:41:48.588804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fe309a3e-e90e-401c-a88f-3563a157517e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1259 microversion: 2.1 time: 0.163312 Jul 14 15:41:48.589372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 415/770] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:48 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:49.606947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-19ccea65-f933-4362-8e99-330b4c562375 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:49.607495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-19ccea65-f933-4362-8e99-330b4c562375 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:49.615142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-19ccea65-f933-4362-8e99-330b4c562375 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:49.615618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-19ccea65-f933-4362-8e99-330b4c562375 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:49.616461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-19ccea65-f933-4362-8e99-330b4c562375 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:49.616902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-19ccea65-f933-4362-8e99-330b4c562375 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:49.754264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-19ccea65-f933-4362-8e99-330b4c562375 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:49.763168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-19ccea65-f933-4362-8e99-330b4c562375 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1443 microversion: 2.1 time: 0.160087 Jul 14 15:41:49.764199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 356/771] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:49 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1443 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:49.780991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e0db665c-08c2-418a-af12-590dee35c3cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:41:49.781631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e0db665c-08c2-418a-af12-590dee35c3cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:49.790186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0db665c-08c2-418a-af12-590dee35c3cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:49.790640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0db665c-08c2-418a-af12-590dee35c3cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:49.791429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0db665c-08c2-418a-af12-590dee35c3cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:49.791900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0db665c-08c2-418a-af12-590dee35c3cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:49.928285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e0db665c-08c2-418a-af12-590dee35c3cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:41:49.935731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e0db665c-08c2-418a-af12-590dee35c3cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1443 microversion: 2.1 time: 0.158819 Jul 14 15:41:49.936297 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 416/772] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:41:49 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:41:51.733814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-52fa46ce-f197-42c6-9906-9c6dd2efd2c7 req-756ae3d9-3998-4b6b-b947-cfb59304e24d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde2fb02-e844-471d-b2bc-81fc89534875", "tag": "fed6f852-a2ff-4105-8fe1-d37f2cf9b9cd"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:51.742943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-52fa46ce-f197-42c6-9906-9c6dd2efd2c7 req-756ae3d9-3998-4b6b-b947-cfb59304e24d service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:51.743381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-52fa46ce-f197-42c6-9906-9c6dd2efd2c7 req-756ae3d9-3998-4b6b-b947-cfb59304e24d service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:51.754550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-52fa46ce-f197-42c6-9906-9c6dd2efd2c7 req-756ae3d9-3998-4b6b-b947-cfb59304e24d service nova] Creating event network-changed:fed6f852-a2ff-4105-8fe1-d37f2cf9b9cd for instance fde2fb02-e844-471d-b2bc-81fc89534875 on hv-cinder-82651 Jul 14 15:41:51.760324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-52fa46ce-f197-42c6-9906-9c6dd2efd2c7 req-756ae3d9-3998-4b6b-b947-cfb59304e24d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030235 Jul 14 15:41:51.760910 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 357/773] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:41:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:41:51.886525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0735ea42-1e1f-4698-95b6-3f3c10962d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c8af675f-e8c6-4320-9d18-1156dda9bb6f"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:41:51.887910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0735ea42-1e1f-4698-95b6-3f3c10962d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:41:51.896741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0735ea42-1e1f-4698-95b6-3f3c10962d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:51.897289 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0735ea42-1e1f-4698-95b6-3f3c10962d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:51.897693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0735ea42-1e1f-4698-95b6-3f3c10962d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:41:51.899918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0735ea42-1e1f-4698-95b6-3f3c10962d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:41:56.959193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0735ea42-1e1f-4698-95b6-3f3c10962d55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "POST /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.191555 Jul 14 15:41:56.960017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 417/774] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 15:41:51 2022] POST /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 194 bytes in 5193 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 15:42:18.035454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=5 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:18.036210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=38 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:18.144415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-758b311a-789c-4a3e-aed6-00455fc6d0ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:18.145043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-758b311a-789c-4a3e-aed6-00455fc6d0ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:18.151972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-758b311a-789c-4a3e-aed6-00455fc6d0ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:18.152422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-758b311a-789c-4a3e-aed6-00455fc6d0ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:18.153184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-758b311a-789c-4a3e-aed6-00455fc6d0ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:18.153657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-758b311a-789c-4a3e-aed6-00455fc6d0ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:18.233056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-758b311a-789c-4a3e-aed6-00455fc6d0ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lazy-loading 'services' on Instance uuid f3d96a86-d045-44b2-b298-75df12f65c86 {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:42:18.307628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-758b311a-789c-4a3e-aed6-00455fc6d0ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments/9277eb13-8d62-4610-b82c-07c55704df0f" status: 202 len: 0 microversion: 2.1 time: 0.276229 Jul 14 15:42:18.308472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 358/775] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:42:18 2022] DELETE /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments/9277eb13-8d62-4610-b82c-07c55704df0f => generated 0 bytes in 279 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:42:56.780612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=5 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:56.781392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=18,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:56.786459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2544f896-4153-48a3-8f24-d9da1733c7d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:56.787042 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2544f896-4153-48a3-8f24-d9da1733c7d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:56.794884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2544f896-4153-48a3-8f24-d9da1733c7d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:56.795336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2544f896-4153-48a3-8f24-d9da1733c7d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:56.796132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2544f896-4153-48a3-8f24-d9da1733c7d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:56.796582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2544f896-4153-48a3-8f24-d9da1733c7d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:56.829685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2544f896-4153-48a3-8f24-d9da1733c7d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments/d9ef1e62-5b7a-4c13-b6d3-7f1ca828085a" status: 200 len: 194 microversion: 2.20 time: 0.051935 Jul 14 15:42:56.830277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 418/776] 10.222.0.99 () {60 vars in 1453 bytes} [Thu Jul 14 15:42:56 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments/d9ef1e62-5b7a-4c13-b6d3-7f1ca828085a => generated 194 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:42:56.891065 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:56.891860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=9,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:42:56.896315 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-05631eef-9759-4666-a1cb-32112eec8902 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:56.896896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-05631eef-9759-4666-a1cb-32112eec8902 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:56.905623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05631eef-9759-4666-a1cb-32112eec8902 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:56.906079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05631eef-9759-4666-a1cb-32112eec8902 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:56.906846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05631eef-9759-4666-a1cb-32112eec8902 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:56.907286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05631eef-9759-4666-a1cb-32112eec8902 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:56.988807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-05631eef-9759-4666-a1cb-32112eec8902 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lazy-loading 'services' on Instance uuid e5c8cb95-bde5-4c91-99de-27aa44a822bf {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:42:57.062220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-05631eef-9759-4666-a1cb-32112eec8902 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments/d9ef1e62-5b7a-4c13-b6d3-7f1ca828085a" status: 202 len: 0 microversion: 2.20 time: 0.172497 Jul 14 15:42:57.062816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 359/777] 10.222.0.99 () {60 vars in 1456 bytes} [Thu Jul 14 15:42:56 2022] DELETE /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments/d9ef1e62-5b7a-4c13-b6d3-7f1ca828085a => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jul 14 15:42:57.071157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-64549070-4ceb-4969-9620-39f2ac16104d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:57.072261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-64549070-4ceb-4969-9620-39f2ac16104d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:57.079797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-64549070-4ceb-4969-9620-39f2ac16104d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:57.080258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-64549070-4ceb-4969-9620-39f2ac16104d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:57.081035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-64549070-4ceb-4969-9620-39f2ac16104d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:57.081479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-64549070-4ceb-4969-9620-39f2ac16104d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:57.115226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-64549070-4ceb-4969-9620-39f2ac16104d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047975 Jul 14 15:42:57.115831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 419/778] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:42:57 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:42:58.128149 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-231f9ff3-7c59-4ec7-84de-a955fdaf553a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:58.129201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-231f9ff3-7c59-4ec7-84de-a955fdaf553a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:58.135391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-231f9ff3-7c59-4ec7-84de-a955fdaf553a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:58.135897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-231f9ff3-7c59-4ec7-84de-a955fdaf553a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:58.136654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-231f9ff3-7c59-4ec7-84de-a955fdaf553a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:58.137162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-231f9ff3-7c59-4ec7-84de-a955fdaf553a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:58.170101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-231f9ff3-7c59-4ec7-84de-a955fdaf553a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046625 Jul 14 15:42:58.170680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 360/779] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:42:58 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:42:58.206088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c56c3a5c-c593-4c6b-a160-4a1f713c8c90 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:42:58.207253 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c56c3a5c-c593-4c6b-a160-4a1f713c8c90 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:58.213721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c56c3a5c-c593-4c6b-a160-4a1f713c8c90 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:58.214181 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c56c3a5c-c593-4c6b-a160-4a1f713c8c90 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:58.214948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c56c3a5c-c593-4c6b-a160-4a1f713c8c90 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:58.215481 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c56c3a5c-c593-4c6b-a160-4a1f713c8c90 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:58.241429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-c56c3a5c-c593-4c6b-a160-4a1f713c8c90 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'flavor' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:42:58.376275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c56c3a5c-c593-4c6b-a160-4a1f713c8c90 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "POST /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/action" status: 200 len: 32 microversion: 2.1 time: 0.173687 Jul 14 15:42:58.380752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 420/780] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 15:42:58 2022] POST /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/action => generated 32 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 15:42:58.385998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a3e2cc23-6703-4909-8d45-176c795a53a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:58.386853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a3e2cc23-6703-4909-8d45-176c795a53a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:58.395016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a3e2cc23-6703-4909-8d45-176c795a53a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:58.398673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a3e2cc23-6703-4909-8d45-176c795a53a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:58.400022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a3e2cc23-6703-4909-8d45-176c795a53a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:58.400632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a3e2cc23-6703-4909-8d45-176c795a53a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:58.582787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a3e2cc23-6703-4909-8d45-176c795a53a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:58.591298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a3e2cc23-6703-4909-8d45-176c795a53a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.209466 Jul 14 15:42:58.591922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 361/781] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:58 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:42:59.183477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-550b6de8-bb85-4f18-9d05-cbc0ad115166 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:59.184867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-550b6de8-bb85-4f18-9d05-cbc0ad115166 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:59.191205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-550b6de8-bb85-4f18-9d05-cbc0ad115166 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:59.191681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-550b6de8-bb85-4f18-9d05-cbc0ad115166 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:59.192440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-550b6de8-bb85-4f18-9d05-cbc0ad115166 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:59.192867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-550b6de8-bb85-4f18-9d05-cbc0ad115166 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:59.223806 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-550b6de8-bb85-4f18-9d05-cbc0ad115166 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045454 Jul 14 15:42:59.224453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 421/782] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:42:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:42:59.609731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6df2219d-d753-46c9-bc58-b45ee048222a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:42:59.610346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6df2219d-d753-46c9-bc58-b45ee048222a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:42:59.616651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6df2219d-d753-46c9-bc58-b45ee048222a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:59.617093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6df2219d-d753-46c9-bc58-b45ee048222a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:59.617931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6df2219d-d753-46c9-bc58-b45ee048222a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:42:59.618363 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6df2219d-d753-46c9-bc58-b45ee048222a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:42:59.753885 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6df2219d-d753-46c9-bc58-b45ee048222a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:42:59.761961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6df2219d-d753-46c9-bc58-b45ee048222a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157125 Jul 14 15:42:59.762808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 362/783] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:42:59 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:00.236076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7daea5ca-d824-4c74-bf54-68d09ef96800 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:00.236987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7daea5ca-d824-4c74-bf54-68d09ef96800 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:00.243403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7daea5ca-d824-4c74-bf54-68d09ef96800 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:00.243888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7daea5ca-d824-4c74-bf54-68d09ef96800 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:00.244650 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7daea5ca-d824-4c74-bf54-68d09ef96800 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:00.245087 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7daea5ca-d824-4c74-bf54-68d09ef96800 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:00.276298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7daea5ca-d824-4c74-bf54-68d09ef96800 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044358 Jul 14 15:43:00.276932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 422/784] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:00 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:00.780122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4cdc40cd-8582-451c-8c08-9463d292d880 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:00.780701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4cdc40cd-8582-451c-8c08-9463d292d880 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:00.787194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4cdc40cd-8582-451c-8c08-9463d292d880 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:00.787677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4cdc40cd-8582-451c-8c08-9463d292d880 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:00.788450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4cdc40cd-8582-451c-8c08-9463d292d880 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:00.788890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4cdc40cd-8582-451c-8c08-9463d292d880 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:00.920245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4cdc40cd-8582-451c-8c08-9463d292d880 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:00.928271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4cdc40cd-8582-451c-8c08-9463d292d880 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152580 Jul 14 15:43:00.928837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 363/785] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:00 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:01.288379 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cf6a6702-7c2b-4c93-b012-73b919f16c5b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:01.289348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cf6a6702-7c2b-4c93-b012-73b919f16c5b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:01.296117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf6a6702-7c2b-4c93-b012-73b919f16c5b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:01.296568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf6a6702-7c2b-4c93-b012-73b919f16c5b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:01.297324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf6a6702-7c2b-4c93-b012-73b919f16c5b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:01.297757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf6a6702-7c2b-4c93-b012-73b919f16c5b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:01.326508 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cf6a6702-7c2b-4c93-b012-73b919f16c5b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042074 Jul 14 15:43:01.327034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 423/786] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:01 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:01.945652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d0693bbe-29c9-4c56-a3d9-2c195c5e01c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:01.946292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d0693bbe-29c9-4c56-a3d9-2c195c5e01c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:01.952708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d0693bbe-29c9-4c56-a3d9-2c195c5e01c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:01.953160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d0693bbe-29c9-4c56-a3d9-2c195c5e01c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:01.953917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d0693bbe-29c9-4c56-a3d9-2c195c5e01c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:01.954855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d0693bbe-29c9-4c56-a3d9-2c195c5e01c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:02.085308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d0693bbe-29c9-4c56-a3d9-2c195c5e01c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:02.093237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d0693bbe-29c9-4c56-a3d9-2c195c5e01c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151494 Jul 14 15:43:02.093798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 364/787] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:01 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:02.338221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e849fd5f-6862-4c11-915b-cb015cd31af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:02.339039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e849fd5f-6862-4c11-915b-cb015cd31af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:02.345932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e849fd5f-6862-4c11-915b-cb015cd31af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:02.346379 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e849fd5f-6862-4c11-915b-cb015cd31af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:02.347138 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e849fd5f-6862-4c11-915b-cb015cd31af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:02.347570 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e849fd5f-6862-4c11-915b-cb015cd31af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:02.375459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e849fd5f-6862-4c11-915b-cb015cd31af0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041275 Jul 14 15:43:02.376033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 424/788] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:03.111942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6a832aba-b056-4818-843b-10284eba85aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:03.112555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6a832aba-b056-4818-843b-10284eba85aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:03.118573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a832aba-b056-4818-843b-10284eba85aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:03.119026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a832aba-b056-4818-843b-10284eba85aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:03.119859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a832aba-b056-4818-843b-10284eba85aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:03.120305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a832aba-b056-4818-843b-10284eba85aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:03.257215 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6a832aba-b056-4818-843b-10284eba85aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:03.265266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6a832aba-b056-4818-843b-10284eba85aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.158135 Jul 14 15:43:03.265833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 365/789] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:03 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:03.387767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-33981e99-3dfb-4001-8ee1-260dbcc4df27 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:03.388679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-33981e99-3dfb-4001-8ee1-260dbcc4df27 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:03.395140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33981e99-3dfb-4001-8ee1-260dbcc4df27 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:03.395582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33981e99-3dfb-4001-8ee1-260dbcc4df27 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:03.396364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33981e99-3dfb-4001-8ee1-260dbcc4df27 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:03.396799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33981e99-3dfb-4001-8ee1-260dbcc4df27 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:03.425645 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-33981e99-3dfb-4001-8ee1-260dbcc4df27 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041933 Jul 14 15:43:03.426194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 425/790] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:04.284517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d06f4f78-7b1c-4cb6-b4c8-4e08ecc59c82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:04.285181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d06f4f78-7b1c-4cb6-b4c8-4e08ecc59c82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:04.292033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d06f4f78-7b1c-4cb6-b4c8-4e08ecc59c82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:04.292495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d06f4f78-7b1c-4cb6-b4c8-4e08ecc59c82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:04.293249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d06f4f78-7b1c-4cb6-b4c8-4e08ecc59c82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:04.293684 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d06f4f78-7b1c-4cb6-b4c8-4e08ecc59c82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:04.438022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cef136ce-2894-4f89-807b-8e3f55cc7de6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:04.439441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cef136ce-2894-4f89-807b-8e3f55cc7de6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:04.446253 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cef136ce-2894-4f89-807b-8e3f55cc7de6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:04.446702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cef136ce-2894-4f89-807b-8e3f55cc7de6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:04.447475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cef136ce-2894-4f89-807b-8e3f55cc7de6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:04.447942 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cef136ce-2894-4f89-807b-8e3f55cc7de6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:04.480537 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cef136ce-2894-4f89-807b-8e3f55cc7de6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046427 Jul 14 15:43:04.481029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 426/791] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:04.663184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d06f4f78-7b1c-4cb6-b4c8-4e08ecc59c82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:04.671158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d06f4f78-7b1c-4cb6-b4c8-4e08ecc59c82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.392035 Jul 14 15:43:04.671862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 366/792] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:04 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:05.492931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f34eb1d9-6081-4578-938f-589530460ef3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:05.493840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f34eb1d9-6081-4578-938f-589530460ef3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:05.500263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f34eb1d9-6081-4578-938f-589530460ef3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:05.500714 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f34eb1d9-6081-4578-938f-589530460ef3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:05.502150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f34eb1d9-6081-4578-938f-589530460ef3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:05.502584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f34eb1d9-6081-4578-938f-589530460ef3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:05.530905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f34eb1d9-6081-4578-938f-589530460ef3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041968 Jul 14 15:43:05.531463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 427/793] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:05 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:43:05.689798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b6d4404b-4b9d-4a78-a18d-c426da866fd5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:05.690447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b6d4404b-4b9d-4a78-a18d-c426da866fd5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:05.696895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6d4404b-4b9d-4a78-a18d-c426da866fd5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:05.697347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6d4404b-4b9d-4a78-a18d-c426da866fd5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:05.698103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6d4404b-4b9d-4a78-a18d-c426da866fd5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:05.698611 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6d4404b-4b9d-4a78-a18d-c426da866fd5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:05.832398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b6d4404b-4b9d-4a78-a18d-c426da866fd5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:05.841281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b6d4404b-4b9d-4a78-a18d-c426da866fd5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.156421 Jul 14 15:43:05.841855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 367/794] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:05 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:06.542339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cc9a5695-023a-49d9-a0c5-a8cbed47a1a3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:06.543250 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cc9a5695-023a-49d9-a0c5-a8cbed47a1a3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:06.550123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc9a5695-023a-49d9-a0c5-a8cbed47a1a3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:06.550595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc9a5695-023a-49d9-a0c5-a8cbed47a1a3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:06.551341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc9a5695-023a-49d9-a0c5-a8cbed47a1a3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:06.551809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc9a5695-023a-49d9-a0c5-a8cbed47a1a3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:06.581252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cc9a5695-023a-49d9-a0c5-a8cbed47a1a3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043118 Jul 14 15:43:06.581803 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 428/795] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:06 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:06.859584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-58f5cecf-7820-495b-b247-dcddbcee86d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:06.860219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-58f5cecf-7820-495b-b247-dcddbcee86d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:06.866905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-58f5cecf-7820-495b-b247-dcddbcee86d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:06.867355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-58f5cecf-7820-495b-b247-dcddbcee86d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:06.868160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-58f5cecf-7820-495b-b247-dcddbcee86d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:06.868698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-58f5cecf-7820-495b-b247-dcddbcee86d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:07.002191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-58f5cecf-7820-495b-b247-dcddbcee86d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:07.010138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-58f5cecf-7820-495b-b247-dcddbcee86d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154340 Jul 14 15:43:07.010709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 368/796] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:06 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:07.593190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fd5f53b9-f99c-4224-a844-90d2da5edc1c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:07.594021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fd5f53b9-f99c-4224-a844-90d2da5edc1c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:07.601505 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd5f53b9-f99c-4224-a844-90d2da5edc1c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:07.601956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd5f53b9-f99c-4224-a844-90d2da5edc1c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:07.602719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd5f53b9-f99c-4224-a844-90d2da5edc1c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:07.603158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd5f53b9-f99c-4224-a844-90d2da5edc1c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:07.633037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fd5f53b9-f99c-4224-a844-90d2da5edc1c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043945 Jul 14 15:43:07.633896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 429/797] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:07 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:43:08.027733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-13f1f780-2b0a-4300-9b2b-40dbc06f1ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:08.028337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-13f1f780-2b0a-4300-9b2b-40dbc06f1ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:08.035688 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13f1f780-2b0a-4300-9b2b-40dbc06f1ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:08.036131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13f1f780-2b0a-4300-9b2b-40dbc06f1ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:08.036889 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13f1f780-2b0a-4300-9b2b-40dbc06f1ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:08.037320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13f1f780-2b0a-4300-9b2b-40dbc06f1ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:08.171243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-13f1f780-2b0a-4300-9b2b-40dbc06f1ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:08.179284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-13f1f780-2b0a-4300-9b2b-40dbc06f1ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155753 Jul 14 15:43:08.179886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 369/798] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:08 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:08.644845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1eb78060-ce3f-4a3b-8e37-85ef39612618 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:08.645807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1eb78060-ce3f-4a3b-8e37-85ef39612618 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:08.652762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1eb78060-ce3f-4a3b-8e37-85ef39612618 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:08.653213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1eb78060-ce3f-4a3b-8e37-85ef39612618 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:08.653993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1eb78060-ce3f-4a3b-8e37-85ef39612618 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:08.654438 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1eb78060-ce3f-4a3b-8e37-85ef39612618 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:08.686272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1eb78060-ce3f-4a3b-8e37-85ef39612618 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045428 Jul 14 15:43:08.686843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 430/799] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:08 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:09.197422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7758caaa-b07f-44c7-80e8-ef96c2a4f63a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:09.198288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7758caaa-b07f-44c7-80e8-ef96c2a4f63a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:09.204603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7758caaa-b07f-44c7-80e8-ef96c2a4f63a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:09.205055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7758caaa-b07f-44c7-80e8-ef96c2a4f63a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:09.206396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7758caaa-b07f-44c7-80e8-ef96c2a4f63a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:09.206837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7758caaa-b07f-44c7-80e8-ef96c2a4f63a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:09.348121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7758caaa-b07f-44c7-80e8-ef96c2a4f63a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:09.356184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7758caaa-b07f-44c7-80e8-ef96c2a4f63a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.162773 Jul 14 15:43:09.356753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 370/800] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:09 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:09.698236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5745dd84-8239-4051-afb4-a2a8d53c20d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:09.699158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5745dd84-8239-4051-afb4-a2a8d53c20d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:09.705728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5745dd84-8239-4051-afb4-a2a8d53c20d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:09.706376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5745dd84-8239-4051-afb4-a2a8d53c20d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:09.707129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5745dd84-8239-4051-afb4-a2a8d53c20d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:09.707568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5745dd84-8239-4051-afb4-a2a8d53c20d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:09.736520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5745dd84-8239-4051-afb4-a2a8d53c20d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042168 Jul 14 15:43:09.738021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 431/801] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:09 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:10.373432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-eb481c12-1941-4fc9-8688-0675ef807203 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:10.374032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eb481c12-1941-4fc9-8688-0675ef807203 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:10.381121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb481c12-1941-4fc9-8688-0675ef807203 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:10.381543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb481c12-1941-4fc9-8688-0675ef807203 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:10.382294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb481c12-1941-4fc9-8688-0675ef807203 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:10.382724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb481c12-1941-4fc9-8688-0675ef807203 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:10.511461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-eb481c12-1941-4fc9-8688-0675ef807203 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:10.520285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-eb481c12-1941-4fc9-8688-0675ef807203 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150668 Jul 14 15:43:10.520952 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 371/802] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:10 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:10.749082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f16a741d-9948-4a67-a8df-56f877b710ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:10.749998 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f16a741d-9948-4a67-a8df-56f877b710ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:10.757300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f16a741d-9948-4a67-a8df-56f877b710ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:10.757785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f16a741d-9948-4a67-a8df-56f877b710ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:10.758550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f16a741d-9948-4a67-a8df-56f877b710ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:10.758994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f16a741d-9948-4a67-a8df-56f877b710ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:10.775855 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:10.790766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f16a741d-9948-4a67-a8df-56f877b710ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045630 Jul 14 15:43:10.791324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 432/803] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:10 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:11.537865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-79c9b948-28d6-4940-8caf-ee0b4ac1f907 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:11.538475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-79c9b948-28d6-4940-8caf-ee0b4ac1f907 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:11.544981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79c9b948-28d6-4940-8caf-ee0b4ac1f907 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:11.545425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79c9b948-28d6-4940-8caf-ee0b4ac1f907 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:11.546177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79c9b948-28d6-4940-8caf-ee0b4ac1f907 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:11.546614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79c9b948-28d6-4940-8caf-ee0b4ac1f907 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:11.682100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-79c9b948-28d6-4940-8caf-ee0b4ac1f907 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:11.690502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-79c9b948-28d6-4940-8caf-ee0b4ac1f907 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155910 Jul 14 15:43:11.691213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 372/804] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:11 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:11.802655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7cdd7aab-7a86-4390-808f-230f1c42dfe3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:11.803637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7cdd7aab-7a86-4390-808f-230f1c42dfe3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:11.812651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7cdd7aab-7a86-4390-808f-230f1c42dfe3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:11.813108 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7cdd7aab-7a86-4390-808f-230f1c42dfe3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:11.813888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7cdd7aab-7a86-4390-808f-230f1c42dfe3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:11.814332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7cdd7aab-7a86-4390-808f-230f1c42dfe3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:11.843556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7cdd7aab-7a86-4390-808f-230f1c42dfe3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045017 Jul 14 15:43:11.844143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 433/805] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:11 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:12.708583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d34654e4-50b2-486b-91ee-82307ece7373 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:12.709228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d34654e4-50b2-486b-91ee-82307ece7373 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:12.715805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d34654e4-50b2-486b-91ee-82307ece7373 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:12.716254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d34654e4-50b2-486b-91ee-82307ece7373 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:12.717012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d34654e4-50b2-486b-91ee-82307ece7373 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:12.717448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d34654e4-50b2-486b-91ee-82307ece7373 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:12.849091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d34654e4-50b2-486b-91ee-82307ece7373 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:12.855232 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ffe236e8-7d36-4cad-b049-16cdf6801056 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:12.856573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ffe236e8-7d36-4cad-b049-16cdf6801056 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:12.859007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d34654e4-50b2-486b-91ee-82307ece7373 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154586 Jul 14 15:43:12.859629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 373/806] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:12 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:12.864061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ffe236e8-7d36-4cad-b049-16cdf6801056 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:12.864512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ffe236e8-7d36-4cad-b049-16cdf6801056 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:12.865278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ffe236e8-7d36-4cad-b049-16cdf6801056 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:12.865715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ffe236e8-7d36-4cad-b049-16cdf6801056 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:12.907729 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ffe236e8-7d36-4cad-b049-16cdf6801056 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.056247 Jul 14 15:43:12.909094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 434/807] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:12 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:43:13.878448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0bc0693c-49f7-40f3-ae02-81f2d19ef04a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:13.879153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0bc0693c-49f7-40f3-ae02-81f2d19ef04a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:13.885712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0bc0693c-49f7-40f3-ae02-81f2d19ef04a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:13.886165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0bc0693c-49f7-40f3-ae02-81f2d19ef04a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:13.886927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0bc0693c-49f7-40f3-ae02-81f2d19ef04a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:13.887379 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0bc0693c-49f7-40f3-ae02-81f2d19ef04a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:13.919916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8e5349fe-ba60-417d-8aa8-c02f619716b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:13.920825 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8e5349fe-ba60-417d-8aa8-c02f619716b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:13.928095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e5349fe-ba60-417d-8aa8-c02f619716b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:13.928540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e5349fe-ba60-417d-8aa8-c02f619716b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:13.929310 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e5349fe-ba60-417d-8aa8-c02f619716b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:13.929744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e5349fe-ba60-417d-8aa8-c02f619716b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:13.959152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8e5349fe-ba60-417d-8aa8-c02f619716b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043181 Jul 14 15:43:13.959956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 435/808] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:13 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:43:14.024034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0bc0693c-49f7-40f3-ae02-81f2d19ef04a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:14.027777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:14.032827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0bc0693c-49f7-40f3-ae02-81f2d19ef04a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.158957 Jul 14 15:43:14.033407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 374/809] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:13 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:14.970196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e6d83e37-57e6-471a-9b9e-32423528b543 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:14.971358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e6d83e37-57e6-471a-9b9e-32423528b543 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:14.977932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6d83e37-57e6-471a-9b9e-32423528b543 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:14.978377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6d83e37-57e6-471a-9b9e-32423528b543 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:14.979146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6d83e37-57e6-471a-9b9e-32423528b543 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:14.979580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6d83e37-57e6-471a-9b9e-32423528b543 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:15.010004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e6d83e37-57e6-471a-9b9e-32423528b543 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043749 Jul 14 15:43:15.010568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 436/810] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:14 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:15.050670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8b3bc958-3204-4476-9ec2-1e38ce69a0ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:15.051286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8b3bc958-3204-4476-9ec2-1e38ce69a0ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:15.058549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b3bc958-3204-4476-9ec2-1e38ce69a0ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:15.058998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b3bc958-3204-4476-9ec2-1e38ce69a0ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:15.059792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b3bc958-3204-4476-9ec2-1e38ce69a0ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:15.060233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b3bc958-3204-4476-9ec2-1e38ce69a0ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:15.193514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8b3bc958-3204-4476-9ec2-1e38ce69a0ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:15.201529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8b3bc958-3204-4476-9ec2-1e38ce69a0ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155517 Jul 14 15:43:15.202104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 375/811] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:15 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:16.022258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-19bfc455-9a6b-4889-b48f-a7ce311fae20 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:16.023169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-19bfc455-9a6b-4889-b48f-a7ce311fae20 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:16.029841 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-19bfc455-9a6b-4889-b48f-a7ce311fae20 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:16.030291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-19bfc455-9a6b-4889-b48f-a7ce311fae20 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:16.031047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-19bfc455-9a6b-4889-b48f-a7ce311fae20 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:16.031480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-19bfc455-9a6b-4889-b48f-a7ce311fae20 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:16.060835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-19bfc455-9a6b-4889-b48f-a7ce311fae20 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043063 Jul 14 15:43:16.061380 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 437/812] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:16 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:16.219315 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c075ec0a-23d4-4bf6-a012-e5e2eb03e84e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:16.219952 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c075ec0a-23d4-4bf6-a012-e5e2eb03e84e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:16.227058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c075ec0a-23d4-4bf6-a012-e5e2eb03e84e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:16.227501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c075ec0a-23d4-4bf6-a012-e5e2eb03e84e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:16.228293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c075ec0a-23d4-4bf6-a012-e5e2eb03e84e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:16.228730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c075ec0a-23d4-4bf6-a012-e5e2eb03e84e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:16.361019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c075ec0a-23d4-4bf6-a012-e5e2eb03e84e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:16.370437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c075ec0a-23d4-4bf6-a012-e5e2eb03e84e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154587 Jul 14 15:43:16.371443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 376/813] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:16 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:17.073015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4beb9568-c2cb-4b8b-90e3-0ed771f8b89e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:17.073927 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4beb9568-c2cb-4b8b-90e3-0ed771f8b89e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:17.081160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4beb9568-c2cb-4b8b-90e3-0ed771f8b89e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:17.081160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4beb9568-c2cb-4b8b-90e3-0ed771f8b89e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:17.081885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4beb9568-c2cb-4b8b-90e3-0ed771f8b89e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:17.082331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4beb9568-c2cb-4b8b-90e3-0ed771f8b89e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:17.111622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4beb9568-c2cb-4b8b-90e3-0ed771f8b89e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042549 Jul 14 15:43:17.113093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 438/814] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:17 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:17.390421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e1921b6-b4f1-4a83-8594-af51701ff5a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:17.391033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e1921b6-b4f1-4a83-8594-af51701ff5a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:17.398776 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e1921b6-b4f1-4a83-8594-af51701ff5a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:17.399231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e1921b6-b4f1-4a83-8594-af51701ff5a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:17.400136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e1921b6-b4f1-4a83-8594-af51701ff5a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:17.400577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e1921b6-b4f1-4a83-8594-af51701ff5a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:17.530343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e1921b6-b4f1-4a83-8594-af51701ff5a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:17.538437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e1921b6-b4f1-4a83-8594-af51701ff5a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151994 Jul 14 15:43:17.539008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 377/815] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:17 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:18.124482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c0edeffa-1f0c-442c-83d5-bee27427e3bd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:18.125399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c0edeffa-1f0c-442c-83d5-bee27427e3bd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:18.132477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0edeffa-1f0c-442c-83d5-bee27427e3bd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:18.132925 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0edeffa-1f0c-442c-83d5-bee27427e3bd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:18.133766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0edeffa-1f0c-442c-83d5-bee27427e3bd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:18.135096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0edeffa-1f0c-442c-83d5-bee27427e3bd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:18.163909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c0edeffa-1f0c-442c-83d5-bee27427e3bd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043354 Jul 14 15:43:18.164462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 439/816] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:18 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:18.555256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b017603e-6cd2-4f2b-8c34-da7762975ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:18.555900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b017603e-6cd2-4f2b-8c34-da7762975ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:18.562310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b017603e-6cd2-4f2b-8c34-da7762975ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:18.562753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b017603e-6cd2-4f2b-8c34-da7762975ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:18.563501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b017603e-6cd2-4f2b-8c34-da7762975ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:18.564067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b017603e-6cd2-4f2b-8c34-da7762975ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:18.697851 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b017603e-6cd2-4f2b-8c34-da7762975ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:18.706308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b017603e-6cd2-4f2b-8c34-da7762975ef8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154768 Jul 14 15:43:18.706744 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 378/817] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:18 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:19.176294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f5c37a70-d0bb-4204-89e9-71a26699d394 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:19.177263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f5c37a70-d0bb-4204-89e9-71a26699d394 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:19.183804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f5c37a70-d0bb-4204-89e9-71a26699d394 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:19.184322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f5c37a70-d0bb-4204-89e9-71a26699d394 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:19.185080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f5c37a70-d0bb-4204-89e9-71a26699d394 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:19.185596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f5c37a70-d0bb-4204-89e9-71a26699d394 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:19.216233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f5c37a70-d0bb-4204-89e9-71a26699d394 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044555 Jul 14 15:43:19.216802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 440/818] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:19 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:19.723143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cc4f5123-92fb-4551-98c7-e4076401ad15 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:19.723811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cc4f5123-92fb-4551-98c7-e4076401ad15 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:19.730288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc4f5123-92fb-4551-98c7-e4076401ad15 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:19.730727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc4f5123-92fb-4551-98c7-e4076401ad15 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:19.731477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc4f5123-92fb-4551-98c7-e4076401ad15 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:19.731947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc4f5123-92fb-4551-98c7-e4076401ad15 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:19.865781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cc4f5123-92fb-4551-98c7-e4076401ad15 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:19.873842 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cc4f5123-92fb-4551-98c7-e4076401ad15 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1717 microversion: 2.1 time: 0.154511 Jul 14 15:43:19.874411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 379/819] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:19 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1717 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:19.929923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-44bf5656-b636-4b22-ae30-d0c9c6c66197 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:19.930420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-44bf5656-b636-4b22-ae30-d0c9c6c66197 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:19.936563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-44bf5656-b636-4b22-ae30-d0c9c6c66197 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:19.937021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-44bf5656-b636-4b22-ae30-d0c9c6c66197 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:19.937796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-44bf5656-b636-4b22-ae30-d0c9c6c66197 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:19.938719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-44bf5656-b636-4b22-ae30-d0c9c6c66197 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:20.063346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-44bf5656-b636-4b22-ae30-d0c9c6c66197 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Cannot 'detach_volume' instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb while it is in vm_state rescued Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-44bf5656-b636-4b22-ae30-d0c9c6c66197 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f HTTP/1.1 Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:43:20.064993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:43:20.067734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:43:20.067734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:43:20.067734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:43:20.067734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:43:20.067734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:43:20.067734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:43:20.067734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:43:20.067734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 15:43:20.067734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:43:20.067734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 15:43:20.067734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Cannot 'detach_volume' instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb while it is in vm_state rescued Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'server_id': 'd4e7b59f-1959-4ed1-ba26-c70f4d9336bb', 'id': 'c8af675f-e8c6-4320-9d18-1156dda9bb6f'} Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb in vm_state rescued. Cannot detach_volume while the instance is in this state. Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:43:20.068540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb while it is in vm_state rescued Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb while it is in vm_state rescued Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:43:20.070312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-44bf5656-b636-4b22-ae30-d0c9c6c66197 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 409 to user: Cannot 'detach_volume' instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb while it is in vm_state rescued {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:43:20.071631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-44bf5656-b636-4b22-ae30-d0c9c6c66197 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f" status: 409 len: 152 microversion: 2.1 time: 0.141861 Jul 14 15:43:20.071631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 441/820] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:43:19 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f => generated 152 bytes in 144 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jul 14 15:43:20.076473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-260033cf-2734-448d-8409-1e954807b164 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:20.076998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-260033cf-2734-448d-8409-1e954807b164 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:20.083322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-260033cf-2734-448d-8409-1e954807b164 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:20.083799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-260033cf-2734-448d-8409-1e954807b164 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:20.084562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-260033cf-2734-448d-8409-1e954807b164 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:20.084995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-260033cf-2734-448d-8409-1e954807b164 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:20.159936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-260033cf-2734-448d-8409-1e954807b164 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "POST /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/action" status: 202 len: 0 microversion: 2.1 time: 0.086162 Jul 14 15:43:20.161029 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 380/821] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 15:43:20 2022] POST /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:43:20.169097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-892abb95-f70c-484b-8205-57e49be25b65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:20.170639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-892abb95-f70c-484b-8205-57e49be25b65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:20.177555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-892abb95-f70c-484b-8205-57e49be25b65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:20.178241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-892abb95-f70c-484b-8205-57e49be25b65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:20.178762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-892abb95-f70c-484b-8205-57e49be25b65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:20.179195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-892abb95-f70c-484b-8205-57e49be25b65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:20.230094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-13d76b2b-3b58-4aaf-b08f-edb3078101ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:20.231176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-13d76b2b-3b58-4aaf-b08f-edb3078101ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:20.238421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13d76b2b-3b58-4aaf-b08f-edb3078101ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:20.238917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13d76b2b-3b58-4aaf-b08f-edb3078101ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:20.239644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13d76b2b-3b58-4aaf-b08f-edb3078101ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:20.240073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13d76b2b-3b58-4aaf-b08f-edb3078101ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:20.272463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-13d76b2b-3b58-4aaf-b08f-edb3078101ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047776 Jul 14 15:43:20.273546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 381/822] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:43:20.323980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-892abb95-f70c-484b-8205-57e49be25b65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:20.332651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-892abb95-f70c-484b-8205-57e49be25b65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1725 microversion: 2.1 time: 0.167463 Jul 14 15:43:20.333234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 442/823] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:20 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:21.285660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fc99d5ba-5632-47a6-a9fa-342b4bcc952b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:21.286483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fc99d5ba-5632-47a6-a9fa-342b4bcc952b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:21.293129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fc99d5ba-5632-47a6-a9fa-342b4bcc952b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:21.293583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fc99d5ba-5632-47a6-a9fa-342b4bcc952b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:21.294350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fc99d5ba-5632-47a6-a9fa-342b4bcc952b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:21.294793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fc99d5ba-5632-47a6-a9fa-342b4bcc952b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:21.323386 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fc99d5ba-5632-47a6-a9fa-342b4bcc952b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042477 Jul 14 15:43:21.323974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 382/824] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:21 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:21.351980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9828121d-32b6-4526-9dbd-7368c2dbbfb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:21.352685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9828121d-32b6-4526-9dbd-7368c2dbbfb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:21.360037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9828121d-32b6-4526-9dbd-7368c2dbbfb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:21.360519 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9828121d-32b6-4526-9dbd-7368c2dbbfb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:21.361342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9828121d-32b6-4526-9dbd-7368c2dbbfb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:21.361779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9828121d-32b6-4526-9dbd-7368c2dbbfb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:21.493819 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9828121d-32b6-4526-9dbd-7368c2dbbfb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:21.501652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9828121d-32b6-4526-9dbd-7368c2dbbfb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1725 microversion: 2.1 time: 0.155690 Jul 14 15:43:21.502256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 443/825] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:21 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:22.339782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7d8236eb-5980-4376-98ad-1c463fc3418f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:22.340615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7d8236eb-5980-4376-98ad-1c463fc3418f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:22.348351 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d8236eb-5980-4376-98ad-1c463fc3418f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:22.348803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d8236eb-5980-4376-98ad-1c463fc3418f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:22.349573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d8236eb-5980-4376-98ad-1c463fc3418f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:22.350011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d8236eb-5980-4376-98ad-1c463fc3418f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:22.383859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7d8236eb-5980-4376-98ad-1c463fc3418f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.053180 Jul 14 15:43:22.384484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 383/826] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:22 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:22.519362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3a0dc3bc-985e-4d18-9ab1-cb8ce06e1879 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:22.520084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3a0dc3bc-985e-4d18-9ab1-cb8ce06e1879 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:22.526838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3a0dc3bc-985e-4d18-9ab1-cb8ce06e1879 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:22.527294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3a0dc3bc-985e-4d18-9ab1-cb8ce06e1879 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:22.528094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3a0dc3bc-985e-4d18-9ab1-cb8ce06e1879 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:22.528537 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3a0dc3bc-985e-4d18-9ab1-cb8ce06e1879 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:22.662439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3a0dc3bc-985e-4d18-9ab1-cb8ce06e1879 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:22.670441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3a0dc3bc-985e-4d18-9ab1-cb8ce06e1879 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1725 microversion: 2.1 time: 0.155098 Jul 14 15:43:22.671010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 444/827] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:22 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:23.397203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6168526f-6877-4236-965a-d32ff6e2596a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:23.398221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6168526f-6877-4236-965a-d32ff6e2596a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:23.405074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6168526f-6877-4236-965a-d32ff6e2596a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:23.405513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6168526f-6877-4236-965a-d32ff6e2596a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:23.406267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6168526f-6877-4236-965a-d32ff6e2596a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:23.406704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6168526f-6877-4236-965a-d32ff6e2596a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:23.436398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6168526f-6877-4236-965a-d32ff6e2596a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043604 Jul 14 15:43:23.436944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 384/828] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:23 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:23.687431 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7b01a0be-986b-438c-a645-07fe7669d3be tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:23.688057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7b01a0be-986b-438c-a645-07fe7669d3be tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:23.695461 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b01a0be-986b-438c-a645-07fe7669d3be tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:23.695989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b01a0be-986b-438c-a645-07fe7669d3be tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:23.696758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b01a0be-986b-438c-a645-07fe7669d3be tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:23.697199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b01a0be-986b-438c-a645-07fe7669d3be tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:23.830353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7b01a0be-986b-438c-a645-07fe7669d3be tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:23.838966 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7b01a0be-986b-438c-a645-07fe7669d3be tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1731 microversion: 2.1 time: 0.155445 Jul 14 15:43:23.839533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 445/829] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:23 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:23.856417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-649ffc9a-fc02-4732-b861-8f9abff7e8a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:23.857054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-649ffc9a-fc02-4732-b861-8f9abff7e8a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:23.863927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-649ffc9a-fc02-4732-b861-8f9abff7e8a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:23.864444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-649ffc9a-fc02-4732-b861-8f9abff7e8a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:23.865197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-649ffc9a-fc02-4732-b861-8f9abff7e8a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:23.865742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-649ffc9a-fc02-4732-b861-8f9abff7e8a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:23.949038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-649ffc9a-fc02-4732-b861-8f9abff7e8a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.096460 Jul 14 15:43:23.949646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 385/830] 10.222.0.99 () {58 vars in 1274 bytes} [Thu Jul 14 15:43:23 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-interface => generated 285 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:43:24.448280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-779bc320-8222-44df-865d-e64e8f9f657c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:24.449207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-779bc320-8222-44df-865d-e64e8f9f657c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:24.455606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-779bc320-8222-44df-865d-e64e8f9f657c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:24.456024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-779bc320-8222-44df-865d-e64e8f9f657c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:24.456887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-779bc320-8222-44df-865d-e64e8f9f657c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:24.457330 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-779bc320-8222-44df-865d-e64e8f9f657c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:24.492214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-779bc320-8222-44df-865d-e64e8f9f657c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047835 Jul 14 15:43:24.493014 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 446/831] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:24 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:24.967921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-9f4ded22-bfff-4132-ba7f-33fb50cad6ba req-a78cba06-8a0b-4acf-8cf8-2e5b836a64bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e7b59f-1959-4ed1-ba26-c70f4d9336bb", "tag": "6d596c25-d79d-4ae5-aad6-5b159dc0f3f0"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:24.977138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-9f4ded22-bfff-4132-ba7f-33fb50cad6ba req-a78cba06-8a0b-4acf-8cf8-2e5b836a64bc service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:24.977594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-9f4ded22-bfff-4132-ba7f-33fb50cad6ba req-a78cba06-8a0b-4acf-8cf8-2e5b836a64bc service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:24.989316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-9f4ded22-bfff-4132-ba7f-33fb50cad6ba req-a78cba06-8a0b-4acf-8cf8-2e5b836a64bc service nova] Creating event network-changed:6d596c25-d79d-4ae5-aad6-5b159dc0f3f0 for instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb on hv-cinder-82651 Jul 14 15:43:25.001065 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-9f4ded22-bfff-4132-ba7f-33fb50cad6ba req-a78cba06-8a0b-4acf-8cf8-2e5b836a64bc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099888 Jul 14 15:43:25.002160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 386/832] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:43:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:43:25.504038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-09ab0a82-cc52-4ada-9e8a-43f50d447450 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:25.505644 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-09ab0a82-cc52-4ada-9e8a-43f50d447450 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:25.511982 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-09ab0a82-cc52-4ada-9e8a-43f50d447450 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:25.512433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-09ab0a82-cc52-4ada-9e8a-43f50d447450 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:25.513306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-09ab0a82-cc52-4ada-9e8a-43f50d447450 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:25.513749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-09ab0a82-cc52-4ada-9e8a-43f50d447450 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:25.545550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-09ab0a82-cc52-4ada-9e8a-43f50d447450 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046043 Jul 14 15:43:25.546756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 447/833] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:25 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:26.558381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9ba872a8-501c-4d91-bc2e-37dd0f00f248 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:26.559375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9ba872a8-501c-4d91-bc2e-37dd0f00f248 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:26.566432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9ba872a8-501c-4d91-bc2e-37dd0f00f248 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:26.566987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9ba872a8-501c-4d91-bc2e-37dd0f00f248 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:26.567785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9ba872a8-501c-4d91-bc2e-37dd0f00f248 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:26.568224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9ba872a8-501c-4d91-bc2e-37dd0f00f248 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:26.597439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9ba872a8-501c-4d91-bc2e-37dd0f00f248 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043464 Jul 14 15:43:26.597998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 387/834] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:26 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:43:27.016574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-bd1bf726-4722-4504-a1c7-92105d178394 req-89be7ab1-86ac-43c7-8caf-103e06dac318 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4e7b59f-1959-4ed1-ba26-c70f4d9336bb", "tag": "6d596c25-d79d-4ae5-aad6-5b159dc0f3f0"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:43:27.021065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=61 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:27.027179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-bd1bf726-4722-4504-a1c7-92105d178394 req-89be7ab1-86ac-43c7-8caf-103e06dac318 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:27.027645 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-bd1bf726-4722-4504-a1c7-92105d178394 req-89be7ab1-86ac-43c7-8caf-103e06dac318 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:27.040646 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-bd1bf726-4722-4504-a1c7-92105d178394 req-89be7ab1-86ac-43c7-8caf-103e06dac318 service nova] Creating event network-changed:6d596c25-d79d-4ae5-aad6-5b159dc0f3f0 for instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb on hv-cinder-82651 Jul 14 15:43:27.045753 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-bd1bf726-4722-4504-a1c7-92105d178394 req-89be7ab1-86ac-43c7-8caf-103e06dac318 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032819 Jul 14 15:43:27.046326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 448/835] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:43:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:43:27.609602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7543e813-5f3f-4507-bd0e-5d48a382c90f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:27.610534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7543e813-5f3f-4507-bd0e-5d48a382c90f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:27.613754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=59 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:27.619258 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7543e813-5f3f-4507-bd0e-5d48a382c90f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:27.619742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7543e813-5f3f-4507-bd0e-5d48a382c90f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:27.620518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7543e813-5f3f-4507-bd0e-5d48a382c90f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:27.620966 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7543e813-5f3f-4507-bd0e-5d48a382c90f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:27.649945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7543e813-5f3f-4507-bd0e-5d48a382c90f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044215 Jul 14 15:43:27.650431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 388/836] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:28.662793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3bc1e8c1-f21e-4db9-a06f-50c924d3db17 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:28.663830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3bc1e8c1-f21e-4db9-a06f-50c924d3db17 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:28.670095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bc1e8c1-f21e-4db9-a06f-50c924d3db17 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:28.670545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bc1e8c1-f21e-4db9-a06f-50c924d3db17 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:28.671309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bc1e8c1-f21e-4db9-a06f-50c924d3db17 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:28.671781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bc1e8c1-f21e-4db9-a06f-50c924d3db17 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:28.696875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:28.702046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3bc1e8c1-f21e-4db9-a06f-50c924d3db17 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044185 Jul 14 15:43:28.702603 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 449/837] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:28 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:29.713669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1113d6be-ce7a-446b-9607-8d6919e23036 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:29.714635 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1113d6be-ce7a-446b-9607-8d6919e23036 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:29.721560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1113d6be-ce7a-446b-9607-8d6919e23036 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:29.722056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1113d6be-ce7a-446b-9607-8d6919e23036 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:29.722859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1113d6be-ce7a-446b-9607-8d6919e23036 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:29.723301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1113d6be-ce7a-446b-9607-8d6919e23036 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:29.754506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1113d6be-ce7a-446b-9607-8d6919e23036 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044217 Jul 14 15:43:29.755075 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 389/838] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:29 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:30.766371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7310f155-8bb5-46ec-a7d7-2f70bd974745 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:30.767283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7310f155-8bb5-46ec-a7d7-2f70bd974745 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:30.774105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7310f155-8bb5-46ec-a7d7-2f70bd974745 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:30.774549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7310f155-8bb5-46ec-a7d7-2f70bd974745 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:30.775307 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7310f155-8bb5-46ec-a7d7-2f70bd974745 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:30.775773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7310f155-8bb5-46ec-a7d7-2f70bd974745 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:30.807258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7310f155-8bb5-46ec-a7d7-2f70bd974745 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044640 Jul 14 15:43:30.811252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 450/839] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:30 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:31.820690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c294400a-6455-4911-98bd-a975917a0f87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:31.821467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c294400a-6455-4911-98bd-a975917a0f87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:31.832520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c294400a-6455-4911-98bd-a975917a0f87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:31.832974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c294400a-6455-4911-98bd-a975917a0f87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:31.833755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c294400a-6455-4911-98bd-a975917a0f87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:31.834198 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c294400a-6455-4911-98bd-a975917a0f87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:31.875375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c294400a-6455-4911-98bd-a975917a0f87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.059259 Jul 14 15:43:31.875963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 390/840] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:31 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:32.888502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3d8c347d-b6d0-436a-b492-e78a60331f0a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:32.889447 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3d8c347d-b6d0-436a-b492-e78a60331f0a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:32.896441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3d8c347d-b6d0-436a-b492-e78a60331f0a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:32.896889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3d8c347d-b6d0-436a-b492-e78a60331f0a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:32.897648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3d8c347d-b6d0-436a-b492-e78a60331f0a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:32.898079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3d8c347d-b6d0-436a-b492-e78a60331f0a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:32.928567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3d8c347d-b6d0-436a-b492-e78a60331f0a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044136 Jul 14 15:43:32.929123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 451/841] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:33.940463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0148aaf9-d8eb-4109-81b0-787d3bbc2300 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:33.941382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0148aaf9-d8eb-4109-81b0-787d3bbc2300 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:33.947889 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0148aaf9-d8eb-4109-81b0-787d3bbc2300 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:33.948346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0148aaf9-d8eb-4109-81b0-787d3bbc2300 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:33.949113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0148aaf9-d8eb-4109-81b0-787d3bbc2300 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:33.949553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0148aaf9-d8eb-4109-81b0-787d3bbc2300 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:33.966642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:33.981805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0148aaf9-d8eb-4109-81b0-787d3bbc2300 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045342 Jul 14 15:43:33.982372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 391/842] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:33 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:34.994134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-12ba419c-8e3e-4e19-85b1-b451165a209a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:34.995049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-12ba419c-8e3e-4e19-85b1-b451165a209a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:35.001594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-12ba419c-8e3e-4e19-85b1-b451165a209a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:35.002047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-12ba419c-8e3e-4e19-85b1-b451165a209a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:35.002810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-12ba419c-8e3e-4e19-85b1-b451165a209a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:35.003249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-12ba419c-8e3e-4e19-85b1-b451165a209a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:35.033366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-12ba419c-8e3e-4e19-85b1-b451165a209a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043322 Jul 14 15:43:35.033922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 452/843] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:34 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:36.046066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4e01e63d-e58c-40f9-a18f-c86c366151d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:36.046981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4e01e63d-e58c-40f9-a18f-c86c366151d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:36.054176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e01e63d-e58c-40f9-a18f-c86c366151d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:36.054632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e01e63d-e58c-40f9-a18f-c86c366151d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:36.055435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e01e63d-e58c-40f9-a18f-c86c366151d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:36.056007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e01e63d-e58c-40f9-a18f-c86c366151d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:36.085974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4e01e63d-e58c-40f9-a18f-c86c366151d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043871 Jul 14 15:43:36.086554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 392/844] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:36 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:37.097585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-58cde9aa-9d97-4186-97ee-4693f2645410 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:37.099279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-58cde9aa-9d97-4186-97ee-4693f2645410 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:37.105647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58cde9aa-9d97-4186-97ee-4693f2645410 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:37.106090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58cde9aa-9d97-4186-97ee-4693f2645410 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:37.106886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58cde9aa-9d97-4186-97ee-4693f2645410 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:37.107356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58cde9aa-9d97-4186-97ee-4693f2645410 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:37.136321 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-58cde9aa-9d97-4186-97ee-4693f2645410 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042701 Jul 14 15:43:37.136876 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 453/845] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:37 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:38.149484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-37fcae75-271d-4d83-bb77-e02ab11c87b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:38.150931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-37fcae75-271d-4d83-bb77-e02ab11c87b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:38.158277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37fcae75-271d-4d83-bb77-e02ab11c87b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:38.158753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37fcae75-271d-4d83-bb77-e02ab11c87b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:38.159526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37fcae75-271d-4d83-bb77-e02ab11c87b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:38.159996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37fcae75-271d-4d83-bb77-e02ab11c87b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:38.191841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-37fcae75-271d-4d83-bb77-e02ab11c87b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047447 Jul 14 15:43:38.192433 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 393/846] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:39.204162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-48943e24-0b14-4154-898c-547082d20fb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:39.205069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-48943e24-0b14-4154-898c-547082d20fb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:39.211529 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-48943e24-0b14-4154-898c-547082d20fb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:39.212086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-48943e24-0b14-4154-898c-547082d20fb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:39.212838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-48943e24-0b14-4154-898c-547082d20fb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:39.213272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-48943e24-0b14-4154-898c-547082d20fb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:39.242581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-48943e24-0b14-4154-898c-547082d20fb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042389 Jul 14 15:43:39.243134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 454/847] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:39 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:40.254607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-db27def8-a2be-4696-a6ee-edcf7a7c784a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:40.256441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-db27def8-a2be-4696-a6ee-edcf7a7c784a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:40.263314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db27def8-a2be-4696-a6ee-edcf7a7c784a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:40.263802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db27def8-a2be-4696-a6ee-edcf7a7c784a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:40.264564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db27def8-a2be-4696-a6ee-edcf7a7c784a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:40.264999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db27def8-a2be-4696-a6ee-edcf7a7c784a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:40.295255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-db27def8-a2be-4696-a6ee-edcf7a7c784a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044750 Jul 14 15:43:40.295932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 394/848] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:40 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:41.308012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-781cf576-310e-4097-ab4c-4d859bbc3f5f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:41.308929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-781cf576-310e-4097-ab4c-4d859bbc3f5f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:41.314902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-781cf576-310e-4097-ab4c-4d859bbc3f5f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:41.315345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-781cf576-310e-4097-ab4c-4d859bbc3f5f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:41.316129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-781cf576-310e-4097-ab4c-4d859bbc3f5f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:41.316560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-781cf576-310e-4097-ab4c-4d859bbc3f5f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:41.346368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-781cf576-310e-4097-ab4c-4d859bbc3f5f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043135 Jul 14 15:43:41.346909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 455/849] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:41 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:42.358791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3c3bd24d-9e8d-413e-b04a-240604297e2d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:42.359748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3c3bd24d-9e8d-413e-b04a-240604297e2d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:42.366235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3c3bd24d-9e8d-413e-b04a-240604297e2d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:42.366685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3c3bd24d-9e8d-413e-b04a-240604297e2d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:42.367446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3c3bd24d-9e8d-413e-b04a-240604297e2d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:42.367911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3c3bd24d-9e8d-413e-b04a-240604297e2d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:42.397370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3c3bd24d-9e8d-413e-b04a-240604297e2d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042520 Jul 14 15:43:42.397920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 395/850] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:42 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:43.409078 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-23e0f973-ee34-4e0f-9470-c645356b6e73 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:43.410023 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-23e0f973-ee34-4e0f-9470-c645356b6e73 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:43.417597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23e0f973-ee34-4e0f-9470-c645356b6e73 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:43.418048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23e0f973-ee34-4e0f-9470-c645356b6e73 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:43.418807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23e0f973-ee34-4e0f-9470-c645356b6e73 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:43.419244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23e0f973-ee34-4e0f-9470-c645356b6e73 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:43.449176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-23e0f973-ee34-4e0f-9470-c645356b6e73 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044072 Jul 14 15:43:43.449738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 456/851] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:43 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:44.461733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4e78ecfc-1431-4773-9951-09e7cfbb1dcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:44.462656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4e78ecfc-1431-4773-9951-09e7cfbb1dcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:44.469300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e78ecfc-1431-4773-9951-09e7cfbb1dcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:44.469759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e78ecfc-1431-4773-9951-09e7cfbb1dcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:44.470523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e78ecfc-1431-4773-9951-09e7cfbb1dcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:44.470965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e78ecfc-1431-4773-9951-09e7cfbb1dcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:44.501342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4e78ecfc-1431-4773-9951-09e7cfbb1dcf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044196 Jul 14 15:43:44.501900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 396/852] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:43:45.513274 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f323b4a2-b6a3-4842-98fa-cfe73a7da4fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:45.514173 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f323b4a2-b6a3-4842-98fa-cfe73a7da4fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:45.520573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f323b4a2-b6a3-4842-98fa-cfe73a7da4fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:45.521026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f323b4a2-b6a3-4842-98fa-cfe73a7da4fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:45.522569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f323b4a2-b6a3-4842-98fa-cfe73a7da4fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:45.523023 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f323b4a2-b6a3-4842-98fa-cfe73a7da4fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:45.553681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f323b4a2-b6a3-4842-98fa-cfe73a7da4fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044357 Jul 14 15:43:45.554237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 457/853] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:45 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:46.565632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9ca8edb3-4678-47dc-b054-c232ec2d86fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:46.566617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9ca8edb3-4678-47dc-b054-c232ec2d86fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:46.574614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9ca8edb3-4678-47dc-b054-c232ec2d86fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:46.575240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9ca8edb3-4678-47dc-b054-c232ec2d86fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:46.576177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9ca8edb3-4678-47dc-b054-c232ec2d86fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:46.576745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9ca8edb3-4678-47dc-b054-c232ec2d86fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:46.609188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9ca8edb3-4678-47dc-b054-c232ec2d86fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048105 Jul 14 15:43:46.609765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 397/854] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:46 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:47.622027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-94f36708-c0f5-4286-884b-867e8b70b79c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:47.622854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-94f36708-c0f5-4286-884b-867e8b70b79c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:47.629278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-94f36708-c0f5-4286-884b-867e8b70b79c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:47.629724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-94f36708-c0f5-4286-884b-867e8b70b79c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:47.630475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-94f36708-c0f5-4286-884b-867e8b70b79c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:47.631537 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-94f36708-c0f5-4286-884b-867e8b70b79c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:47.661377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-94f36708-c0f5-4286-884b-867e8b70b79c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043462 Jul 14 15:43:47.661993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 458/855] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:47 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:48.674064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-74a504b8-ac9d-4f38-9016-6323b1d88653 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:48.675048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-74a504b8-ac9d-4f38-9016-6323b1d88653 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:48.682280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74a504b8-ac9d-4f38-9016-6323b1d88653 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:48.682823 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74a504b8-ac9d-4f38-9016-6323b1d88653 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:48.683629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74a504b8-ac9d-4f38-9016-6323b1d88653 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:48.684058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74a504b8-ac9d-4f38-9016-6323b1d88653 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:48.714575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-74a504b8-ac9d-4f38-9016-6323b1d88653 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044948 Jul 14 15:43:48.715146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 398/856] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:48 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:49.727637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-166d1e30-8cf9-4ebe-9b33-bc4ea5578484 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:49.728559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-166d1e30-8cf9-4ebe-9b33-bc4ea5578484 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:49.735111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-166d1e30-8cf9-4ebe-9b33-bc4ea5578484 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:49.735561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-166d1e30-8cf9-4ebe-9b33-bc4ea5578484 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:49.736399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-166d1e30-8cf9-4ebe-9b33-bc4ea5578484 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:49.736836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-166d1e30-8cf9-4ebe-9b33-bc4ea5578484 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:49.765482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-166d1e30-8cf9-4ebe-9b33-bc4ea5578484 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043127 Jul 14 15:43:49.766044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 459/857] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:49 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:43:50.777664 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4ad55490-f31e-4b2c-a235-f9c484b05131 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:50.778593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4ad55490-f31e-4b2c-a235-f9c484b05131 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:50.785070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ad55490-f31e-4b2c-a235-f9c484b05131 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:50.785529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ad55490-f31e-4b2c-a235-f9c484b05131 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:50.786280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ad55490-f31e-4b2c-a235-f9c484b05131 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:50.786716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ad55490-f31e-4b2c-a235-f9c484b05131 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:50.820564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4ad55490-f31e-4b2c-a235-f9c484b05131 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047162 Jul 14 15:43:50.821265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 399/858] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:50 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:51.832692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-621ffc60-8e56-4953-a2dd-744b813f26d8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:51.833556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-621ffc60-8e56-4953-a2dd-744b813f26d8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:51.840437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-621ffc60-8e56-4953-a2dd-744b813f26d8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:51.840888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-621ffc60-8e56-4953-a2dd-744b813f26d8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:51.841642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-621ffc60-8e56-4953-a2dd-744b813f26d8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:51.842085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-621ffc60-8e56-4953-a2dd-744b813f26d8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:51.872859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-621ffc60-8e56-4953-a2dd-744b813f26d8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044252 Jul 14 15:43:51.873454 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 460/859] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:51 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:52.885151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7989d4b8-b0b3-4c83-bbef-3d108612e1f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:52.886093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7989d4b8-b0b3-4c83-bbef-3d108612e1f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:52.892484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7989d4b8-b0b3-4c83-bbef-3d108612e1f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:52.892925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7989d4b8-b0b3-4c83-bbef-3d108612e1f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:52.893671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7989d4b8-b0b3-4c83-bbef-3d108612e1f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:52.894103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7989d4b8-b0b3-4c83-bbef-3d108612e1f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:52.923468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7989d4b8-b0b3-4c83-bbef-3d108612e1f7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042257 Jul 14 15:43:52.924040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 400/860] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:52 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:53.935659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fdcafa5b-8d40-460d-a429-09d208b191bb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:53.936587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fdcafa5b-8d40-460d-a429-09d208b191bb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:53.943069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdcafa5b-8d40-460d-a429-09d208b191bb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:53.943523 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdcafa5b-8d40-460d-a429-09d208b191bb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:53.944882 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdcafa5b-8d40-460d-a429-09d208b191bb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:53.945325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdcafa5b-8d40-460d-a429-09d208b191bb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:53.973956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fdcafa5b-8d40-460d-a429-09d208b191bb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042372 Jul 14 15:43:53.974510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 461/861] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:53 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:54.986181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1d738d46-5a8c-45a0-8030-51acc988fc35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:54.987105 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1d738d46-5a8c-45a0-8030-51acc988fc35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:54.993698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d738d46-5a8c-45a0-8030-51acc988fc35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:54.994144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d738d46-5a8c-45a0-8030-51acc988fc35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:54.994906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d738d46-5a8c-45a0-8030-51acc988fc35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:54.995338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d738d46-5a8c-45a0-8030-51acc988fc35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:55.024873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1d738d46-5a8c-45a0-8030-51acc988fc35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042665 Jul 14 15:43:55.025438 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 401/862] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:54 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:56.037161 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ea85c524-9d94-4c6c-ae3e-a8b956a1d545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:56.038597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ea85c524-9d94-4c6c-ae3e-a8b956a1d545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:56.045503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea85c524-9d94-4c6c-ae3e-a8b956a1d545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:56.045965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea85c524-9d94-4c6c-ae3e-a8b956a1d545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:56.046742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea85c524-9d94-4c6c-ae3e-a8b956a1d545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:56.047186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea85c524-9d94-4c6c-ae3e-a8b956a1d545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:56.077942 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ea85c524-9d94-4c6c-ae3e-a8b956a1d545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044745 Jul 14 15:43:56.078513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 462/863] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:56 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:57.091044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-84efd3c3-f93a-4b0b-aa8f-0a4969da6042 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:57.091981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-84efd3c3-f93a-4b0b-aa8f-0a4969da6042 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:57.098017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84efd3c3-f93a-4b0b-aa8f-0a4969da6042 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:57.098487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84efd3c3-f93a-4b0b-aa8f-0a4969da6042 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:57.099251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84efd3c3-f93a-4b0b-aa8f-0a4969da6042 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:57.099716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84efd3c3-f93a-4b0b-aa8f-0a4969da6042 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:57.129794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-84efd3c3-f93a-4b0b-aa8f-0a4969da6042 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043767 Jul 14 15:43:57.130377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 402/864] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:57 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:57.299723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9404ad13-d1f7-4bef-b264-95e415f78f23 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:57.300266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9404ad13-d1f7-4bef-b264-95e415f78f23 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:57.302477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=30 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:57.308436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9404ad13-d1f7-4bef-b264-95e415f78f23 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:57.308929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9404ad13-d1f7-4bef-b264-95e415f78f23 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:57.309669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9404ad13-d1f7-4bef-b264-95e415f78f23 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:57.310116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9404ad13-d1f7-4bef-b264-95e415f78f23 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:57.338363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9404ad13-d1f7-4bef-b264-95e415f78f23 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 15:43:57.419768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9404ad13-d1f7-4bef-b264-95e415f78f23 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 204 len: 0 microversion: 2.1 time: 0.123648 Jul 14 15:43:57.420452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 463/865] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 15:43:57 2022] DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jul 14 15:43:57.431556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5f2aaa34-cbd7-4dd8-aee6-0ac65cabcf6b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:57.431556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5f2aaa34-cbd7-4dd8-aee6-0ac65cabcf6b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:57.437953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f2aaa34-cbd7-4dd8-aee6-0ac65cabcf6b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:57.438407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f2aaa34-cbd7-4dd8-aee6-0ac65cabcf6b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:57.439181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f2aaa34-cbd7-4dd8-aee6-0ac65cabcf6b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:57.439637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f2aaa34-cbd7-4dd8-aee6-0ac65cabcf6b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:57.591194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5f2aaa34-cbd7-4dd8-aee6-0ac65cabcf6b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:57.599823 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5f2aaa34-cbd7-4dd8-aee6-0ac65cabcf6b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1576 microversion: 2.1 time: 0.174514 Jul 14 15:43:57.600386 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 403/866] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:57 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1576 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:58.142961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f003927c-080b-4462-92fe-95a76e356302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:58.143990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f003927c-080b-4462-92fe-95a76e356302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:58.151101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f003927c-080b-4462-92fe-95a76e356302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:58.151547 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f003927c-080b-4462-92fe-95a76e356302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:58.152615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f003927c-080b-4462-92fe-95a76e356302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:58.153055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f003927c-080b-4462-92fe-95a76e356302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:58.178849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:58.185043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f003927c-080b-4462-92fe-95a76e356302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046540 Jul 14 15:43:58.185606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 464/867] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:58 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:58.620594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fb04b867-5bcb-4917-8990-0197a8bf619b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:58.621197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fb04b867-5bcb-4917-8990-0197a8bf619b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:58.623876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=32 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:43:58.629778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb04b867-5bcb-4917-8990-0197a8bf619b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:58.630231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb04b867-5bcb-4917-8990-0197a8bf619b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:58.631012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb04b867-5bcb-4917-8990-0197a8bf619b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:58.632300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb04b867-5bcb-4917-8990-0197a8bf619b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:58.768717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fb04b867-5bcb-4917-8990-0197a8bf619b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:43:58.776694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fb04b867-5bcb-4917-8990-0197a8bf619b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1576 microversion: 2.1 time: 0.162442 Jul 14 15:43:58.777515 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 404/868] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:58 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1576 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:43:59.198975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8d44dcea-3d69-4e04-8681-beae9f67d8f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:59.199924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8d44dcea-3d69-4e04-8681-beae9f67d8f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:59.208433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d44dcea-3d69-4e04-8681-beae9f67d8f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:59.208884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d44dcea-3d69-4e04-8681-beae9f67d8f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:59.209661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d44dcea-3d69-4e04-8681-beae9f67d8f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:59.210100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d44dcea-3d69-4e04-8681-beae9f67d8f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:59.242869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8d44dcea-3d69-4e04-8681-beae9f67d8f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049531 Jul 14 15:43:59.247311 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 465/869] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:43:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:43:59.794000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3ee10ba6-4f82-4859-99d5-e8d3167bab26 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:43:59.794698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3ee10ba6-4f82-4859-99d5-e8d3167bab26 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:43:59.802412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ee10ba6-4f82-4859-99d5-e8d3167bab26 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:59.802809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ee10ba6-4f82-4859-99d5-e8d3167bab26 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:43:59.803582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ee10ba6-4f82-4859-99d5-e8d3167bab26 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:43:59.804043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ee10ba6-4f82-4859-99d5-e8d3167bab26 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:00.018179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3ee10ba6-4f82-4859-99d5-e8d3167bab26 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:00.025800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3ee10ba6-4f82-4859-99d5-e8d3167bab26 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1576 microversion: 2.1 time: 0.236514 Jul 14 15:44:00.026376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 405/870] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:43:59 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1576 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:00.255460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0dda6c66-38ac-4886-ac54-affda1eb343e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:00.256339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0dda6c66-38ac-4886-ac54-affda1eb343e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:00.264183 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0dda6c66-38ac-4886-ac54-affda1eb343e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:00.264641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0dda6c66-38ac-4886-ac54-affda1eb343e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:00.265458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0dda6c66-38ac-4886-ac54-affda1eb343e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:00.265906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0dda6c66-38ac-4886-ac54-affda1eb343e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:00.298254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0dda6c66-38ac-4886-ac54-affda1eb343e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046930 Jul 14 15:44:00.298838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 466/871] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:00 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:00.999244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-8a95402a-93fc-4078-8871-85b38935c20f req-11ed9df2-217c-400f-8433-55e68e8f377a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7ea27265-d9b4-48a9-80e7-00f4be8ca323", "name": "network-vif-deleted", "tag": "404d8f87-7e6c-41cf-b6ba-764dede489c9"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:01.008288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-8a95402a-93fc-4078-8871-85b38935c20f req-11ed9df2-217c-400f-8433-55e68e8f377a service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:01.008960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-8a95402a-93fc-4078-8871-85b38935c20f req-11ed9df2-217c-400f-8433-55e68e8f377a service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:01.020556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-8a95402a-93fc-4078-8871-85b38935c20f req-11ed9df2-217c-400f-8433-55e68e8f377a service nova] Creating event network-vif-deleted:404d8f87-7e6c-41cf-b6ba-764dede489c9 for instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 on hv-cinder-82651 Jul 14 15:44:01.027047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-8a95402a-93fc-4078-8871-85b38935c20f req-11ed9df2-217c-400f-8433-55e68e8f377a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031969 Jul 14 15:44:01.031413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 406/872] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:44:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:44:01.044886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c0955bae-5f2d-4f9f-96d7-2ff1807148f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:01.046053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c0955bae-5f2d-4f9f-96d7-2ff1807148f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:01.052903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0955bae-5f2d-4f9f-96d7-2ff1807148f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:01.053624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0955bae-5f2d-4f9f-96d7-2ff1807148f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:01.054394 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0955bae-5f2d-4f9f-96d7-2ff1807148f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:01.055963 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0955bae-5f2d-4f9f-96d7-2ff1807148f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:01.123031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c0955bae-5f2d-4f9f-96d7-2ff1807148f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:01.130658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c0955bae-5f2d-4f9f-96d7-2ff1807148f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.092139 Jul 14 15:44:01.131220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 467/873] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:01 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:01.311847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-250f59f5-9d52-47b6-91ee-e2512b4163ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:01.313238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-250f59f5-9d52-47b6-91ee-e2512b4163ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:01.320156 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-250f59f5-9d52-47b6-91ee-e2512b4163ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:01.321274 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-250f59f5-9d52-47b6-91ee-e2512b4163ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:01.322329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-250f59f5-9d52-47b6-91ee-e2512b4163ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:01.322943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-250f59f5-9d52-47b6-91ee-e2512b4163ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:01.354433 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-250f59f5-9d52-47b6-91ee-e2512b4163ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047211 Jul 14 15:44:01.355159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 407/874] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:01 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:02.150320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ce6106af-ebd4-4909-a3a5-e4e8f21d7260 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:02.151733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ce6106af-ebd4-4909-a3a5-e4e8f21d7260 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:02.160402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ce6106af-ebd4-4909-a3a5-e4e8f21d7260 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:02.160945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ce6106af-ebd4-4909-a3a5-e4e8f21d7260 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:02.161908 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ce6106af-ebd4-4909-a3a5-e4e8f21d7260 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:02.162419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ce6106af-ebd4-4909-a3a5-e4e8f21d7260 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:02.237645 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ce6106af-ebd4-4909-a3a5-e4e8f21d7260 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:02.250217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ce6106af-ebd4-4909-a3a5-e4e8f21d7260 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.105705 Jul 14 15:44:02.250800 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 468/875] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:02 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:02.365875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5bc71be4-be51-4043-b012-cd772ee2cb80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:02.366797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5bc71be4-be51-4043-b012-cd772ee2cb80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:02.374025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5bc71be4-be51-4043-b012-cd772ee2cb80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:02.374475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5bc71be4-be51-4043-b012-cd772ee2cb80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:02.375245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5bc71be4-be51-4043-b012-cd772ee2cb80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:02.375750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5bc71be4-be51-4043-b012-cd772ee2cb80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:02.402186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:02.407496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5bc71be4-be51-4043-b012-cd772ee2cb80 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045779 Jul 14 15:44:02.408288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 408/876] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:03.268208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6e7a0fda-a27e-42f5-8353-29bf42cdc6b4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:03.268786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6e7a0fda-a27e-42f5-8353-29bf42cdc6b4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:03.275754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6e7a0fda-a27e-42f5-8353-29bf42cdc6b4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:03.276210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6e7a0fda-a27e-42f5-8353-29bf42cdc6b4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:03.276987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6e7a0fda-a27e-42f5-8353-29bf42cdc6b4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:03.277694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6e7a0fda-a27e-42f5-8353-29bf42cdc6b4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:03.342304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6e7a0fda-a27e-42f5-8353-29bf42cdc6b4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:03.350513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6e7a0fda-a27e-42f5-8353-29bf42cdc6b4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.086690 Jul 14 15:44:03.351080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 469/877] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:03 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:03.419622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a0f73221-6f23-45e6-b28c-224a9174f270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:03.420569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a0f73221-6f23-45e6-b28c-224a9174f270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:03.426589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0f73221-6f23-45e6-b28c-224a9174f270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:03.427096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0f73221-6f23-45e6-b28c-224a9174f270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:03.427900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0f73221-6f23-45e6-b28c-224a9174f270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:03.428338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0f73221-6f23-45e6-b28c-224a9174f270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:03.459898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a0f73221-6f23-45e6-b28c-224a9174f270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045251 Jul 14 15:44:03.460475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 409/878] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:04.368195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e5546163-a8cc-4dd2-83e9-529e8cee7f43 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:04.369025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e5546163-a8cc-4dd2-83e9-529e8cee7f43 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:04.375556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e5546163-a8cc-4dd2-83e9-529e8cee7f43 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:04.376040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e5546163-a8cc-4dd2-83e9-529e8cee7f43 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:04.376827 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e5546163-a8cc-4dd2-83e9-529e8cee7f43 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:04.377269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e5546163-a8cc-4dd2-83e9-529e8cee7f43 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:04.442740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e5546163-a8cc-4dd2-83e9-529e8cee7f43 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:04.451810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e5546163-a8cc-4dd2-83e9-529e8cee7f43 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.088367 Jul 14 15:44:04.452400 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 470/879] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:04 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:04.472926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5a3aa5ed-74b0-4d9a-a346-c7c985670e50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:04.473838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5a3aa5ed-74b0-4d9a-a346-c7c985670e50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:04.481157 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a3aa5ed-74b0-4d9a-a346-c7c985670e50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:04.481717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a3aa5ed-74b0-4d9a-a346-c7c985670e50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:04.482490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a3aa5ed-74b0-4d9a-a346-c7c985670e50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:04.482921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a3aa5ed-74b0-4d9a-a346-c7c985670e50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:04.513493 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5a3aa5ed-74b0-4d9a-a346-c7c985670e50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044533 Jul 14 15:44:04.515333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 410/880] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:05.468740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9eb140e4-a568-4351-906f-d75ad02564ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:05.469340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9eb140e4-a568-4351-906f-d75ad02564ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:05.475816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9eb140e4-a568-4351-906f-d75ad02564ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:05.476263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9eb140e4-a568-4351-906f-d75ad02564ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:05.477045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9eb140e4-a568-4351-906f-d75ad02564ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:05.477736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9eb140e4-a568-4351-906f-d75ad02564ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:05.524892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-13865892-c900-45a5-912b-6aeb4970a8d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:05.525541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-13865892-c900-45a5-912b-6aeb4970a8d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:05.532285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13865892-c900-45a5-912b-6aeb4970a8d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:05.532731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13865892-c900-45a5-912b-6aeb4970a8d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:05.533487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13865892-c900-45a5-912b-6aeb4970a8d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:05.533916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13865892-c900-45a5-912b-6aeb4970a8d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:05.538751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9eb140e4-a568-4351-906f-d75ad02564ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:05.546357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9eb140e4-a568-4351-906f-d75ad02564ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.081571 Jul 14 15:44:05.546930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 471/881] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:05 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:05.563492 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-13865892-c900-45a5-912b-6aeb4970a8d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042999 Jul 14 15:44:05.564081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 411/882] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:05 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:06.564323 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-068ae779-d5e9-4cac-b623-4300a820cb44 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:06.564919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-068ae779-d5e9-4cac-b623-4300a820cb44 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:06.571425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-068ae779-d5e9-4cac-b623-4300a820cb44 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.571914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-068ae779-d5e9-4cac-b623-4300a820cb44 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.572677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-068ae779-d5e9-4cac-b623-4300a820cb44 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.573156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-068ae779-d5e9-4cac-b623-4300a820cb44 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.574320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8b572026-b8f1-46ac-9892-c6d6a27e74a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:06.575381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8b572026-b8f1-46ac-9892-c6d6a27e74a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:06.582513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b572026-b8f1-46ac-9892-c6d6a27e74a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.582971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b572026-b8f1-46ac-9892-c6d6a27e74a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.583786 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b572026-b8f1-46ac-9892-c6d6a27e74a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:06.584228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b572026-b8f1-46ac-9892-c6d6a27e74a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:06.615692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8b572026-b8f1-46ac-9892-c6d6a27e74a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045253 Jul 14 15:44:06.616274 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 412/883] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:06 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:06.636104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-068ae779-d5e9-4cac-b623-4300a820cb44 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:06.643747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-068ae779-d5e9-4cac-b623-4300a820cb44 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.083238 Jul 14 15:44:06.644329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 472/884] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:06 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:07.628005 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b8a8df82-e67e-4f97-a71a-1c76130d3bef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:07.628920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b8a8df82-e67e-4f97-a71a-1c76130d3bef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:07.636017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8a8df82-e67e-4f97-a71a-1c76130d3bef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:07.636462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8a8df82-e67e-4f97-a71a-1c76130d3bef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:07.637231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8a8df82-e67e-4f97-a71a-1c76130d3bef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:07.637662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8a8df82-e67e-4f97-a71a-1c76130d3bef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:07.661884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3e6bf169-593c-456c-8220-fa63f0c851e2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:07.662425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3e6bf169-593c-456c-8220-fa63f0c851e2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:07.669785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b8a8df82-e67e-4f97-a71a-1c76130d3bef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045872 Jul 14 15:44:07.670197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e6bf169-593c-456c-8220-fa63f0c851e2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:07.671104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 413/885] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:07 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:07.671266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e6bf169-593c-456c-8220-fa63f0c851e2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:07.671654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e6bf169-593c-456c-8220-fa63f0c851e2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:07.672097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e6bf169-593c-456c-8220-fa63f0c851e2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:07.742025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3e6bf169-593c-456c-8220-fa63f0c851e2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:07.749934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3e6bf169-593c-456c-8220-fa63f0c851e2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.092077 Jul 14 15:44:07.750512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 473/886] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:07 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:08.682633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e99bd9e0-99f8-43ed-8ca7-85e2a027e99a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:08.683554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e99bd9e0-99f8-43ed-8ca7-85e2a027e99a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:08.690264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e99bd9e0-99f8-43ed-8ca7-85e2a027e99a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:08.690720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e99bd9e0-99f8-43ed-8ca7-85e2a027e99a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:08.691486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e99bd9e0-99f8-43ed-8ca7-85e2a027e99a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:08.691954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e99bd9e0-99f8-43ed-8ca7-85e2a027e99a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:08.721014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e99bd9e0-99f8-43ed-8ca7-85e2a027e99a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043095 Jul 14 15:44:08.721578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 414/887] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:08 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:08.766210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b6ba1b37-f699-4b1e-8845-99239642be8e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:08.766854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b6ba1b37-f699-4b1e-8845-99239642be8e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:08.773505 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b6ba1b37-f699-4b1e-8845-99239642be8e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:08.773964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b6ba1b37-f699-4b1e-8845-99239642be8e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:08.774735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b6ba1b37-f699-4b1e-8845-99239642be8e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:08.775177 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b6ba1b37-f699-4b1e-8845-99239642be8e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:08.840730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b6ba1b37-f699-4b1e-8845-99239642be8e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:08.848943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b6ba1b37-f699-4b1e-8845-99239642be8e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.086617 Jul 14 15:44:08.849519 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 474/888] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:08 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:09.733246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1b514751-6dd0-47ab-8a83-59a71a9825d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:09.734091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1b514751-6dd0-47ab-8a83-59a71a9825d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:09.740636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b514751-6dd0-47ab-8a83-59a71a9825d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:09.741085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b514751-6dd0-47ab-8a83-59a71a9825d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:09.741843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b514751-6dd0-47ab-8a83-59a71a9825d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:09.742621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b514751-6dd0-47ab-8a83-59a71a9825d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:09.772394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1b514751-6dd0-47ab-8a83-59a71a9825d5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043202 Jul 14 15:44:09.772945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 415/889] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:09 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:09.866197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b3e66dc6-da4e-4335-894d-e0df2f3d0d79 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:09.866806 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b3e66dc6-da4e-4335-894d-e0df2f3d0d79 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:09.874575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3e66dc6-da4e-4335-894d-e0df2f3d0d79 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:09.875026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3e66dc6-da4e-4335-894d-e0df2f3d0d79 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:09.875826 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3e66dc6-da4e-4335-894d-e0df2f3d0d79 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:09.876267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3e66dc6-da4e-4335-894d-e0df2f3d0d79 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:09.943705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b3e66dc6-da4e-4335-894d-e0df2f3d0d79 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:09.951883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b3e66dc6-da4e-4335-894d-e0df2f3d0d79 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.089573 Jul 14 15:44:09.952450 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 475/890] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:09 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:10.784927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0497b326-14fb-4235-8103-661e283fce4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:10.785832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0497b326-14fb-4235-8103-661e283fce4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:10.793585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0497b326-14fb-4235-8103-661e283fce4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:10.794034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0497b326-14fb-4235-8103-661e283fce4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:10.794796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0497b326-14fb-4235-8103-661e283fce4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:10.795233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0497b326-14fb-4235-8103-661e283fce4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:10.825192 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0497b326-14fb-4235-8103-661e283fce4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044165 Jul 14 15:44:10.825745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 416/891] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:10 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:10.968463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6fb4cad1-3d9c-40b0-ad2b-14509ef0b472 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:10.969085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6fb4cad1-3d9c-40b0-ad2b-14509ef0b472 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:10.975278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6fb4cad1-3d9c-40b0-ad2b-14509ef0b472 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:10.975757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6fb4cad1-3d9c-40b0-ad2b-14509ef0b472 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:10.976615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6fb4cad1-3d9c-40b0-ad2b-14509ef0b472 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:10.977064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6fb4cad1-3d9c-40b0-ad2b-14509ef0b472 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:11.039479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6fb4cad1-3d9c-40b0-ad2b-14509ef0b472 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:11.047225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6fb4cad1-3d9c-40b0-ad2b-14509ef0b472 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.082698 Jul 14 15:44:11.047854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 476/892] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:10 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:11.546416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:44:11.546614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:44:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 15:44:11.837355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c2190e21-c1da-4748-ae4a-f69ff4f24e44 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:11.838306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c2190e21-c1da-4748-ae4a-f69ff4f24e44 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:11.845482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c2190e21-c1da-4748-ae4a-f69ff4f24e44 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:11.845928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c2190e21-c1da-4748-ae4a-f69ff4f24e44 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:11.846681 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c2190e21-c1da-4748-ae4a-f69ff4f24e44 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:11.847110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c2190e21-c1da-4748-ae4a-f69ff4f24e44 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:11.876835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c2190e21-c1da-4748-ae4a-f69ff4f24e44 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043669 Jul 14 15:44:11.877385 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 417/893] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:11 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:12.162849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d70cc917-d76e-402d-a8dc-e9c08a79e6f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:12.163470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d70cc917-d76e-402d-a8dc-e9c08a79e6f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:12.170337 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d70cc917-d76e-402d-a8dc-e9c08a79e6f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:12.170790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d70cc917-d76e-402d-a8dc-e9c08a79e6f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:12.171563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d70cc917-d76e-402d-a8dc-e9c08a79e6f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:12.172093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d70cc917-d76e-402d-a8dc-e9c08a79e6f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:12.236956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d70cc917-d76e-402d-a8dc-e9c08a79e6f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:12.244840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d70cc917-d76e-402d-a8dc-e9c08a79e6f2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.184247 Jul 14 15:44:12.245410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 477/894] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:12 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:12.890844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-33705d39-a401-4d37-b5a3-4ac335a7b0a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:12.891807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-33705d39-a401-4d37-b5a3-4ac335a7b0a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:12.898394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-33705d39-a401-4d37-b5a3-4ac335a7b0a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:12.898842 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-33705d39-a401-4d37-b5a3-4ac335a7b0a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:12.899652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-33705d39-a401-4d37-b5a3-4ac335a7b0a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:12.900094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-33705d39-a401-4d37-b5a3-4ac335a7b0a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:12.928058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-33705d39-a401-4d37-b5a3-4ac335a7b0a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041848 Jul 14 15:44:12.928601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 418/895] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:12 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:13.261874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-037ce11c-a42f-47da-82a2-3104c5db9f51 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:13.262516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-037ce11c-a42f-47da-82a2-3104c5db9f51 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:13.268984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-037ce11c-a42f-47da-82a2-3104c5db9f51 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:13.269436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-037ce11c-a42f-47da-82a2-3104c5db9f51 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:13.270209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-037ce11c-a42f-47da-82a2-3104c5db9f51 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:13.270648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-037ce11c-a42f-47da-82a2-3104c5db9f51 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:13.332715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-037ce11c-a42f-47da-82a2-3104c5db9f51 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:13.341188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-037ce11c-a42f-47da-82a2-3104c5db9f51 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.083939 Jul 14 15:44:13.341808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 478/896] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:13 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:13.940355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a6c4b4a8-b6c0-4401-acd6-56830716882b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:13.941274 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a6c4b4a8-b6c0-4401-acd6-56830716882b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:13.949395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a6c4b4a8-b6c0-4401-acd6-56830716882b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:13.950100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a6c4b4a8-b6c0-4401-acd6-56830716882b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:13.950975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a6c4b4a8-b6c0-4401-acd6-56830716882b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:13.951776 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a6c4b4a8-b6c0-4401-acd6-56830716882b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:13.982761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a6c4b4a8-b6c0-4401-acd6-56830716882b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046370 Jul 14 15:44:13.983323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 419/897] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:13 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:14.358613 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d54fc1f4-f106-4b2c-95fb-0b362c0d79e5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:14.359331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d54fc1f4-f106-4b2c-95fb-0b362c0d79e5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:14.365999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d54fc1f4-f106-4b2c-95fb-0b362c0d79e5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:14.366452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d54fc1f4-f106-4b2c-95fb-0b362c0d79e5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:14.367753 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d54fc1f4-f106-4b2c-95fb-0b362c0d79e5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:14.368584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d54fc1f4-f106-4b2c-95fb-0b362c0d79e5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:14.429314 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d54fc1f4-f106-4b2c-95fb-0b362c0d79e5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:14.437332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d54fc1f4-f106-4b2c-95fb-0b362c0d79e5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.082635 Jul 14 15:44:14.437905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 479/898] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:14 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:14.995132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2f4596cd-992b-42a6-8ae8-e1aa31326211 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:14.996069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2f4596cd-992b-42a6-8ae8-e1aa31326211 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:15.002609 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f4596cd-992b-42a6-8ae8-e1aa31326211 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:15.003049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f4596cd-992b-42a6-8ae8-e1aa31326211 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:15.003834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f4596cd-992b-42a6-8ae8-e1aa31326211 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:15.004268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f4596cd-992b-42a6-8ae8-e1aa31326211 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:15.033344 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2f4596cd-992b-42a6-8ae8-e1aa31326211 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042791 Jul 14 15:44:15.033898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 420/899] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:14 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:15.454421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-588f7f58-544b-4cd9-a13e-0e086c6d2741 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:15.455024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-588f7f58-544b-4cd9-a13e-0e086c6d2741 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:15.461456 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-588f7f58-544b-4cd9-a13e-0e086c6d2741 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:15.461899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-588f7f58-544b-4cd9-a13e-0e086c6d2741 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:15.462651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-588f7f58-544b-4cd9-a13e-0e086c6d2741 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:15.464041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-588f7f58-544b-4cd9-a13e-0e086c6d2741 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:15.523783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-588f7f58-544b-4cd9-a13e-0e086c6d2741 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:15.532500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-588f7f58-544b-4cd9-a13e-0e086c6d2741 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.081883 Jul 14 15:44:15.533080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 480/900] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:15 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:16.045208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-aaf4528c-f770-47f5-81e3-ed4b6a785a9d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:16.046143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-aaf4528c-f770-47f5-81e3-ed4b6a785a9d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:16.052757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aaf4528c-f770-47f5-81e3-ed4b6a785a9d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:16.053205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aaf4528c-f770-47f5-81e3-ed4b6a785a9d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:16.053964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aaf4528c-f770-47f5-81e3-ed4b6a785a9d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:16.054394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aaf4528c-f770-47f5-81e3-ed4b6a785a9d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:16.084071 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-aaf4528c-f770-47f5-81e3-ed4b6a785a9d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042875 Jul 14 15:44:16.084633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 421/901] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:16 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:16.549299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e0d6cc64-bf74-4ca2-8e8d-3bde5dd2f707 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:16.549909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e0d6cc64-bf74-4ca2-8e8d-3bde5dd2f707 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:16.556402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0d6cc64-bf74-4ca2-8e8d-3bde5dd2f707 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:16.557316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0d6cc64-bf74-4ca2-8e8d-3bde5dd2f707 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:16.558087 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0d6cc64-bf74-4ca2-8e8d-3bde5dd2f707 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:16.558525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0d6cc64-bf74-4ca2-8e8d-3bde5dd2f707 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:16.576329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:16.625988 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e0d6cc64-bf74-4ca2-8e8d-3bde5dd2f707 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:16.633499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e0d6cc64-bf74-4ca2-8e8d-3bde5dd2f707 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.088113 Jul 14 15:44:16.634058 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 481/902] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:16 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:17.096479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9112cc71-b414-4f7e-b5a3-2bae6ebe9cdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:17.097422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9112cc71-b414-4f7e-b5a3-2bae6ebe9cdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:17.104904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9112cc71-b414-4f7e-b5a3-2bae6ebe9cdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:17.105359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9112cc71-b414-4f7e-b5a3-2bae6ebe9cdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:17.106124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9112cc71-b414-4f7e-b5a3-2bae6ebe9cdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:17.106561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9112cc71-b414-4f7e-b5a3-2bae6ebe9cdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:17.136701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9112cc71-b414-4f7e-b5a3-2bae6ebe9cdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044697 Jul 14 15:44:17.137263 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 422/903] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:17 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:17.649519 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b217ef8b-3d9e-46b8-b1b1-38547f35755d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:17.650124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b217ef8b-3d9e-46b8-b1b1-38547f35755d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:17.657676 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b217ef8b-3d9e-46b8-b1b1-38547f35755d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:17.658121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b217ef8b-3d9e-46b8-b1b1-38547f35755d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:17.658939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b217ef8b-3d9e-46b8-b1b1-38547f35755d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:17.659323 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b217ef8b-3d9e-46b8-b1b1-38547f35755d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:17.721903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b217ef8b-3d9e-46b8-b1b1-38547f35755d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:17.729784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b217ef8b-3d9e-46b8-b1b1-38547f35755d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.083909 Jul 14 15:44:17.730366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 482/904] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:17 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:18.148771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4f972a52-4259-42f9-8889-f3aeda7eedf6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:18.149697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4f972a52-4259-42f9-8889-f3aeda7eedf6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:18.158564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f972a52-4259-42f9-8889-f3aeda7eedf6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:18.159016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f972a52-4259-42f9-8889-f3aeda7eedf6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:18.159834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f972a52-4259-42f9-8889-f3aeda7eedf6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:18.160278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f972a52-4259-42f9-8889-f3aeda7eedf6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:18.193304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4f972a52-4259-42f9-8889-f3aeda7eedf6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047743 Jul 14 15:44:18.193304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 423/905] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:18 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:18.747087 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-beccc54b-b077-4ab7-86d5-cb24b748c6ab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:18.747706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-beccc54b-b077-4ab7-86d5-cb24b748c6ab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:18.754291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-beccc54b-b077-4ab7-86d5-cb24b748c6ab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:18.754738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-beccc54b-b077-4ab7-86d5-cb24b748c6ab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:18.755495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-beccc54b-b077-4ab7-86d5-cb24b748c6ab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:18.755959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-beccc54b-b077-4ab7-86d5-cb24b748c6ab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:18.819036 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-beccc54b-b077-4ab7-86d5-cb24b748c6ab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:18.828396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-beccc54b-b077-4ab7-86d5-cb24b748c6ab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.085984 Jul 14 15:44:18.828968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 483/906] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:18 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:19.205054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d2d6583c-bf10-4668-9bcc-ac00d5dffaf3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:19.205973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d2d6583c-bf10-4668-9bcc-ac00d5dffaf3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:19.212706 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2d6583c-bf10-4668-9bcc-ac00d5dffaf3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:19.213154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2d6583c-bf10-4668-9bcc-ac00d5dffaf3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:19.214637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2d6583c-bf10-4668-9bcc-ac00d5dffaf3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:19.215169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2d6583c-bf10-4668-9bcc-ac00d5dffaf3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:19.243826 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d2d6583c-bf10-4668-9bcc-ac00d5dffaf3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042766 Jul 14 15:44:19.244382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 424/907] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:19 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:19.846185 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e0f74b3b-c41b-487b-aabc-902181c26188 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:19.847001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e0f74b3b-c41b-487b-aabc-902181c26188 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:19.853188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0f74b3b-c41b-487b-aabc-902181c26188 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:19.853638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0f74b3b-c41b-487b-aabc-902181c26188 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:19.855558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0f74b3b-c41b-487b-aabc-902181c26188 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:19.856041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0f74b3b-c41b-487b-aabc-902181c26188 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:19.920616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e0f74b3b-c41b-487b-aabc-902181c26188 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:19.930347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e0f74b3b-c41b-487b-aabc-902181c26188 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.088054 Jul 14 15:44:19.930939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 484/908] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:19 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:20.255700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f3bf8e51-f629-44b9-b092-de432e58f680 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:20.256617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f3bf8e51-f629-44b9-b092-de432e58f680 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:20.264194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3bf8e51-f629-44b9-b092-de432e58f680 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:20.264642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3bf8e51-f629-44b9-b092-de432e58f680 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:20.265412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3bf8e51-f629-44b9-b092-de432e58f680 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:20.265850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3bf8e51-f629-44b9-b092-de432e58f680 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:20.283754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:20.303153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f3bf8e51-f629-44b9-b092-de432e58f680 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051897 Jul 14 15:44:20.303757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 425/909] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:20.947360 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-eca2ae6f-ec55-4e12-9d8e-dd00aa53cf27 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:20.947990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-eca2ae6f-ec55-4e12-9d8e-dd00aa53cf27 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:20.955381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eca2ae6f-ec55-4e12-9d8e-dd00aa53cf27 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:20.956228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eca2ae6f-ec55-4e12-9d8e-dd00aa53cf27 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:20.957637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eca2ae6f-ec55-4e12-9d8e-dd00aa53cf27 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:20.958415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eca2ae6f-ec55-4e12-9d8e-dd00aa53cf27 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:21.033174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-eca2ae6f-ec55-4e12-9d8e-dd00aa53cf27 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:21.040890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-eca2ae6f-ec55-4e12-9d8e-dd00aa53cf27 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.097509 Jul 14 15:44:21.041463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 485/910] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:20 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:21.315531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-95fa70a1-fcc6-4d63-a869-f0702bbc93fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:21.316577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-95fa70a1-fcc6-4d63-a869-f0702bbc93fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:21.324029 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-95fa70a1-fcc6-4d63-a869-f0702bbc93fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:21.324792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-95fa70a1-fcc6-4d63-a869-f0702bbc93fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:21.326158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-95fa70a1-fcc6-4d63-a869-f0702bbc93fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:21.326676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-95fa70a1-fcc6-4d63-a869-f0702bbc93fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:21.360835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-95fa70a1-fcc6-4d63-a869-f0702bbc93fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049277 Jul 14 15:44:21.361352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 426/911] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:21 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:22.058801 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-23755f04-fbef-4507-9b24-e06f89936c9e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:22.059441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-23755f04-fbef-4507-9b24-e06f89936c9e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:22.066481 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23755f04-fbef-4507-9b24-e06f89936c9e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:22.066956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23755f04-fbef-4507-9b24-e06f89936c9e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:22.067757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23755f04-fbef-4507-9b24-e06f89936c9e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:22.068205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-23755f04-fbef-4507-9b24-e06f89936c9e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:22.131610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-23755f04-fbef-4507-9b24-e06f89936c9e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:22.139378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-23755f04-fbef-4507-9b24-e06f89936c9e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.085046 Jul 14 15:44:22.139978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 486/912] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:22 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:22.373291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bcf16fe0-753e-4c8b-89b1-0f826053770e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:22.374113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bcf16fe0-753e-4c8b-89b1-0f826053770e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:22.380504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bcf16fe0-753e-4c8b-89b1-0f826053770e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:22.380980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bcf16fe0-753e-4c8b-89b1-0f826053770e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:22.381731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bcf16fe0-753e-4c8b-89b1-0f826053770e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:22.382190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bcf16fe0-753e-4c8b-89b1-0f826053770e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:22.416179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bcf16fe0-753e-4c8b-89b1-0f826053770e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047522 Jul 14 15:44:22.416740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 427/913] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:22 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:23.156904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a69071cb-0f0d-4864-99f8-7fd70b6972bb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:23.157530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a69071cb-0f0d-4864-99f8-7fd70b6972bb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:23.164380 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a69071cb-0f0d-4864-99f8-7fd70b6972bb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:23.164833 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a69071cb-0f0d-4864-99f8-7fd70b6972bb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:23.165649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a69071cb-0f0d-4864-99f8-7fd70b6972bb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:23.166091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a69071cb-0f0d-4864-99f8-7fd70b6972bb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:23.229595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a69071cb-0f0d-4864-99f8-7fd70b6972bb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:23.237123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a69071cb-0f0d-4864-99f8-7fd70b6972bb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.085164 Jul 14 15:44:23.237698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 487/914] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:23 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:23.428862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-845211b2-fe28-4f55-a237-e6dc4743e49f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:23.429768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-845211b2-fe28-4f55-a237-e6dc4743e49f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:23.436847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-845211b2-fe28-4f55-a237-e6dc4743e49f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:23.437286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-845211b2-fe28-4f55-a237-e6dc4743e49f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:23.438046 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-845211b2-fe28-4f55-a237-e6dc4743e49f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:23.438476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-845211b2-fe28-4f55-a237-e6dc4743e49f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:23.469176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-845211b2-fe28-4f55-a237-e6dc4743e49f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044269 Jul 14 15:44:23.469748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 428/915] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:23 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:24.144848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cf8f0159-fd32-4a6f-ae1e-7c250db2d82b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:24.145388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cf8f0159-fd32-4a6f-ae1e-7c250db2d82b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:24.151670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf8f0159-fd32-4a6f-ae1e-7c250db2d82b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:24.152125 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf8f0159-fd32-4a6f-ae1e-7c250db2d82b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:24.153592 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf8f0159-fd32-4a6f-ae1e-7c250db2d82b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:24.154071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf8f0159-fd32-4a6f-ae1e-7c250db2d82b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:24.180230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-cf8f0159-fd32-4a6f-ae1e-7c250db2d82b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lazy-loading 'flavor' on Instance uuid fde2fb02-e844-471d-b2bc-81fc89534875 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:44:24.254262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cf8f0159-fd32-4a6f-ae1e-7c250db2d82b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "POST /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875/action" status: 202 len: 0 microversion: 2.1 time: 0.113184 Jul 14 15:44:24.254957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 488/916] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 15:44:24 2022] POST /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:44:24.255296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-26cc54ef-6b08-4afd-95e9-44caf5225fbc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:24.256213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-26cc54ef-6b08-4afd-95e9-44caf5225fbc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:24.263727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7138b2d5-3bd9-438c-9951-6b8177f8f1b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:24.263968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26cc54ef-6b08-4afd-95e9-44caf5225fbc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:24.264193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26cc54ef-6b08-4afd-95e9-44caf5225fbc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:24.264432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7138b2d5-3bd9-438c-9951-6b8177f8f1b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:24.264975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26cc54ef-6b08-4afd-95e9-44caf5225fbc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:24.265415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26cc54ef-6b08-4afd-95e9-44caf5225fbc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:24.270816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7138b2d5-3bd9-438c-9951-6b8177f8f1b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:24.271265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7138b2d5-3bd9-438c-9951-6b8177f8f1b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:24.272116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7138b2d5-3bd9-438c-9951-6b8177f8f1b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:24.272511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7138b2d5-3bd9-438c-9951-6b8177f8f1b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:24.334421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-26cc54ef-6b08-4afd-95e9-44caf5225fbc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:24.343228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-26cc54ef-6b08-4afd-95e9-44caf5225fbc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.093147 Jul 14 15:44:24.343970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 429/917] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:24 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:24.417702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7138b2d5-3bd9-438c-9951-6b8177f8f1b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:24.425942 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7138b2d5-3bd9-438c-9951-6b8177f8f1b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.166902 Jul 14 15:44:24.426514 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 489/918] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:24 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:24.481661 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0dab0989-f4e9-446e-9ece-aa3d4fa4c8fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:24.482713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0dab0989-f4e9-446e-9ece-aa3d4fa4c8fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:24.489251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0dab0989-f4e9-446e-9ece-aa3d4fa4c8fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:24.489697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0dab0989-f4e9-446e-9ece-aa3d4fa4c8fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:24.490481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0dab0989-f4e9-446e-9ece-aa3d4fa4c8fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:24.490915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0dab0989-f4e9-446e-9ece-aa3d4fa4c8fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:24.521560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0dab0989-f4e9-446e-9ece-aa3d4fa4c8fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044360 Jul 14 15:44:24.522028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 430/919] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:24 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:25.361842 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c21fe1b4-4bb3-4f50-8db3-2d9db6f9ff75 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:25.362759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c21fe1b4-4bb3-4f50-8db3-2d9db6f9ff75 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:25.370880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c21fe1b4-4bb3-4f50-8db3-2d9db6f9ff75 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:25.371335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c21fe1b4-4bb3-4f50-8db3-2d9db6f9ff75 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:25.372167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c21fe1b4-4bb3-4f50-8db3-2d9db6f9ff75 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:25.373466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c21fe1b4-4bb3-4f50-8db3-2d9db6f9ff75 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:25.441181 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c21fe1b4-4bb3-4f50-8db3-2d9db6f9ff75 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:25.444365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7b70bb75-7319-4208-b18a-71c687fe6580 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:25.444989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7b70bb75-7319-4208-b18a-71c687fe6580 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:25.449433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c21fe1b4-4bb3-4f50-8db3-2d9db6f9ff75 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.093127 Jul 14 15:44:25.450280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 490/920] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:25 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:25.451919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7b70bb75-7319-4208-b18a-71c687fe6580 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:25.452341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7b70bb75-7319-4208-b18a-71c687fe6580 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:25.453127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7b70bb75-7319-4208-b18a-71c687fe6580 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:25.453567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7b70bb75-7319-4208-b18a-71c687fe6580 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:25.533300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0a61f419-773e-4458-b524-ba7f98564bbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:25.534333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0a61f419-773e-4458-b524-ba7f98564bbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:25.540567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a61f419-773e-4458-b524-ba7f98564bbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:25.541017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a61f419-773e-4458-b524-ba7f98564bbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:25.541783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a61f419-773e-4458-b524-ba7f98564bbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:25.542226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a61f419-773e-4458-b524-ba7f98564bbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:25.572652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0a61f419-773e-4458-b524-ba7f98564bbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044017 Jul 14 15:44:25.573230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 491/921] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:25 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:25.591759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7b70bb75-7319-4208-b18a-71c687fe6580 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:25.599919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7b70bb75-7319-4208-b18a-71c687fe6580 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.159300 Jul 14 15:44:25.600494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 431/922] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:25 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:26.471293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-432db306-4bc9-4dd5-aa3e-1de83ff63f78 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:26.471944 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-432db306-4bc9-4dd5-aa3e-1de83ff63f78 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:26.480741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-432db306-4bc9-4dd5-aa3e-1de83ff63f78 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:26.481193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-432db306-4bc9-4dd5-aa3e-1de83ff63f78 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:26.483046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-432db306-4bc9-4dd5-aa3e-1de83ff63f78 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:26.483814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-432db306-4bc9-4dd5-aa3e-1de83ff63f78 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:26.552530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-432db306-4bc9-4dd5-aa3e-1de83ff63f78 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:26.562623 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-432db306-4bc9-4dd5-aa3e-1de83ff63f78 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.095957 Jul 14 15:44:26.564100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 492/923] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:26 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:26.585104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f82a721a-1362-4475-abdb-0a90b98d9d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:26.586051 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f82a721a-1362-4475-abdb-0a90b98d9d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:26.593765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f82a721a-1362-4475-abdb-0a90b98d9d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:26.594400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f82a721a-1362-4475-abdb-0a90b98d9d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:26.594971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f82a721a-1362-4475-abdb-0a90b98d9d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:26.595402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f82a721a-1362-4475-abdb-0a90b98d9d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:26.617958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f834d4cd-d737-4c5a-a2e0-f068374dabee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:26.618823 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f834d4cd-d737-4c5a-a2e0-f068374dabee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:26.625104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f834d4cd-d737-4c5a-a2e0-f068374dabee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:26.625547 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f834d4cd-d737-4c5a-a2e0-f068374dabee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:26.626311 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f834d4cd-d737-4c5a-a2e0-f068374dabee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:26.626738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f834d4cd-d737-4c5a-a2e0-f068374dabee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:26.626908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f82a721a-1362-4475-abdb-0a90b98d9d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045762 Jul 14 15:44:26.627491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 432/924] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:26 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:26.767320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f834d4cd-d737-4c5a-a2e0-f068374dabee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:26.775018 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f834d4cd-d737-4c5a-a2e0-f068374dabee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.160829 Jul 14 15:44:26.775651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 493/925] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:26 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:27.580616 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fa4ec345-4afd-4173-87a9-d1411d27ceb1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:27.581249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fa4ec345-4afd-4173-87a9-d1411d27ceb1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:27.587266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa4ec345-4afd-4173-87a9-d1411d27ceb1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:27.587740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa4ec345-4afd-4173-87a9-d1411d27ceb1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:27.588490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa4ec345-4afd-4173-87a9-d1411d27ceb1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:27.588920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa4ec345-4afd-4173-87a9-d1411d27ceb1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:27.638441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-74830a22-52ca-4d0d-9c22-ffb3d7fcb411 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:27.640075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-74830a22-52ca-4d0d-9c22-ffb3d7fcb411 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:27.642488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:27.647763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-74830a22-52ca-4d0d-9c22-ffb3d7fcb411 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:27.648288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-74830a22-52ca-4d0d-9c22-ffb3d7fcb411 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:27.649065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-74830a22-52ca-4d0d-9c22-ffb3d7fcb411 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:27.649503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-74830a22-52ca-4d0d-9c22-ffb3d7fcb411 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:27.655753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fa4ec345-4afd-4173-87a9-d1411d27ceb1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:27.663352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fa4ec345-4afd-4173-87a9-d1411d27ceb1 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.087143 Jul 14 15:44:27.663881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 433/926] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:27 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:27.681555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-74830a22-52ca-4d0d-9c22-ffb3d7fcb411 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047015 Jul 14 15:44:27.682207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 494/927] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:27.793334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bb63e5d6-d2e8-4ddf-a6e4-507d5b17ac2f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:27.793950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bb63e5d6-d2e8-4ddf-a6e4-507d5b17ac2f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:27.800232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb63e5d6-d2e8-4ddf-a6e4-507d5b17ac2f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:27.800714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb63e5d6-d2e8-4ddf-a6e4-507d5b17ac2f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:27.801472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb63e5d6-d2e8-4ddf-a6e4-507d5b17ac2f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:27.801902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb63e5d6-d2e8-4ddf-a6e4-507d5b17ac2f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:27.933358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bb63e5d6-d2e8-4ddf-a6e4-507d5b17ac2f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:27.941818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bb63e5d6-d2e8-4ddf-a6e4-507d5b17ac2f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.152344 Jul 14 15:44:27.942381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 434/928] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:27 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:28.680019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a31f1b43-fcda-47d2-b66c-1b368008b6c7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:28.680697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a31f1b43-fcda-47d2-b66c-1b368008b6c7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:28.687631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a31f1b43-fcda-47d2-b66c-1b368008b6c7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:28.688165 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a31f1b43-fcda-47d2-b66c-1b368008b6c7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:28.688936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a31f1b43-fcda-47d2-b66c-1b368008b6c7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:28.689374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a31f1b43-fcda-47d2-b66c-1b368008b6c7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:28.694508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4ad9f8ed-a34a-4f28-8bb6-ba6a54d4196d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:28.694977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4ad9f8ed-a34a-4f28-8bb6-ba6a54d4196d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:28.697028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=62 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:28.702486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ad9f8ed-a34a-4f28-8bb6-ba6a54d4196d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:28.702941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ad9f8ed-a34a-4f28-8bb6-ba6a54d4196d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:28.703742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ad9f8ed-a34a-4f28-8bb6-ba6a54d4196d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:28.704186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ad9f8ed-a34a-4f28-8bb6-ba6a54d4196d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:28.756830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a31f1b43-fcda-47d2-b66c-1b368008b6c7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:28.765162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a31f1b43-fcda-47d2-b66c-1b368008b6c7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.088721 Jul 14 15:44:28.765789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 495/929] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:28 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:28.882977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4ad9f8ed-a34a-4f28-8bb6-ba6a54d4196d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.193115 Jul 14 15:44:28.883531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 435/930] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:28 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:28.959299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-db29685d-340f-4432-a54a-091200b7652b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:28.959840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-db29685d-340f-4432-a54a-091200b7652b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:28.965881 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db29685d-340f-4432-a54a-091200b7652b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:28.966333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db29685d-340f-4432-a54a-091200b7652b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:28.967909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db29685d-340f-4432-a54a-091200b7652b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:28.968434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db29685d-340f-4432-a54a-091200b7652b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:28.972404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:29.101049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-db29685d-340f-4432-a54a-091200b7652b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:29.109493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-db29685d-340f-4432-a54a-091200b7652b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.154116 Jul 14 15:44:29.110214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 496/931] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:28 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:29.782502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-58b2f237-8105-4f03-b536-b5ffa3662e74 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:29.783208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-58b2f237-8105-4f03-b536-b5ffa3662e74 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:29.789753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-58b2f237-8105-4f03-b536-b5ffa3662e74 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:29.790187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-58b2f237-8105-4f03-b536-b5ffa3662e74 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:29.790933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-58b2f237-8105-4f03-b536-b5ffa3662e74 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:29.791363 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-58b2f237-8105-4f03-b536-b5ffa3662e74 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:29.852472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-58b2f237-8105-4f03-b536-b5ffa3662e74 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:29.860821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-58b2f237-8105-4f03-b536-b5ffa3662e74 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.082153 Jul 14 15:44:29.861372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 436/932] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:29 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:29.895204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-83848254-8bce-4f2e-b0ba-cd7379197b2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:29.896159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-83848254-8bce-4f2e-b0ba-cd7379197b2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:29.902684 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83848254-8bce-4f2e-b0ba-cd7379197b2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:29.903393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83848254-8bce-4f2e-b0ba-cd7379197b2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:29.904749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83848254-8bce-4f2e-b0ba-cd7379197b2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:29.905472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83848254-8bce-4f2e-b0ba-cd7379197b2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:29.935331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-83848254-8bce-4f2e-b0ba-cd7379197b2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044076 Jul 14 15:44:29.936032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 497/933] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:29 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:30.129996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-94305982-65a4-4acf-81cd-676af87b01e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:30.130693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-94305982-65a4-4acf-81cd-676af87b01e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:30.137339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-94305982-65a4-4acf-81cd-676af87b01e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:30.137792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-94305982-65a4-4acf-81cd-676af87b01e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:30.138555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-94305982-65a4-4acf-81cd-676af87b01e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:30.139000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-94305982-65a4-4acf-81cd-676af87b01e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:30.277145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-94305982-65a4-4acf-81cd-676af87b01e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:30.286684 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-94305982-65a4-4acf-81cd-676af87b01e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.164201 Jul 14 15:44:30.287262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 437/934] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:30 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:30.882256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c7501fae-d9cc-4130-a228-c24f2b8483c2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:30.882853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c7501fae-d9cc-4130-a228-c24f2b8483c2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:30.888937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7501fae-d9cc-4130-a228-c24f2b8483c2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:30.889602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7501fae-d9cc-4130-a228-c24f2b8483c2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:30.890189 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7501fae-d9cc-4130-a228-c24f2b8483c2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:30.890607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7501fae-d9cc-4130-a228-c24f2b8483c2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:30.948338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ed2a1ebc-3bd6-4e57-805e-329bc5a40f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:30.949424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ed2a1ebc-3bd6-4e57-805e-329bc5a40f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:30.956730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ed2a1ebc-3bd6-4e57-805e-329bc5a40f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:30.956937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c7501fae-d9cc-4130-a228-c24f2b8483c2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:30.957384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ed2a1ebc-3bd6-4e57-805e-329bc5a40f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:30.957960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ed2a1ebc-3bd6-4e57-805e-329bc5a40f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:30.958406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ed2a1ebc-3bd6-4e57-805e-329bc5a40f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:30.967969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c7501fae-d9cc-4130-a228-c24f2b8483c2 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.089723 Jul 14 15:44:30.968917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 498/935] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:30 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:31.003969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ed2a1ebc-3bd6-4e57-805e-329bc5a40f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.060766 Jul 14 15:44:31.004559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 438/936] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:30 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:31.304661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-32d20393-3776-4d53-818c-37e8fb8fa9c6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:31.305280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-32d20393-3776-4d53-818c-37e8fb8fa9c6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:31.312190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32d20393-3776-4d53-818c-37e8fb8fa9c6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:31.312674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32d20393-3776-4d53-818c-37e8fb8fa9c6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:31.313447 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32d20393-3776-4d53-818c-37e8fb8fa9c6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:31.313906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32d20393-3776-4d53-818c-37e8fb8fa9c6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:31.449068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-32d20393-3776-4d53-818c-37e8fb8fa9c6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:31.457267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-32d20393-3776-4d53-818c-37e8fb8fa9c6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.156533 Jul 14 15:44:31.457852 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 499/937] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:31 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:31.984448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9bb839df-4e62-4876-9847-6e78802ddc38 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:31.985063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9bb839df-4e62-4876-9847-6e78802ddc38 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:31.991672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9bb839df-4e62-4876-9847-6e78802ddc38 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:31.992131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9bb839df-4e62-4876-9847-6e78802ddc38 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:31.992904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9bb839df-4e62-4876-9847-6e78802ddc38 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:31.993348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9bb839df-4e62-4876-9847-6e78802ddc38 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:32.015360 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3bf26158-b433-4f69-95ab-fb3c9a3c4697 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:32.016308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3bf26158-b433-4f69-95ab-fb3c9a3c4697 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:32.022760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bf26158-b433-4f69-95ab-fb3c9a3c4697 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:32.023216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bf26158-b433-4f69-95ab-fb3c9a3c4697 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:32.024114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bf26158-b433-4f69-95ab-fb3c9a3c4697 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:32.024553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bf26158-b433-4f69-95ab-fb3c9a3c4697 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:32.055048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3bf26158-b433-4f69-95ab-fb3c9a3c4697 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044220 Jul 14 15:44:32.055660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 500/938] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:32.056204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9bb839df-4e62-4876-9847-6e78802ddc38 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:32.063760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9bb839df-4e62-4876-9847-6e78802ddc38 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.083364 Jul 14 15:44:32.064309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 439/939] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:31 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:32.477845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-80b11ea9-baf9-4738-a196-2041d425be07 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:32.478963 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-80b11ea9-baf9-4738-a196-2041d425be07 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:32.489628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80b11ea9-baf9-4738-a196-2041d425be07 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:32.490412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80b11ea9-baf9-4738-a196-2041d425be07 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:32.491811 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80b11ea9-baf9-4738-a196-2041d425be07 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:32.492597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80b11ea9-baf9-4738-a196-2041d425be07 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:32.651491 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-80b11ea9-baf9-4738-a196-2041d425be07 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:32.660056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-80b11ea9-baf9-4738-a196-2041d425be07 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.189258 Jul 14 15:44:32.660639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 501/940] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:32 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:33.068360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9e11a534-a820-4e48-ad5c-6329002b3429 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:33.069518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9e11a534-a820-4e48-ad5c-6329002b3429 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:33.077497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e11a534-a820-4e48-ad5c-6329002b3429 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:33.077968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e11a534-a820-4e48-ad5c-6329002b3429 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:33.079357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e11a534-a820-4e48-ad5c-6329002b3429 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:33.080063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e11a534-a820-4e48-ad5c-6329002b3429 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:33.082838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bda7de8d-d7f7-44c6-8196-bc7145e5ca8d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:33.083540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bda7de8d-d7f7-44c6-8196-bc7145e5ca8d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:33.094057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bda7de8d-d7f7-44c6-8196-bc7145e5ca8d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:33.094892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bda7de8d-d7f7-44c6-8196-bc7145e5ca8d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:33.096356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bda7de8d-d7f7-44c6-8196-bc7145e5ca8d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:33.097188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bda7de8d-d7f7-44c6-8196-bc7145e5ca8d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:33.116142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9e11a534-a820-4e48-ad5c-6329002b3429 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052885 Jul 14 15:44:33.116738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 440/941] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:33 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:33.186500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bda7de8d-d7f7-44c6-8196-bc7145e5ca8d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:33.194390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bda7de8d-d7f7-44c6-8196-bc7145e5ca8d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.117552 Jul 14 15:44:33.194982 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 502/942] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:33 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:33.678441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-be045305-6dc3-47c0-b0c4-302238a2c7da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:33.679001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-be045305-6dc3-47c0-b0c4-302238a2c7da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:33.684993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-be045305-6dc3-47c0-b0c4-302238a2c7da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:33.685940 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-be045305-6dc3-47c0-b0c4-302238a2c7da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:33.686771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-be045305-6dc3-47c0-b0c4-302238a2c7da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:33.687203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-be045305-6dc3-47c0-b0c4-302238a2c7da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:33.830735 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-be045305-6dc3-47c0-b0c4-302238a2c7da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:33.838375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-be045305-6dc3-47c0-b0c4-302238a2c7da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.164012 Jul 14 15:44:33.838934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 441/943] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:33 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:34.129385 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-db26b5c9-7051-43dd-94b5-862ec6659511 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:34.130308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-db26b5c9-7051-43dd-94b5-862ec6659511 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:34.136851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db26b5c9-7051-43dd-94b5-862ec6659511 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:34.137282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db26b5c9-7051-43dd-94b5-862ec6659511 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:34.138094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db26b5c9-7051-43dd-94b5-862ec6659511 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:34.139034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db26b5c9-7051-43dd-94b5-862ec6659511 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:34.172478 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-db26b5c9-7051-43dd-94b5-862ec6659511 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047014 Jul 14 15:44:34.173507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 503/944] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:34 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:34.211269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2257f9a0-93a5-4786-bd82-408511532896 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:34.211944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2257f9a0-93a5-4786-bd82-408511532896 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:34.219897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2257f9a0-93a5-4786-bd82-408511532896 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:34.220349 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2257f9a0-93a5-4786-bd82-408511532896 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:34.221111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2257f9a0-93a5-4786-bd82-408511532896 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:34.221545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2257f9a0-93a5-4786-bd82-408511532896 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:34.225562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:34.288175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2257f9a0-93a5-4786-bd82-408511532896 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:34.296265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2257f9a0-93a5-4786-bd82-408511532896 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.088833 Jul 14 15:44:34.296825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 442/945] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:34 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:34.856430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e7e24395-9edd-4487-9cc2-7a8029b0c4e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:34.857039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e7e24395-9edd-4487-9cc2-7a8029b0c4e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:34.863876 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7e24395-9edd-4487-9cc2-7a8029b0c4e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:34.864326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7e24395-9edd-4487-9cc2-7a8029b0c4e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:34.865083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7e24395-9edd-4487-9cc2-7a8029b0c4e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:34.865521 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7e24395-9edd-4487-9cc2-7a8029b0c4e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:34.996533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e7e24395-9edd-4487-9cc2-7a8029b0c4e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:35.004737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e7e24395-9edd-4487-9cc2-7a8029b0c4e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.152145 Jul 14 15:44:35.005309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 504/946] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:34 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:35.186683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0d588dfb-7d4d-447e-99ac-30c21df4471d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:35.187650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0d588dfb-7d4d-447e-99ac-30c21df4471d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:35.193773 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d588dfb-7d4d-447e-99ac-30c21df4471d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:35.194220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d588dfb-7d4d-447e-99ac-30c21df4471d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:35.194985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d588dfb-7d4d-447e-99ac-30c21df4471d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:35.195422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d588dfb-7d4d-447e-99ac-30c21df4471d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:35.225830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0d588dfb-7d4d-447e-99ac-30c21df4471d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043960 Jul 14 15:44:35.226496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 443/947] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:35 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:35.313441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fa8050bc-4373-4e1c-a912-5edd822cf5f6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:35.314066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fa8050bc-4373-4e1c-a912-5edd822cf5f6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:35.320669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa8050bc-4373-4e1c-a912-5edd822cf5f6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:35.321118 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa8050bc-4373-4e1c-a912-5edd822cf5f6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:35.321893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa8050bc-4373-4e1c-a912-5edd822cf5f6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:35.322332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa8050bc-4373-4e1c-a912-5edd822cf5f6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:35.534767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fa8050bc-4373-4e1c-a912-5edd822cf5f6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:35.542424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fa8050bc-4373-4e1c-a912-5edd822cf5f6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.233367 Jul 14 15:44:35.542994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 505/948] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:35 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:36.022111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f8a32240-84bb-4d37-b695-3d75aaf3e683 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:36.022716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f8a32240-84bb-4d37-b695-3d75aaf3e683 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:36.029769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8a32240-84bb-4d37-b695-3d75aaf3e683 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:36.030223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8a32240-84bb-4d37-b695-3d75aaf3e683 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:36.030977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8a32240-84bb-4d37-b695-3d75aaf3e683 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:36.031411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8a32240-84bb-4d37-b695-3d75aaf3e683 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:36.173990 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f8a32240-84bb-4d37-b695-3d75aaf3e683 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:36.181482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f8a32240-84bb-4d37-b695-3d75aaf3e683 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.163299 Jul 14 15:44:36.182044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 444/949] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:36 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:36.238002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-91c4b718-3947-44be-b1fe-d46cc801ee2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:36.238924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-91c4b718-3947-44be-b1fe-d46cc801ee2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:36.245006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91c4b718-3947-44be-b1fe-d46cc801ee2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:36.245461 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91c4b718-3947-44be-b1fe-d46cc801ee2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:36.246286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91c4b718-3947-44be-b1fe-d46cc801ee2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:36.246675 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91c4b718-3947-44be-b1fe-d46cc801ee2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:36.276562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-91c4b718-3947-44be-b1fe-d46cc801ee2a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042563 Jul 14 15:44:36.277110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 506/950] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:36 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:36.560635 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-83700347-d999-47e5-a0ef-d5ec65c9ab0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:36.561286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-83700347-d999-47e5-a0ef-d5ec65c9ab0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:36.567544 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83700347-d999-47e5-a0ef-d5ec65c9ab0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:36.568025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83700347-d999-47e5-a0ef-d5ec65c9ab0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:36.568774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83700347-d999-47e5-a0ef-d5ec65c9ab0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:36.569203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83700347-d999-47e5-a0ef-d5ec65c9ab0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:36.632125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-83700347-d999-47e5-a0ef-d5ec65c9ab0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:36.640488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-83700347-d999-47e5-a0ef-d5ec65c9ab0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.083968 Jul 14 15:44:36.641042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 445/951] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:36 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:37.199097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-00e99dad-a387-4079-b31c-43ebf081b640 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:37.199899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-00e99dad-a387-4079-b31c-43ebf081b640 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:37.207174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-00e99dad-a387-4079-b31c-43ebf081b640 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:37.207832 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-00e99dad-a387-4079-b31c-43ebf081b640 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:37.208669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-00e99dad-a387-4079-b31c-43ebf081b640 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:37.209520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-00e99dad-a387-4079-b31c-43ebf081b640 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:37.289422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d6698671-10b7-42ae-aa1e-684855056a11 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:37.290340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d6698671-10b7-42ae-aa1e-684855056a11 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:37.297222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6698671-10b7-42ae-aa1e-684855056a11 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:37.297669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6698671-10b7-42ae-aa1e-684855056a11 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:37.298430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6698671-10b7-42ae-aa1e-684855056a11 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:37.298860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6698671-10b7-42ae-aa1e-684855056a11 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:37.329315 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d6698671-10b7-42ae-aa1e-684855056a11 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043816 Jul 14 15:44:37.329885 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 446/952] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:37 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:37.347979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-00e99dad-a387-4079-b31c-43ebf081b640 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:37.356326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-00e99dad-a387-4079-b31c-43ebf081b640 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.161301 Jul 14 15:44:37.356888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 507/953] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:37 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:37.657827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bc9c1cac-e3ab-430c-a856-cad30fa979be tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:37.658413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bc9c1cac-e3ab-430c-a856-cad30fa979be tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:37.664855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc9c1cac-e3ab-430c-a856-cad30fa979be tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:37.665300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc9c1cac-e3ab-430c-a856-cad30fa979be tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:37.666061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc9c1cac-e3ab-430c-a856-cad30fa979be tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:37.666491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc9c1cac-e3ab-430c-a856-cad30fa979be tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:37.730841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bc9c1cac-e3ab-430c-a856-cad30fa979be tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:37.739041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bc9c1cac-e3ab-430c-a856-cad30fa979be tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.086000 Jul 14 15:44:37.739612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 447/954] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:37 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:38.341687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b0a06374-d34a-41b1-b9a7-ee3feab3c5ec tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:38.342632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b0a06374-d34a-41b1-b9a7-ee3feab3c5ec tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:38.349028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0a06374-d34a-41b1-b9a7-ee3feab3c5ec tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:38.349471 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0a06374-d34a-41b1-b9a7-ee3feab3c5ec tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:38.350225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0a06374-d34a-41b1-b9a7-ee3feab3c5ec tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:38.350656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0a06374-d34a-41b1-b9a7-ee3feab3c5ec tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:38.374564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1f3ff936-a4e9-4856-80df-60c4d4c123eb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:38.375178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1f3ff936-a4e9-4856-80df-60c4d4c123eb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:38.381396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f3ff936-a4e9-4856-80df-60c4d4c123eb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:38.381846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f3ff936-a4e9-4856-80df-60c4d4c123eb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:38.382497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b0a06374-d34a-41b1-b9a7-ee3feab3c5ec tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045001 Jul 14 15:44:38.382655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f3ff936-a4e9-4856-80df-60c4d4c123eb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:38.383068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 508/955] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:38.383179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f3ff936-a4e9-4856-80df-60c4d4c123eb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:38.531245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1f3ff936-a4e9-4856-80df-60c4d4c123eb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:38.538944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1f3ff936-a4e9-4856-80df-60c4d4c123eb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.168837 Jul 14 15:44:38.539512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 448/956] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:38 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:38.755576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0303485d-481e-48c5-96a6-7d581caea89c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:38.756209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0303485d-481e-48c5-96a6-7d581caea89c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:38.762286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0303485d-481e-48c5-96a6-7d581caea89c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:38.762736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0303485d-481e-48c5-96a6-7d581caea89c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:38.764109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0303485d-481e-48c5-96a6-7d581caea89c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:38.764565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0303485d-481e-48c5-96a6-7d581caea89c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:38.828140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0303485d-481e-48c5-96a6-7d581caea89c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:38.835694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0303485d-481e-48c5-96a6-7d581caea89c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.083902 Jul 14 15:44:38.836338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 509/957] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:38 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:39.395508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-96baec53-5712-4fd6-ac5d-5fe2a90cb579 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:39.396485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-96baec53-5712-4fd6-ac5d-5fe2a90cb579 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:39.402964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96baec53-5712-4fd6-ac5d-5fe2a90cb579 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:39.403694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96baec53-5712-4fd6-ac5d-5fe2a90cb579 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:39.405383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96baec53-5712-4fd6-ac5d-5fe2a90cb579 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:39.405827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96baec53-5712-4fd6-ac5d-5fe2a90cb579 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:39.436118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-96baec53-5712-4fd6-ac5d-5fe2a90cb579 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044487 Jul 14 15:44:39.436930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 449/958] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:39 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:39.556392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9db477cc-d0ce-4660-b844-c157aa27167d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:39.557010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9db477cc-d0ce-4660-b844-c157aa27167d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:39.563737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9db477cc-d0ce-4660-b844-c157aa27167d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:39.564132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9db477cc-d0ce-4660-b844-c157aa27167d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:39.564911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9db477cc-d0ce-4660-b844-c157aa27167d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:39.565353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9db477cc-d0ce-4660-b844-c157aa27167d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:39.705750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9db477cc-d0ce-4660-b844-c157aa27167d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:39.713199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9db477cc-d0ce-4660-b844-c157aa27167d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.160656 Jul 14 15:44:39.713754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 510/959] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:39 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:39.852506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0f141ba8-5587-4ab0-b984-15117bd2f955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:39.853135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0f141ba8-5587-4ab0-b984-15117bd2f955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:39.859677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f141ba8-5587-4ab0-b984-15117bd2f955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:39.860130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f141ba8-5587-4ab0-b984-15117bd2f955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:39.860890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f141ba8-5587-4ab0-b984-15117bd2f955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:39.861324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f141ba8-5587-4ab0-b984-15117bd2f955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:39.944482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0f141ba8-5587-4ab0-b984-15117bd2f955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:39.953139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0f141ba8-5587-4ab0-b984-15117bd2f955 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.104475 Jul 14 15:44:39.953957 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 450/960] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:39 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:40.447862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-010abd48-d2ec-421b-8905-92b767e6fc37 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:40.448776 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-010abd48-d2ec-421b-8905-92b767e6fc37 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:40.454905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-010abd48-d2ec-421b-8905-92b767e6fc37 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:40.455348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-010abd48-d2ec-421b-8905-92b767e6fc37 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:40.456210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-010abd48-d2ec-421b-8905-92b767e6fc37 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:40.456648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-010abd48-d2ec-421b-8905-92b767e6fc37 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:40.486177 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-010abd48-d2ec-421b-8905-92b767e6fc37 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042286 Jul 14 15:44:40.486736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 511/961] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:40 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:40.730136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-edacfbd3-750a-49a3-8499-423591cf5578 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:40.730664 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-edacfbd3-750a-49a3-8499-423591cf5578 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:40.738159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-edacfbd3-750a-49a3-8499-423591cf5578 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:40.738612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-edacfbd3-750a-49a3-8499-423591cf5578 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:40.739376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-edacfbd3-750a-49a3-8499-423591cf5578 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:40.739852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-edacfbd3-750a-49a3-8499-423591cf5578 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:40.878840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-edacfbd3-750a-49a3-8499-423591cf5578 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:40.891344 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-edacfbd3-750a-49a3-8499-423591cf5578 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.165105 Jul 14 15:44:40.891957 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 451/962] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:40 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:40.971724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-96d6bd88-aa10-475c-b6c3-bbd555d93884 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:40.972340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-96d6bd88-aa10-475c-b6c3-bbd555d93884 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:40.978405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96d6bd88-aa10-475c-b6c3-bbd555d93884 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:40.978882 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96d6bd88-aa10-475c-b6c3-bbd555d93884 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:40.979658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96d6bd88-aa10-475c-b6c3-bbd555d93884 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:40.980097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96d6bd88-aa10-475c-b6c3-bbd555d93884 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:41.046447 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-96d6bd88-aa10-475c-b6c3-bbd555d93884 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:41.049824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:41.054534 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-96d6bd88-aa10-475c-b6c3-bbd555d93884 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.088145 Jul 14 15:44:41.055135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 512/963] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:40 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:41.498633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b121d6af-a6cc-4ebe-aff7-c2b18b0fadc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:41.499551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b121d6af-a6cc-4ebe-aff7-c2b18b0fadc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:41.505594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b121d6af-a6cc-4ebe-aff7-c2b18b0fadc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:41.506049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b121d6af-a6cc-4ebe-aff7-c2b18b0fadc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:41.506811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b121d6af-a6cc-4ebe-aff7-c2b18b0fadc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:41.507252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b121d6af-a6cc-4ebe-aff7-c2b18b0fadc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:41.536306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b121d6af-a6cc-4ebe-aff7-c2b18b0fadc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042156 Jul 14 15:44:41.536957 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 452/964] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:41 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:41.909256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7e79af06-3302-4eeb-aaf0-a4fd45c9f987 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:41.909876 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7e79af06-3302-4eeb-aaf0-a4fd45c9f987 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:41.916229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e79af06-3302-4eeb-aaf0-a4fd45c9f987 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:41.916690 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e79af06-3302-4eeb-aaf0-a4fd45c9f987 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:41.917456 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e79af06-3302-4eeb-aaf0-a4fd45c9f987 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:41.917897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e79af06-3302-4eeb-aaf0-a4fd45c9f987 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:42.049326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7e79af06-3302-4eeb-aaf0-a4fd45c9f987 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:42.056967 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7e79af06-3302-4eeb-aaf0-a4fd45c9f987 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.151502 Jul 14 15:44:42.057462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 513/965] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:41 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:42.071905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-07aceb1c-917f-4e10-a85d-ab0c8b5df307 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:42.072511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-07aceb1c-917f-4e10-a85d-ab0c8b5df307 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:42.078838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-07aceb1c-917f-4e10-a85d-ab0c8b5df307 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:42.079285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-07aceb1c-917f-4e10-a85d-ab0c8b5df307 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:42.080072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-07aceb1c-917f-4e10-a85d-ab0c8b5df307 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:42.080506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-07aceb1c-917f-4e10-a85d-ab0c8b5df307 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:42.141142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-07aceb1c-917f-4e10-a85d-ab0c8b5df307 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:42.148596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-07aceb1c-917f-4e10-a85d-ab0c8b5df307 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.080640 Jul 14 15:44:42.149159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 453/966] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:42 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:42.548773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-661b1227-6b16-43c4-9094-d5f1ec47c145 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:42.549691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-661b1227-6b16-43c4-9094-d5f1ec47c145 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:42.555773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-661b1227-6b16-43c4-9094-d5f1ec47c145 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:42.556224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-661b1227-6b16-43c4-9094-d5f1ec47c145 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:42.556987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-661b1227-6b16-43c4-9094-d5f1ec47c145 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:42.557419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-661b1227-6b16-43c4-9094-d5f1ec47c145 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:42.588036 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-661b1227-6b16-43c4-9094-d5f1ec47c145 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043205 Jul 14 15:44:42.588593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 514/967] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:42 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:43.073169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-54976632-e40a-4a30-8617-bcce014606dc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:43.073771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-54976632-e40a-4a30-8617-bcce014606dc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:43.080387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-54976632-e40a-4a30-8617-bcce014606dc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:43.080831 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-54976632-e40a-4a30-8617-bcce014606dc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:43.081611 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-54976632-e40a-4a30-8617-bcce014606dc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:43.082040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-54976632-e40a-4a30-8617-bcce014606dc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:43.165951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6150a55f-764c-40e0-91cd-8afa3341c0bd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:43.166564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6150a55f-764c-40e0-91cd-8afa3341c0bd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:43.173938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6150a55f-764c-40e0-91cd-8afa3341c0bd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:43.174390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6150a55f-764c-40e0-91cd-8afa3341c0bd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:43.175161 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6150a55f-764c-40e0-91cd-8afa3341c0bd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:43.175619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6150a55f-764c-40e0-91cd-8afa3341c0bd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:43.215003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-54976632-e40a-4a30-8617-bcce014606dc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:43.222832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-54976632-e40a-4a30-8617-bcce014606dc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.153468 Jul 14 15:44:43.223542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 454/968] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:43 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:43.237711 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6150a55f-764c-40e0-91cd-8afa3341c0bd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:43.245124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6150a55f-764c-40e0-91cd-8afa3341c0bd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.083031 Jul 14 15:44:43.245679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 515/969] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:43 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:43.601607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d1e8814a-eaf1-4c52-87c9-7ece6e661716 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:43.602527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d1e8814a-eaf1-4c52-87c9-7ece6e661716 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:43.609301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d1e8814a-eaf1-4c52-87c9-7ece6e661716 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:43.609741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d1e8814a-eaf1-4c52-87c9-7ece6e661716 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:43.610495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d1e8814a-eaf1-4c52-87c9-7ece6e661716 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:43.610924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d1e8814a-eaf1-4c52-87c9-7ece6e661716 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:43.641359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d1e8814a-eaf1-4c52-87c9-7ece6e661716 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044488 Jul 14 15:44:43.641925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 455/970] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:43 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:44.240923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fb9739d3-db7a-4f90-968e-2be5e7917498 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:44.241531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fb9739d3-db7a-4f90-968e-2be5e7917498 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:44.249080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb9739d3-db7a-4f90-968e-2be5e7917498 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:44.249463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb9739d3-db7a-4f90-968e-2be5e7917498 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:44.250248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb9739d3-db7a-4f90-968e-2be5e7917498 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:44.250693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb9739d3-db7a-4f90-968e-2be5e7917498 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:44.262291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7e371f4e-0240-40bc-a7ff-177a803952ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:44.262886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7e371f4e-0240-40bc-a7ff-177a803952ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:44.270056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e371f4e-0240-40bc-a7ff-177a803952ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:44.270507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e371f4e-0240-40bc-a7ff-177a803952ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:44.271272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e371f4e-0240-40bc-a7ff-177a803952ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:44.271734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e371f4e-0240-40bc-a7ff-177a803952ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:44.337504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7e371f4e-0240-40bc-a7ff-177a803952ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:44.345886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7e371f4e-0240-40bc-a7ff-177a803952ae tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.087491 Jul 14 15:44:44.346469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 456/971] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:44 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:44.391951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fb9739d3-db7a-4f90-968e-2be5e7917498 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:44.400339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fb9739d3-db7a-4f90-968e-2be5e7917498 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.163250 Jul 14 15:44:44.400915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 516/972] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:44 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:44.608639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-15fb4dea-250c-4a71-a16a-174e16e6dc46 req-b7d9573f-6ed5-4be1-bb22-03dc456510da service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde2fb02-e844-471d-b2bc-81fc89534875", "name": "network-vif-unplugged", "status": "completed", "tag": "fed6f852-a2ff-4105-8fe1-d37f2cf9b9cd"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 15:44:44.617320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-15fb4dea-250c-4a71-a16a-174e16e6dc46 req-b7d9573f-6ed5-4be1-bb22-03dc456510da service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:44.617753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-15fb4dea-250c-4a71-a16a-174e16e6dc46 req-b7d9573f-6ed5-4be1-bb22-03dc456510da service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:44.629323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-15fb4dea-250c-4a71-a16a-174e16e6dc46 req-b7d9573f-6ed5-4be1-bb22-03dc456510da service nova] Creating event network-vif-unplugged:fed6f852-a2ff-4105-8fe1-d37f2cf9b9cd for instance fde2fb02-e844-471d-b2bc-81fc89534875 on hv-cinder-82651 Jul 14 15:44:44.634690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-15fb4dea-250c-4a71-a16a-174e16e6dc46 req-b7d9573f-6ed5-4be1-bb22-03dc456510da service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.158596 Jul 14 15:44:44.635276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 457/973] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 15:44:44 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 15:44:44.653446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0414fac2-7eeb-4ec2-a14e-feafe3db6fbf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:44.654687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0414fac2-7eeb-4ec2-a14e-feafe3db6fbf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:44.662943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0414fac2-7eeb-4ec2-a14e-feafe3db6fbf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:44.663404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0414fac2-7eeb-4ec2-a14e-feafe3db6fbf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:44.664227 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0414fac2-7eeb-4ec2-a14e-feafe3db6fbf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:44.664692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0414fac2-7eeb-4ec2-a14e-feafe3db6fbf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:44.697244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0414fac2-7eeb-4ec2-a14e-feafe3db6fbf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047973 Jul 14 15:44:44.697812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 517/974] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:45.363915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e63ba380-64d2-4826-a117-0336832ef436 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:45.364538 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e63ba380-64d2-4826-a117-0336832ef436 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:45.371302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e63ba380-64d2-4826-a117-0336832ef436 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:45.371805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e63ba380-64d2-4826-a117-0336832ef436 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:45.372563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e63ba380-64d2-4826-a117-0336832ef436 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:45.373675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e63ba380-64d2-4826-a117-0336832ef436 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:45.417599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-61d60eee-28e5-48aa-a409-bd6645a52811 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:45.418345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-61d60eee-28e5-48aa-a409-bd6645a52811 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:45.425833 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-61d60eee-28e5-48aa-a409-bd6645a52811 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:45.426286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-61d60eee-28e5-48aa-a409-bd6645a52811 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:45.427254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-61d60eee-28e5-48aa-a409-bd6645a52811 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:45.427725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-61d60eee-28e5-48aa-a409-bd6645a52811 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:45.444757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e63ba380-64d2-4826-a117-0336832ef436 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:45.452950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e63ba380-64d2-4826-a117-0336832ef436 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.093576 Jul 14 15:44:45.453511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 458/975] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:45 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:45.563948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-61d60eee-28e5-48aa-a409-bd6645a52811 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:45.571463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-61d60eee-28e5-48aa-a409-bd6645a52811 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.157669 Jul 14 15:44:45.572077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 518/976] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:45 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:45.709502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-22b6a3d4-8992-4c5d-bb9b-a9ecd5496de5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:45.710420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-22b6a3d4-8992-4c5d-bb9b-a9ecd5496de5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:45.717052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22b6a3d4-8992-4c5d-bb9b-a9ecd5496de5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:45.717790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22b6a3d4-8992-4c5d-bb9b-a9ecd5496de5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:45.718541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22b6a3d4-8992-4c5d-bb9b-a9ecd5496de5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:45.718978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22b6a3d4-8992-4c5d-bb9b-a9ecd5496de5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:45.739622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:45.753694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-22b6a3d4-8992-4c5d-bb9b-a9ecd5496de5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048143 Jul 14 15:44:45.754285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 459/977] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:45 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:46.470389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8ceb4a88-b155-430d-b041-6c4fc673e912 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:46.471013 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8ceb4a88-b155-430d-b041-6c4fc673e912 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:46.477594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ceb4a88-b155-430d-b041-6c4fc673e912 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:46.478043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ceb4a88-b155-430d-b041-6c4fc673e912 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:46.478819 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ceb4a88-b155-430d-b041-6c4fc673e912 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:46.479259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ceb4a88-b155-430d-b041-6c4fc673e912 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:46.544952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8ceb4a88-b155-430d-b041-6c4fc673e912 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:46.553360 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8ceb4a88-b155-430d-b041-6c4fc673e912 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.087518 Jul 14 15:44:46.553945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 519/978] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:46 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:46.588492 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-40a71765-33e8-431a-a6de-5ca8d2988827 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:46.589110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-40a71765-33e8-431a-a6de-5ca8d2988827 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:46.595754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40a71765-33e8-431a-a6de-5ca8d2988827 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:46.596212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40a71765-33e8-431a-a6de-5ca8d2988827 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:46.596980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40a71765-33e8-431a-a6de-5ca8d2988827 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:46.597423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40a71765-33e8-431a-a6de-5ca8d2988827 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:46.734143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-40a71765-33e8-431a-a6de-5ca8d2988827 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:46.741782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-40a71765-33e8-431a-a6de-5ca8d2988827 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.157225 Jul 14 15:44:46.742351 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 460/979] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:46 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:46.766774 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-80a6bc6b-d43b-4b4e-ab4c-dd7b1382e771 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:46.767793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-80a6bc6b-d43b-4b4e-ab4c-dd7b1382e771 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:46.773860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80a6bc6b-d43b-4b4e-ab4c-dd7b1382e771 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:46.774299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80a6bc6b-d43b-4b4e-ab4c-dd7b1382e771 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:46.775057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80a6bc6b-d43b-4b4e-ab4c-dd7b1382e771 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:46.775484 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80a6bc6b-d43b-4b4e-ab4c-dd7b1382e771 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:46.808438 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-80a6bc6b-d43b-4b4e-ab4c-dd7b1382e771 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046399 Jul 14 15:44:46.809003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 520/980] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:46 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:47.572900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ee70cfe3-43a7-422e-b1c4-a0a353aeae8c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:47.573502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ee70cfe3-43a7-422e-b1c4-a0a353aeae8c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:47.579866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee70cfe3-43a7-422e-b1c4-a0a353aeae8c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:47.580312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee70cfe3-43a7-422e-b1c4-a0a353aeae8c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:47.581068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee70cfe3-43a7-422e-b1c4-a0a353aeae8c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:47.581498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee70cfe3-43a7-422e-b1c4-a0a353aeae8c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:47.645042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ee70cfe3-43a7-422e-b1c4-a0a353aeae8c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:47.653526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ee70cfe3-43a7-422e-b1c4-a0a353aeae8c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.084986 Jul 14 15:44:47.654222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 461/981] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:47 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:47.759697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-19116112-d638-4de2-800b-5addda7ce9f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:47.760252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-19116112-d638-4de2-800b-5addda7ce9f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:47.766861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-19116112-d638-4de2-800b-5addda7ce9f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:47.767302 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-19116112-d638-4de2-800b-5addda7ce9f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:47.768101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-19116112-d638-4de2-800b-5addda7ce9f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:47.768538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-19116112-d638-4de2-800b-5addda7ce9f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:47.821597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-66ea8c1e-e369-479f-a799-8fec418533ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:47.822510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-66ea8c1e-e369-479f-a799-8fec418533ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:47.828766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66ea8c1e-e369-479f-a799-8fec418533ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:47.829536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66ea8c1e-e369-479f-a799-8fec418533ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:47.830174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66ea8c1e-e369-479f-a799-8fec418533ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:47.830603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66ea8c1e-e369-479f-a799-8fec418533ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:47.860849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-66ea8c1e-e369-479f-a799-8fec418533ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043138 Jul 14 15:44:47.861411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 462/982] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:47 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:47.906248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-19116112-d638-4de2-800b-5addda7ce9f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:47.913768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-19116112-d638-4de2-800b-5addda7ce9f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.158057 Jul 14 15:44:47.914332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 521/983] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:47 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:48.671512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5975e19a-ed6a-4585-ba9f-60b938cd7dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:48.672166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5975e19a-ed6a-4585-ba9f-60b938cd7dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:48.678697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5975e19a-ed6a-4585-ba9f-60b938cd7dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:48.679147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5975e19a-ed6a-4585-ba9f-60b938cd7dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:48.679947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5975e19a-ed6a-4585-ba9f-60b938cd7dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:48.680383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5975e19a-ed6a-4585-ba9f-60b938cd7dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:48.747276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5975e19a-ed6a-4585-ba9f-60b938cd7dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:48.755157 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5975e19a-ed6a-4585-ba9f-60b938cd7dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.088766 Jul 14 15:44:48.755945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 463/984] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:48 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:48.872687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-484f8837-6e7c-4242-9f57-22b385b84cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:48.873884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-484f8837-6e7c-4242-9f57-22b385b84cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:48.881063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-484f8837-6e7c-4242-9f57-22b385b84cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:48.881517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-484f8837-6e7c-4242-9f57-22b385b84cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:48.882290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-484f8837-6e7c-4242-9f57-22b385b84cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:48.882731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-484f8837-6e7c-4242-9f57-22b385b84cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:48.913483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-484f8837-6e7c-4242-9f57-22b385b84cc6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044835 Jul 14 15:44:48.914052 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 522/985] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:48 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:48.931437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-81b26099-3e9f-415c-b3cc-d3fb332ae40f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:48.932024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-81b26099-3e9f-415c-b3cc-d3fb332ae40f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:48.939185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-81b26099-3e9f-415c-b3cc-d3fb332ae40f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:48.939623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-81b26099-3e9f-415c-b3cc-d3fb332ae40f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:48.940404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-81b26099-3e9f-415c-b3cc-d3fb332ae40f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:48.940836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-81b26099-3e9f-415c-b3cc-d3fb332ae40f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:49.091166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-81b26099-3e9f-415c-b3cc-d3fb332ae40f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:49.100138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-81b26099-3e9f-415c-b3cc-d3fb332ae40f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.172657 Jul 14 15:44:49.100702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 464/986] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:48 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:49.771924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-24bbf320-d842-4204-9dc9-8b181c329cf9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:49.772522 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-24bbf320-d842-4204-9dc9-8b181c329cf9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:49.779923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-24bbf320-d842-4204-9dc9-8b181c329cf9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:49.780542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-24bbf320-d842-4204-9dc9-8b181c329cf9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:49.781274 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-24bbf320-d842-4204-9dc9-8b181c329cf9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:49.781739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-24bbf320-d842-4204-9dc9-8b181c329cf9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:49.846485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-24bbf320-d842-4204-9dc9-8b181c329cf9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:49.854342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-24bbf320-d842-4204-9dc9-8b181c329cf9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.086535 Jul 14 15:44:49.854910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 523/987] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:49 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:49.925350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b99f9eca-324f-49d9-b62e-e1ea06b85f68 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:49.926368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b99f9eca-324f-49d9-b62e-e1ea06b85f68 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:49.933257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b99f9eca-324f-49d9-b62e-e1ea06b85f68 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:49.933709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b99f9eca-324f-49d9-b62e-e1ea06b85f68 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:49.934506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b99f9eca-324f-49d9-b62e-e1ea06b85f68 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:49.934962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b99f9eca-324f-49d9-b62e-e1ea06b85f68 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:49.964364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b99f9eca-324f-49d9-b62e-e1ea06b85f68 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042973 Jul 14 15:44:49.964931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 465/988] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:49 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:50.118060 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ca89e441-2dfc-46eb-bf49-d2ee62ca769e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:50.118636 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ca89e441-2dfc-46eb-bf49-d2ee62ca769e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:50.125111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca89e441-2dfc-46eb-bf49-d2ee62ca769e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:50.125570 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca89e441-2dfc-46eb-bf49-d2ee62ca769e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:50.126333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca89e441-2dfc-46eb-bf49-d2ee62ca769e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:50.126773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca89e441-2dfc-46eb-bf49-d2ee62ca769e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:50.266578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ca89e441-2dfc-46eb-bf49-d2ee62ca769e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:50.274342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ca89e441-2dfc-46eb-bf49-d2ee62ca769e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.160202 Jul 14 15:44:50.274994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 524/989] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:50 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:50.871902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c595a2d5-f6a4-440d-b267-7a9e509de47d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:50.872514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c595a2d5-f6a4-440d-b267-7a9e509de47d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:50.878647 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c595a2d5-f6a4-440d-b267-7a9e509de47d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:50.879095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c595a2d5-f6a4-440d-b267-7a9e509de47d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:50.879892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c595a2d5-f6a4-440d-b267-7a9e509de47d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:50.880328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c595a2d5-f6a4-440d-b267-7a9e509de47d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:50.945017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c595a2d5-f6a4-440d-b267-7a9e509de47d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:50.953372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c595a2d5-f6a4-440d-b267-7a9e509de47d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.085564 Jul 14 15:44:50.954313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 466/990] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:50 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:50.976524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1660a0fd-dc5e-4fb3-87f2-0e3383577efe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:50.977438 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1660a0fd-dc5e-4fb3-87f2-0e3383577efe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:50.984038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1660a0fd-dc5e-4fb3-87f2-0e3383577efe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:50.984814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1660a0fd-dc5e-4fb3-87f2-0e3383577efe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:50.986207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1660a0fd-dc5e-4fb3-87f2-0e3383577efe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:50.987010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1660a0fd-dc5e-4fb3-87f2-0e3383577efe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:51.020734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1660a0fd-dc5e-4fb3-87f2-0e3383577efe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048064 Jul 14 15:44:51.021308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 525/991] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:50 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:51.292379 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2bfe4840-26d4-4245-978c-f3c7d0c4970d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:51.292976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2bfe4840-26d4-4245-978c-f3c7d0c4970d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:51.300461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2bfe4840-26d4-4245-978c-f3c7d0c4970d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:51.300913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2bfe4840-26d4-4245-978c-f3c7d0c4970d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:51.301669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2bfe4840-26d4-4245-978c-f3c7d0c4970d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:51.302101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2bfe4840-26d4-4245-978c-f3c7d0c4970d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:51.444126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2bfe4840-26d4-4245-978c-f3c7d0c4970d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:51.451854 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2bfe4840-26d4-4245-978c-f3c7d0c4970d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.163330 Jul 14 15:44:51.452425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 467/992] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:51 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:51.970495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dc2bbb3b-44fe-400b-8452-fcb52f280851 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:51.971162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dc2bbb3b-44fe-400b-8452-fcb52f280851 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:51.977771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc2bbb3b-44fe-400b-8452-fcb52f280851 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:51.978221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc2bbb3b-44fe-400b-8452-fcb52f280851 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:51.978983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc2bbb3b-44fe-400b-8452-fcb52f280851 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:51.979423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc2bbb3b-44fe-400b-8452-fcb52f280851 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:52.033265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5de8830a-611e-4c37-ab88-1af4caebcca8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:52.034278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5de8830a-611e-4c37-ab88-1af4caebcca8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:52.040892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5de8830a-611e-4c37-ab88-1af4caebcca8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:52.041443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5de8830a-611e-4c37-ab88-1af4caebcca8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:52.042322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5de8830a-611e-4c37-ab88-1af4caebcca8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:52.042991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5de8830a-611e-4c37-ab88-1af4caebcca8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:52.047278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-dc2bbb3b-44fe-400b-8452-fcb52f280851 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:52.054721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dc2bbb3b-44fe-400b-8452-fcb52f280851 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.088081 Jul 14 15:44:52.055278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 526/993] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:51 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:52.075524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5de8830a-611e-4c37-ab88-1af4caebcca8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046938 Jul 14 15:44:52.076186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 468/994] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:52 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:52.469744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-caa27aa4-9638-4bb9-bff1-d9c19fc5473f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:52.470355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-caa27aa4-9638-4bb9-bff1-d9c19fc5473f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:52.476514 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-caa27aa4-9638-4bb9-bff1-d9c19fc5473f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:52.476971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-caa27aa4-9638-4bb9-bff1-d9c19fc5473f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:52.477725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-caa27aa4-9638-4bb9-bff1-d9c19fc5473f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:52.478155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-caa27aa4-9638-4bb9-bff1-d9c19fc5473f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:52.616945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-caa27aa4-9638-4bb9-bff1-d9c19fc5473f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:52.625097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-caa27aa4-9638-4bb9-bff1-d9c19fc5473f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.159616 Jul 14 15:44:52.625667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 527/995] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:52 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:53.072457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-444d0c2d-4c36-4b35-825b-ce1927fa8dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:53.073185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-444d0c2d-4c36-4b35-825b-ce1927fa8dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:53.080310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-444d0c2d-4c36-4b35-825b-ce1927fa8dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:53.080764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-444d0c2d-4c36-4b35-825b-ce1927fa8dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:53.081527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-444d0c2d-4c36-4b35-825b-ce1927fa8dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:53.081961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-444d0c2d-4c36-4b35-825b-ce1927fa8dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:53.088626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-185cf83e-aeeb-413a-9eca-7841b28fae65 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:53.089688 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-185cf83e-aeeb-413a-9eca-7841b28fae65 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:53.096380 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-185cf83e-aeeb-413a-9eca-7841b28fae65 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:53.096839 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-185cf83e-aeeb-413a-9eca-7841b28fae65 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:53.097616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-185cf83e-aeeb-413a-9eca-7841b28fae65 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:53.098060 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-185cf83e-aeeb-413a-9eca-7841b28fae65 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:53.129812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-185cf83e-aeeb-413a-9eca-7841b28fae65 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045216 Jul 14 15:44:53.130405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 528/996] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:53 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:53.149087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-444d0c2d-4c36-4b35-825b-ce1927fa8dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:53.157736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-444d0c2d-4c36-4b35-825b-ce1927fa8dd9 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.089142 Jul 14 15:44:53.158301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 469/997] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:53 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:53.642544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-70fd670a-b625-4a49-986b-50a99f8901c1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:53.643182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-70fd670a-b625-4a49-986b-50a99f8901c1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:53.649281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70fd670a-b625-4a49-986b-50a99f8901c1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:53.649724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70fd670a-b625-4a49-986b-50a99f8901c1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:53.650500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70fd670a-b625-4a49-986b-50a99f8901c1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:53.650920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70fd670a-b625-4a49-986b-50a99f8901c1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:53.670721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:53.786952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-70fd670a-b625-4a49-986b-50a99f8901c1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:53.793841 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-70fd670a-b625-4a49-986b-50a99f8901c1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.155400 Jul 14 15:44:53.794399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 529/998] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:53 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:54.144724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b013ab31-b29e-4edc-8fe8-95a612e01f6e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:54.145653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b013ab31-b29e-4edc-8fe8-95a612e01f6e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:54.152740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b013ab31-b29e-4edc-8fe8-95a612e01f6e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:54.153191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b013ab31-b29e-4edc-8fe8-95a612e01f6e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:54.154309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b013ab31-b29e-4edc-8fe8-95a612e01f6e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:54.154748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b013ab31-b29e-4edc-8fe8-95a612e01f6e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:54.174976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0c3a3682-1875-4052-b022-160ae1874d7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:54.175580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0c3a3682-1875-4052-b022-160ae1874d7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:54.182020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c3a3682-1875-4052-b022-160ae1874d7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:54.182469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c3a3682-1875-4052-b022-160ae1874d7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:54.183233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c3a3682-1875-4052-b022-160ae1874d7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:54.183691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c3a3682-1875-4052-b022-160ae1874d7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:54.184549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b013ab31-b29e-4edc-8fe8-95a612e01f6e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043966 Jul 14 15:44:54.185121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 470/999] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:54 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:54.249809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0c3a3682-1875-4052-b022-160ae1874d7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:54.257300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0c3a3682-1875-4052-b022-160ae1874d7f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.086570 Jul 14 15:44:54.257906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 530/1000] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:54 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:54.811397 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-69c6dcb1-c332-404d-bc8f-28def6ad66c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:54.812043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-69c6dcb1-c332-404d-bc8f-28def6ad66c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:54.818579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69c6dcb1-c332-404d-bc8f-28def6ad66c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:54.819029 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69c6dcb1-c332-404d-bc8f-28def6ad66c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:54.819822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69c6dcb1-c332-404d-bc8f-28def6ad66c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:54.820259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69c6dcb1-c332-404d-bc8f-28def6ad66c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:54.963382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-69c6dcb1-c332-404d-bc8f-28def6ad66c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:54.973381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-69c6dcb1-c332-404d-bc8f-28def6ad66c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.166132 Jul 14 15:44:54.974096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 471/1001] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:54 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:55.197246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-52226277-89c4-4fe3-a845-4bb5219c97be tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:55.198166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-52226277-89c4-4fe3-a845-4bb5219c97be tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:55.204980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52226277-89c4-4fe3-a845-4bb5219c97be tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:55.205427 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52226277-89c4-4fe3-a845-4bb5219c97be tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:55.206189 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52226277-89c4-4fe3-a845-4bb5219c97be tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:55.206628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52226277-89c4-4fe3-a845-4bb5219c97be tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:55.237099 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-52226277-89c4-4fe3-a845-4bb5219c97be tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044142 Jul 14 15:44:55.237680 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 531/1002] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:55 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:55.274535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-39853f76-11eb-4171-aff0-2b2ec8dad43d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:55.275137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-39853f76-11eb-4171-aff0-2b2ec8dad43d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:55.282381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-39853f76-11eb-4171-aff0-2b2ec8dad43d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:55.282861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-39853f76-11eb-4171-aff0-2b2ec8dad43d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:55.283664 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-39853f76-11eb-4171-aff0-2b2ec8dad43d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:55.284103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-39853f76-11eb-4171-aff0-2b2ec8dad43d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:55.348870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-39853f76-11eb-4171-aff0-2b2ec8dad43d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:55.356607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-39853f76-11eb-4171-aff0-2b2ec8dad43d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.085960 Jul 14 15:44:55.357787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 472/1003] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:55 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:55.991526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-65c51f51-0ee7-4c4f-a533-909b7b7d2b41 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:55.992191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-65c51f51-0ee7-4c4f-a533-909b7b7d2b41 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:56.003875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65c51f51-0ee7-4c4f-a533-909b7b7d2b41 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:56.004350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65c51f51-0ee7-4c4f-a533-909b7b7d2b41 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:56.007088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65c51f51-0ee7-4c4f-a533-909b7b7d2b41 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:56.008744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65c51f51-0ee7-4c4f-a533-909b7b7d2b41 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:56.142907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-65c51f51-0ee7-4c4f-a533-909b7b7d2b41 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:56.150707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-65c51f51-0ee7-4c4f-a533-909b7b7d2b41 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.163070 Jul 14 15:44:56.151284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 532/1004] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:55 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:56.250012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c5ad240f-c076-4c30-8135-4a950778f38e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:56.250841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c5ad240f-c076-4c30-8135-4a950778f38e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:56.257109 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5ad240f-c076-4c30-8135-4a950778f38e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:56.257561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5ad240f-c076-4c30-8135-4a950778f38e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:56.258336 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5ad240f-c076-4c30-8135-4a950778f38e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:56.258783 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5ad240f-c076-4c30-8135-4a950778f38e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:56.290429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c5ad240f-c076-4c30-8135-4a950778f38e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045295 Jul 14 15:44:56.291118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 473/1005] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:56 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:56.374077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-395af52e-4a90-494f-8ca9-fc5283fd8e7a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:56.374720 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-395af52e-4a90-494f-8ca9-fc5283fd8e7a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:56.382557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-395af52e-4a90-494f-8ca9-fc5283fd8e7a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:56.383082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-395af52e-4a90-494f-8ca9-fc5283fd8e7a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:56.383847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-395af52e-4a90-494f-8ca9-fc5283fd8e7a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:56.384292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-395af52e-4a90-494f-8ca9-fc5283fd8e7a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:56.453371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-395af52e-4a90-494f-8ca9-fc5283fd8e7a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:56.461860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-395af52e-4a90-494f-8ca9-fc5283fd8e7a tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.091697 Jul 14 15:44:56.462444 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 533/1006] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:56 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:57.168435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-006d60d7-3175-4ec6-9e3c-4dddc3931220 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:57.169082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-006d60d7-3175-4ec6-9e3c-4dddc3931220 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:57.175368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-006d60d7-3175-4ec6-9e3c-4dddc3931220 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:57.175859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-006d60d7-3175-4ec6-9e3c-4dddc3931220 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:57.176625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-006d60d7-3175-4ec6-9e3c-4dddc3931220 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:57.177068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-006d60d7-3175-4ec6-9e3c-4dddc3931220 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:57.302740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6bc6a866-8808-4831-91e9-4297b6f0605d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:57.303827 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6bc6a866-8808-4831-91e9-4297b6f0605d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:57.308651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-006d60d7-3175-4ec6-9e3c-4dddc3931220 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:57.310549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6bc6a866-8808-4831-91e9-4297b6f0605d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:57.311003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6bc6a866-8808-4831-91e9-4297b6f0605d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:57.311837 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6bc6a866-8808-4831-91e9-4297b6f0605d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:57.313293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6bc6a866-8808-4831-91e9-4297b6f0605d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:57.319504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-006d60d7-3175-4ec6-9e3c-4dddc3931220 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.154898 Jul 14 15:44:57.320978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 474/1007] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:57 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:57.342321 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6bc6a866-8808-4831-91e9-4297b6f0605d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043622 Jul 14 15:44:57.342874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 534/1008] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:57 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:44:57.478451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9779e8d2-6bb0-4be8-ab3c-f61719aedb41 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:57.479064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9779e8d2-6bb0-4be8-ab3c-f61719aedb41 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:57.485716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9779e8d2-6bb0-4be8-ab3c-f61719aedb41 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:57.486166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9779e8d2-6bb0-4be8-ab3c-f61719aedb41 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:57.486931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9779e8d2-6bb0-4be8-ab3c-f61719aedb41 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:57.487365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9779e8d2-6bb0-4be8-ab3c-f61719aedb41 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:57.549750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9779e8d2-6bb0-4be8-ab3c-f61719aedb41 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:57.557262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9779e8d2-6bb0-4be8-ab3c-f61719aedb41 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.082743 Jul 14 15:44:57.557827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 475/1009] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:57 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:58.338318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-15d66ddd-032d-4d86-9907-ea1d263539c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:58.338934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-15d66ddd-032d-4d86-9907-ea1d263539c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:58.341327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=82 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:58.347235 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-15d66ddd-032d-4d86-9907-ea1d263539c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:58.347747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-15d66ddd-032d-4d86-9907-ea1d263539c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:58.348528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-15d66ddd-032d-4d86-9907-ea1d263539c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:58.348972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-15d66ddd-032d-4d86-9907-ea1d263539c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:58.354123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e6838957-3b97-477b-8a9c-eb558b645a4a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:58.355175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e6838957-3b97-477b-8a9c-eb558b645a4a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:58.362475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6838957-3b97-477b-8a9c-eb558b645a4a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:58.362933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6838957-3b97-477b-8a9c-eb558b645a4a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:58.363746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6838957-3b97-477b-8a9c-eb558b645a4a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:58.364189 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6838957-3b97-477b-8a9c-eb558b645a4a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:58.367995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:58.395919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e6838957-3b97-477b-8a9c-eb558b645a4a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045656 Jul 14 15:44:58.396497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 476/1010] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:58 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:58.497135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-15d66ddd-032d-4d86-9907-ea1d263539c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:58.504797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-15d66ddd-032d-4d86-9907-ea1d263539c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.170518 Jul 14 15:44:58.505391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 535/1011] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:58 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:58.574434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-63a46893-01d3-46e3-9d8d-cb231ef9d3d3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:58.574997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-63a46893-01d3-46e3-9d8d-cb231ef9d3d3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:58.581689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63a46893-01d3-46e3-9d8d-cb231ef9d3d3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:58.582133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63a46893-01d3-46e3-9d8d-cb231ef9d3d3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:58.582880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63a46893-01d3-46e3-9d8d-cb231ef9d3d3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:58.583308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63a46893-01d3-46e3-9d8d-cb231ef9d3d3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:58.644099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-63a46893-01d3-46e3-9d8d-cb231ef9d3d3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:58.651530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-63a46893-01d3-46e3-9d8d-cb231ef9d3d3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.081241 Jul 14 15:44:58.652107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 477/1012] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:58 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:44:58.886209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-010ef732-9008-483e-ac48-b0243f3d4ca9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:58.886714 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-010ef732-9008-483e-ac48-b0243f3d4ca9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:58.893398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-010ef732-9008-483e-ac48-b0243f3d4ca9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:58.893854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-010ef732-9008-483e-ac48-b0243f3d4ca9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:58.894633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-010ef732-9008-483e-ac48-b0243f3d4ca9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:58.895179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-010ef732-9008-483e-ac48-b0243f3d4ca9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:59.408335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-539c439c-dab0-42d9-ad04-c3fd2b234178 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:59.409308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-539c439c-dab0-42d9-ad04-c3fd2b234178 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:59.412476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=86 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:44:59.418310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-539c439c-dab0-42d9-ad04-c3fd2b234178 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:59.418846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-539c439c-dab0-42d9-ad04-c3fd2b234178 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:59.419529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-539c439c-dab0-42d9-ad04-c3fd2b234178 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:59.419988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-539c439c-dab0-42d9-ad04-c3fd2b234178 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:59.455437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-539c439c-dab0-42d9-ad04-c3fd2b234178 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.050979 Jul 14 15:44:59.456053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 478/1013] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:44:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:44:59.522670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a25202f1-55d5-4c94-97a8-95c2f4ac4641 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:59.523286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a25202f1-55d5-4c94-97a8-95c2f4ac4641 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:59.529623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a25202f1-55d5-4c94-97a8-95c2f4ac4641 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:59.530066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a25202f1-55d5-4c94-97a8-95c2f4ac4641 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:59.530822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a25202f1-55d5-4c94-97a8-95c2f4ac4641 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:59.531259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a25202f1-55d5-4c94-97a8-95c2f4ac4641 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:59.671161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a25202f1-55d5-4c94-97a8-95c2f4ac4641 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:59.682767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a25202f1-55d5-4c94-97a8-95c2f4ac4641 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.163791 Jul 14 15:44:59.683727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 479/1014] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:59 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:44:59.688146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-639afe3b-d874-4bbe-a864-cbeb54857ff3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:44:59.689420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-639afe3b-d874-4bbe-a864-cbeb54857ff3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:44:59.695485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-639afe3b-d874-4bbe-a864-cbeb54857ff3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:59.695965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-639afe3b-d874-4bbe-a864-cbeb54857ff3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:59.696727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-639afe3b-d874-4bbe-a864-cbeb54857ff3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:44:59.697168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-639afe3b-d874-4bbe-a864-cbeb54857ff3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:44:59.760619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-639afe3b-d874-4bbe-a864-cbeb54857ff3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:44:59.768546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-639afe3b-d874-4bbe-a864-cbeb54857ff3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.083805 Jul 14 15:44:59.769129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 480/1015] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:44:59 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:00.467955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f528ac5f-7528-414a-a759-e4e87aa6121b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:00.468889 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f528ac5f-7528-414a-a759-e4e87aa6121b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:00.476230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f528ac5f-7528-414a-a759-e4e87aa6121b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:00.476679 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f528ac5f-7528-414a-a759-e4e87aa6121b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:00.477455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f528ac5f-7528-414a-a759-e4e87aa6121b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:00.477895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f528ac5f-7528-414a-a759-e4e87aa6121b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:00.510510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f528ac5f-7528-414a-a759-e4e87aa6121b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047200 Jul 14 15:45:00.511088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 481/1016] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:00 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:45:00.700863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-acd55699-21f4-47e3-9081-1c33d0a48b3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:00.701480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-acd55699-21f4-47e3-9081-1c33d0a48b3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:00.707577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acd55699-21f4-47e3-9081-1c33d0a48b3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:00.708059 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acd55699-21f4-47e3-9081-1c33d0a48b3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:00.708823 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acd55699-21f4-47e3-9081-1c33d0a48b3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:00.709261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acd55699-21f4-47e3-9081-1c33d0a48b3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:00.852512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-acd55699-21f4-47e3-9081-1c33d0a48b3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:00.859969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-acd55699-21f4-47e3-9081-1c33d0a48b3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.162977 Jul 14 15:45:00.861182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 482/1017] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:00 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:00.865687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-16426582-3c0e-44c6-99c8-5d7e481eaf0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:00.866298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-16426582-3c0e-44c6-99c8-5d7e481eaf0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:00.871941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16426582-3c0e-44c6-99c8-5d7e481eaf0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:00.872396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16426582-3c0e-44c6-99c8-5d7e481eaf0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:00.873158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16426582-3c0e-44c6-99c8-5d7e481eaf0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:00.873600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16426582-3c0e-44c6-99c8-5d7e481eaf0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:00.934403 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-16426582-3c0e-44c6-99c8-5d7e481eaf0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:00.943218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-16426582-3c0e-44c6-99c8-5d7e481eaf0f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.081095 Jul 14 15:45:00.943871 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 483/1018] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:00 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:01.522879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-36c0de63-0dd3-4f9a-b36c-835e62b36983 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:01.523906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-36c0de63-0dd3-4f9a-b36c-835e62b36983 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:01.530626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36c0de63-0dd3-4f9a-b36c-835e62b36983 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:01.531070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36c0de63-0dd3-4f9a-b36c-835e62b36983 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:01.531850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36c0de63-0dd3-4f9a-b36c-835e62b36983 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:01.532328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36c0de63-0dd3-4f9a-b36c-835e62b36983 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:01.560902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-36c0de63-0dd3-4f9a-b36c-835e62b36983 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041977 Jul 14 15:45:01.561452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 484/1019] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:01 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:45:01.878614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6f585606-d8aa-4cbe-93d7-b893045c453a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:01.879136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6f585606-d8aa-4cbe-93d7-b893045c453a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:01.885293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6f585606-d8aa-4cbe-93d7-b893045c453a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:01.885742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6f585606-d8aa-4cbe-93d7-b893045c453a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:01.886503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6f585606-d8aa-4cbe-93d7-b893045c453a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:01.886944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6f585606-d8aa-4cbe-93d7-b893045c453a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:02.019441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6f585606-d8aa-4cbe-93d7-b893045c453a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:02.027313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6f585606-d8aa-4cbe-93d7-b893045c453a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.153467 Jul 14 15:45:02.027928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 485/1020] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:01 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:02.033085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-442c3765-2517-424e-8c26-40593c9455d7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:02.033703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-442c3765-2517-424e-8c26-40593c9455d7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:02.041246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-442c3765-2517-424e-8c26-40593c9455d7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:02.041696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-442c3765-2517-424e-8c26-40593c9455d7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:02.042470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-442c3765-2517-424e-8c26-40593c9455d7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:02.042908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-442c3765-2517-424e-8c26-40593c9455d7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:02.105989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-442c3765-2517-424e-8c26-40593c9455d7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:02.114975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-442c3765-2517-424e-8c26-40593c9455d7 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.085970 Jul 14 15:45:02.115562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 486/1021] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:02 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:02.573467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8890bbac-fd5e-46a9-af17-30101f8265fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:02.574387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8890bbac-fd5e-46a9-af17-30101f8265fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:02.581331 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8890bbac-fd5e-46a9-af17-30101f8265fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:02.581817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8890bbac-fd5e-46a9-af17-30101f8265fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:02.582578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8890bbac-fd5e-46a9-af17-30101f8265fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:02.583013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8890bbac-fd5e-46a9-af17-30101f8265fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:02.615401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8890bbac-fd5e-46a9-af17-30101f8265fb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045981 Jul 14 15:45:02.615997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 487/1022] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:45:03.045128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a8293da6-b711-430d-979b-d8a2be1b3a14 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:03.045743 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a8293da6-b711-430d-979b-d8a2be1b3a14 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:03.052272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8293da6-b711-430d-979b-d8a2be1b3a14 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:03.052722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8293da6-b711-430d-979b-d8a2be1b3a14 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:03.053478 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8293da6-b711-430d-979b-d8a2be1b3a14 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:03.054219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8293da6-b711-430d-979b-d8a2be1b3a14 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:03.187232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a8293da6-b711-430d-979b-d8a2be1b3a14 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:03.195495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a8293da6-b711-430d-979b-d8a2be1b3a14 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.154359 Jul 14 15:45:03.196097 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 488/1023] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:03 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:03.200455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f9dfed35-6792-4232-bb7a-03549d720295 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:03.201060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f9dfed35-6792-4232-bb7a-03549d720295 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:03.208906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9dfed35-6792-4232-bb7a-03549d720295 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:03.209358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9dfed35-6792-4232-bb7a-03549d720295 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:03.210238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9dfed35-6792-4232-bb7a-03549d720295 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:03.210669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9dfed35-6792-4232-bb7a-03549d720295 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:03.274608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f9dfed35-6792-4232-bb7a-03549d720295 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:03.283817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f9dfed35-6792-4232-bb7a-03549d720295 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.085923 Jul 14 15:45:03.284391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 489/1024] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:03 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:03.627286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ba08af3d-f296-4579-b4d4-3ce5e3aa6e31 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:03.628237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ba08af3d-f296-4579-b4d4-3ce5e3aa6e31 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:03.634242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba08af3d-f296-4579-b4d4-3ce5e3aa6e31 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:03.634697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba08af3d-f296-4579-b4d4-3ce5e3aa6e31 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:03.635458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba08af3d-f296-4579-b4d4-3ce5e3aa6e31 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:03.636033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba08af3d-f296-4579-b4d4-3ce5e3aa6e31 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:03.666378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ba08af3d-f296-4579-b4d4-3ce5e3aa6e31 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043615 Jul 14 15:45:03.667132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 490/1025] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:45:03.795922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:45:03.796503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:45:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:45:04.213429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d39c7931-ca89-41e1-92b2-af38f01835e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:04.214047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d39c7931-ca89-41e1-92b2-af38f01835e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:04.221428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d39c7931-ca89-41e1-92b2-af38f01835e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.221877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d39c7931-ca89-41e1-92b2-af38f01835e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.222639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d39c7931-ca89-41e1-92b2-af38f01835e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.223182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d39c7931-ca89-41e1-92b2-af38f01835e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.355579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d39c7931-ca89-41e1-92b2-af38f01835e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:04.363946 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d39c7931-ca89-41e1-92b2-af38f01835e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.154514 Jul 14 15:45:04.364510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 491/1026] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:04 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:04.368860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-550babc6-9263-42df-b5a7-6dac51079b57 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:04.369468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-550babc6-9263-42df-b5a7-6dac51079b57 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:04.375070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-550babc6-9263-42df-b5a7-6dac51079b57 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.375522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-550babc6-9263-42df-b5a7-6dac51079b57 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.376734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-550babc6-9263-42df-b5a7-6dac51079b57 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.380453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-550babc6-9263-42df-b5a7-6dac51079b57 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.439590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-550babc6-9263-42df-b5a7-6dac51079b57 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:04.443136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:04.449375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-550babc6-9263-42df-b5a7-6dac51079b57 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.083908 Jul 14 15:45:04.449950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 492/1027] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:04 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:04.677713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-49090193-bf17-48ce-a941-e6ca2ef0045e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:04.678656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-49090193-bf17-48ce-a941-e6ca2ef0045e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:04.684805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-49090193-bf17-48ce-a941-e6ca2ef0045e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.685251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-49090193-bf17-48ce-a941-e6ca2ef0045e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.685999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-49090193-bf17-48ce-a941-e6ca2ef0045e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:04.686431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-49090193-bf17-48ce-a941-e6ca2ef0045e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:04.715089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-49090193-bf17-48ce-a941-e6ca2ef0045e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041481 Jul 14 15:45:04.715654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 493/1028] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:45:05.380828 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8c8cacbc-6c94-4c7a-90cd-dbad38e64605 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:05.381394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8c8cacbc-6c94-4c7a-90cd-dbad38e64605 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:05.388008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8c8cacbc-6c94-4c7a-90cd-dbad38e64605 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:05.388463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8c8cacbc-6c94-4c7a-90cd-dbad38e64605 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:05.389227 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8c8cacbc-6c94-4c7a-90cd-dbad38e64605 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:05.389667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8c8cacbc-6c94-4c7a-90cd-dbad38e64605 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:05.521859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8c8cacbc-6c94-4c7a-90cd-dbad38e64605 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:05.529599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8c8cacbc-6c94-4c7a-90cd-dbad38e64605 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.152761 Jul 14 15:45:05.530159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 494/1029] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:05 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:05.534456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c244e2f9-2637-4078-a529-804141336a22 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:05.535028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c244e2f9-2637-4078-a529-804141336a22 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:05.540570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c244e2f9-2637-4078-a529-804141336a22 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:05.541468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c244e2f9-2637-4078-a529-804141336a22 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:05.542211 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c244e2f9-2637-4078-a529-804141336a22 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:05.542643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c244e2f9-2637-4078-a529-804141336a22 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:05.603306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c244e2f9-2637-4078-a529-804141336a22 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:05.610930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c244e2f9-2637-4078-a529-804141336a22 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.079828 Jul 14 15:45:05.611494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 495/1030] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:05 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:05.726548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e8da01d-e631-4afb-bc15-b692be05bb25 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:05.727463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e8da01d-e631-4afb-bc15-b692be05bb25 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:05.733441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e8da01d-e631-4afb-bc15-b692be05bb25 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:05.733887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e8da01d-e631-4afb-bc15-b692be05bb25 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:05.734636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e8da01d-e631-4afb-bc15-b692be05bb25 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:05.735092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e8da01d-e631-4afb-bc15-b692be05bb25 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:05.763930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e8da01d-e631-4afb-bc15-b692be05bb25 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041284 Jul 14 15:45:05.764490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 496/1031] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:05 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 15:45:06.547262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9c93e40d-1c4d-47ba-995a-262b88640efc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:06.548628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9c93e40d-1c4d-47ba-995a-262b88640efc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:06.555072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c93e40d-1c4d-47ba-995a-262b88640efc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:06.555523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c93e40d-1c4d-47ba-995a-262b88640efc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:06.556445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c93e40d-1c4d-47ba-995a-262b88640efc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:06.556880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c93e40d-1c4d-47ba-995a-262b88640efc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:06.694170 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9c93e40d-1c4d-47ba-995a-262b88640efc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:06.701663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9c93e40d-1c4d-47ba-995a-262b88640efc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.158228 Jul 14 15:45:06.702222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 497/1032] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:06 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:06.706800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c70944e9-f3b4-4abb-8d37-c358a75c0fa6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:06.707397 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c70944e9-f3b4-4abb-8d37-c358a75c0fa6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:06.713050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c70944e9-f3b4-4abb-8d37-c358a75c0fa6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:06.713493 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c70944e9-f3b4-4abb-8d37-c358a75c0fa6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:06.714237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c70944e9-f3b4-4abb-8d37-c358a75c0fa6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:06.714666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c70944e9-f3b4-4abb-8d37-c358a75c0fa6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:06.774605 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c70944e9-f3b4-4abb-8d37-c358a75c0fa6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:06.782983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c70944e9-f3b4-4abb-8d37-c358a75c0fa6 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.079797 Jul 14 15:45:06.783613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 498/1033] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:06 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:06.790447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a2314efa-ad93-44c2-a6d3-6a310d5bf742 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:06.791341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a2314efa-ad93-44c2-a6d3-6a310d5bf742 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:06.799965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2314efa-ad93-44c2-a6d3-6a310d5bf742 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:06.800689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2314efa-ad93-44c2-a6d3-6a310d5bf742 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:06.801860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2314efa-ad93-44c2-a6d3-6a310d5bf742 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:06.802303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2314efa-ad93-44c2-a6d3-6a310d5bf742 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:06.836780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a2314efa-ad93-44c2-a6d3-6a310d5bf742 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052115 Jul 14 15:45:06.837333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 499/1034] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:06 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:07.719856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2cbc2b35-557c-4905-8311-b1f238c8ce3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:07.720921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2cbc2b35-557c-4905-8311-b1f238c8ce3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:07.727458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2cbc2b35-557c-4905-8311-b1f238c8ce3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:07.728012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2cbc2b35-557c-4905-8311-b1f238c8ce3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:07.728779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2cbc2b35-557c-4905-8311-b1f238c8ce3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:07.729216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2cbc2b35-557c-4905-8311-b1f238c8ce3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:07.871945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2cbc2b35-557c-4905-8311-b1f238c8ce3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:07.879553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2cbc2b35-557c-4905-8311-b1f238c8ce3f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.164227 Jul 14 15:45:07.880137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 500/1035] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:07 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:07.884622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f14c22c2-8353-4ac9-aa11-23f944827440 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:07.885221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f14c22c2-8353-4ac9-aa11-23f944827440 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:07.890912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f14c22c2-8353-4ac9-aa11-23f944827440 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:07.891886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f14c22c2-8353-4ac9-aa11-23f944827440 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:07.892641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f14c22c2-8353-4ac9-aa11-23f944827440 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:07.893079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f14c22c2-8353-4ac9-aa11-23f944827440 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:07.953121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f14c22c2-8353-4ac9-aa11-23f944827440 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:07.961705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f14c22c2-8353-4ac9-aa11-23f944827440 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.080626 Jul 14 15:45:07.962273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 501/1036] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:07 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:07.966930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9f5422bc-b5f9-4fe6-b8c4-f3c1b8fe9e71 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:07.967863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9f5422bc-b5f9-4fe6-b8c4-f3c1b8fe9e71 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:07.975073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f5422bc-b5f9-4fe6-b8c4-f3c1b8fe9e71 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:07.975457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f5422bc-b5f9-4fe6-b8c4-f3c1b8fe9e71 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:07.976251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f5422bc-b5f9-4fe6-b8c4-f3c1b8fe9e71 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:07.976685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f5422bc-b5f9-4fe6-b8c4-f3c1b8fe9e71 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:08.007446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9f5422bc-b5f9-4fe6-b8c4-f3c1b8fe9e71 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044046 Jul 14 15:45:08.008038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 502/1037] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:07 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:08.890256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=3 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:08.897543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-38202c05-7b7c-459c-89dd-472b6711a679 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:08.898156 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-38202c05-7b7c-459c-89dd-472b6711a679 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:08.904889 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38202c05-7b7c-459c-89dd-472b6711a679 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:08.905341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38202c05-7b7c-459c-89dd-472b6711a679 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:08.906098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38202c05-7b7c-459c-89dd-472b6711a679 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:08.906536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38202c05-7b7c-459c-89dd-472b6711a679 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:08.913371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=42 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:09.038472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-38202c05-7b7c-459c-89dd-472b6711a679 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:09.046099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-38202c05-7b7c-459c-89dd-472b6711a679 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.152659 Jul 14 15:45:09.046665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 503/1038] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:08 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:09.052467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-019a00ed-5ecf-4d9b-a533-ea7f6e07610b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:09.053072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-019a00ed-5ecf-4d9b-a533-ea7f6e07610b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:09.058671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-019a00ed-5ecf-4d9b-a533-ea7f6e07610b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:09.059121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-019a00ed-5ecf-4d9b-a533-ea7f6e07610b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:09.059911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-019a00ed-5ecf-4d9b-a533-ea7f6e07610b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:09.060347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-019a00ed-5ecf-4d9b-a533-ea7f6e07610b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:09.121461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-019a00ed-5ecf-4d9b-a533-ea7f6e07610b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:09.129467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-019a00ed-5ecf-4d9b-a533-ea7f6e07610b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.081875 Jul 14 15:45:09.130034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 504/1039] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:09 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:09.134663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1b83b11b-de57-494d-a996-a24794b04835 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:09.135604 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1b83b11b-de57-494d-a996-a24794b04835 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:09.141425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b83b11b-de57-494d-a996-a24794b04835 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:09.142120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b83b11b-de57-494d-a996-a24794b04835 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:09.142888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b83b11b-de57-494d-a996-a24794b04835 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:09.143325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b83b11b-de57-494d-a996-a24794b04835 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:09.176298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1b83b11b-de57-494d-a996-a24794b04835 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045215 Jul 14 15:45:09.176881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 505/1040] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:09 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:10.064565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6b4ae687-aac7-495b-ada3-a7f7b65b6a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:10.065180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6b4ae687-aac7-495b-ada3-a7f7b65b6a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:10.071758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b4ae687-aac7-495b-ada3-a7f7b65b6a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:10.072216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b4ae687-aac7-495b-ada3-a7f7b65b6a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:10.072979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b4ae687-aac7-495b-ada3-a7f7b65b6a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:10.073428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b4ae687-aac7-495b-ada3-a7f7b65b6a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:10.213328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6b4ae687-aac7-495b-ada3-a7f7b65b6a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:10.224659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6b4ae687-aac7-495b-ada3-a7f7b65b6a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.164677 Jul 14 15:45:10.225267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 506/1041] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:10 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:10.229740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d35ec8e2-0fdd-4a49-8488-6c057ead2776 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:10.230351 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d35ec8e2-0fdd-4a49-8488-6c057ead2776 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:10.237190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d35ec8e2-0fdd-4a49-8488-6c057ead2776 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:10.237641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d35ec8e2-0fdd-4a49-8488-6c057ead2776 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:10.238407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d35ec8e2-0fdd-4a49-8488-6c057ead2776 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:10.238844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d35ec8e2-0fdd-4a49-8488-6c057ead2776 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:10.301686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d35ec8e2-0fdd-4a49-8488-6c057ead2776 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:10.309112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d35ec8e2-0fdd-4a49-8488-6c057ead2776 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.082893 Jul 14 15:45:10.309672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 507/1042] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:10 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:10.315398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4a8bbf22-19bf-4ad8-a5a6-82d433f78dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:10.316325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4a8bbf22-19bf-4ad8-a5a6-82d433f78dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:10.322019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a8bbf22-19bf-4ad8-a5a6-82d433f78dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:10.322469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a8bbf22-19bf-4ad8-a5a6-82d433f78dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:10.323227 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a8bbf22-19bf-4ad8-a5a6-82d433f78dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:10.323693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a8bbf22-19bf-4ad8-a5a6-82d433f78dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:10.353097 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4a8bbf22-19bf-4ad8-a5a6-82d433f78dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042407 Jul 14 15:45:10.353650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 508/1043] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:10 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:11.244675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-53e1e06f-0a37-4539-982b-2e8408fa72d3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:11.245325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-53e1e06f-0a37-4539-982b-2e8408fa72d3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:11.252818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-53e1e06f-0a37-4539-982b-2e8408fa72d3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:11.253204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-53e1e06f-0a37-4539-982b-2e8408fa72d3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:11.253963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-53e1e06f-0a37-4539-982b-2e8408fa72d3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:11.254399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-53e1e06f-0a37-4539-982b-2e8408fa72d3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:11.277450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:11.395962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-53e1e06f-0a37-4539-982b-2e8408fa72d3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:11.403522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-53e1e06f-0a37-4539-982b-2e8408fa72d3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.162877 Jul 14 15:45:11.404383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 509/1044] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:11 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:11.408978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9d96e1a2-efa3-455b-8a24-9f556a1e50f8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:11.409574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9d96e1a2-efa3-455b-8a24-9f556a1e50f8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:11.415220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d96e1a2-efa3-455b-8a24-9f556a1e50f8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:11.415713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d96e1a2-efa3-455b-8a24-9f556a1e50f8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:11.416491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d96e1a2-efa3-455b-8a24-9f556a1e50f8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:11.416922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d96e1a2-efa3-455b-8a24-9f556a1e50f8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:11.477646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9d96e1a2-efa3-455b-8a24-9f556a1e50f8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:11.485166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9d96e1a2-efa3-455b-8a24-9f556a1e50f8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.079811 Jul 14 15:45:11.485726 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 510/1045] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:11 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:11.490252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a94cba19-0220-4590-bccb-b70666dda6f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:11.491178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a94cba19-0220-4590-bccb-b70666dda6f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:11.497168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a94cba19-0220-4590-bccb-b70666dda6f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:11.497617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a94cba19-0220-4590-bccb-b70666dda6f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:11.498381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a94cba19-0220-4590-bccb-b70666dda6f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:11.498820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a94cba19-0220-4590-bccb-b70666dda6f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:11.528399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a94cba19-0220-4590-bccb-b70666dda6f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041583 Jul 14 15:45:11.529126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 511/1046] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:11 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:12.421901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-996ce07f-d527-4384-9b26-a504db1e2b43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:12.422650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-996ce07f-d527-4384-9b26-a504db1e2b43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:12.429529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-996ce07f-d527-4384-9b26-a504db1e2b43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:12.429976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-996ce07f-d527-4384-9b26-a504db1e2b43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:12.430747 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-996ce07f-d527-4384-9b26-a504db1e2b43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:12.431185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-996ce07f-d527-4384-9b26-a504db1e2b43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:12.560883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-996ce07f-d527-4384-9b26-a504db1e2b43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:12.568586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-996ce07f-d527-4384-9b26-a504db1e2b43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.150606 Jul 14 15:45:12.569774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 512/1047] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:12 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:12.574850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-44fb7d5d-68c3-4f06-8072-f5f14b46194e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:12.575460 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-44fb7d5d-68c3-4f06-8072-f5f14b46194e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:12.582231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-44fb7d5d-68c3-4f06-8072-f5f14b46194e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:12.582681 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-44fb7d5d-68c3-4f06-8072-f5f14b46194e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:12.583442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-44fb7d5d-68c3-4f06-8072-f5f14b46194e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:12.583919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-44fb7d5d-68c3-4f06-8072-f5f14b46194e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:12.646121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-44fb7d5d-68c3-4f06-8072-f5f14b46194e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:12.653662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-44fb7d5d-68c3-4f06-8072-f5f14b46194e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.082458 Jul 14 15:45:12.654489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 513/1048] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:12 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:12.660318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-849c3f12-da31-433b-912f-66257d8666d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:12.661231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-849c3f12-da31-433b-912f-66257d8666d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:12.667029 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-849c3f12-da31-433b-912f-66257d8666d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:12.667482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-849c3f12-da31-433b-912f-66257d8666d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:12.668279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-849c3f12-da31-433b-912f-66257d8666d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:12.668843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-849c3f12-da31-433b-912f-66257d8666d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:12.700600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-849c3f12-da31-433b-912f-66257d8666d2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044992 Jul 14 15:45:12.701080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 514/1049] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:12 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:13.585480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9c9f6d8a-b3cf-4183-8f75-25b20b737e68 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:13.586132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9c9f6d8a-b3cf-4183-8f75-25b20b737e68 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:13.592795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c9f6d8a-b3cf-4183-8f75-25b20b737e68 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:13.593260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c9f6d8a-b3cf-4183-8f75-25b20b737e68 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:13.594013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c9f6d8a-b3cf-4183-8f75-25b20b737e68 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:13.595177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c9f6d8a-b3cf-4183-8f75-25b20b737e68 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:13.728879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9c9f6d8a-b3cf-4183-8f75-25b20b737e68 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:13.737345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9c9f6d8a-b3cf-4183-8f75-25b20b737e68 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.155730 Jul 14 15:45:13.737924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 515/1050] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:13 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:13.742390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a3d9a90b-7e7e-42ae-b8f6-a84699aa3a55 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:13.742998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a3d9a90b-7e7e-42ae-b8f6-a84699aa3a55 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:13.748859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a3d9a90b-7e7e-42ae-b8f6-a84699aa3a55 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:13.749311 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a3d9a90b-7e7e-42ae-b8f6-a84699aa3a55 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:13.750073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a3d9a90b-7e7e-42ae-b8f6-a84699aa3a55 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:13.750566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a3d9a90b-7e7e-42ae-b8f6-a84699aa3a55 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:13.811372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a3d9a90b-7e7e-42ae-b8f6-a84699aa3a55 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:13.818978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a3d9a90b-7e7e-42ae-b8f6-a84699aa3a55 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.080119 Jul 14 15:45:13.819591 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 516/1051] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:13 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:13.824292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a5c3b51e-1dbe-4fab-82a2-6112c2383fff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:13.825187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a5c3b51e-1dbe-4fab-82a2-6112c2383fff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:13.831703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a5c3b51e-1dbe-4fab-82a2-6112c2383fff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:13.832152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a5c3b51e-1dbe-4fab-82a2-6112c2383fff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:13.832912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a5c3b51e-1dbe-4fab-82a2-6112c2383fff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:13.833348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a5c3b51e-1dbe-4fab-82a2-6112c2383fff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:13.863939 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a5c3b51e-1dbe-4fab-82a2-6112c2383fff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043286 Jul 14 15:45:13.864488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 517/1052] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:13 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:14.755076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d4f42ebf-c1e2-4048-87e5-452835f2fb9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:14.755782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d4f42ebf-c1e2-4048-87e5-452835f2fb9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:14.762373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d4f42ebf-c1e2-4048-87e5-452835f2fb9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:14.762813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d4f42ebf-c1e2-4048-87e5-452835f2fb9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:14.763558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d4f42ebf-c1e2-4048-87e5-452835f2fb9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:14.764010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d4f42ebf-c1e2-4048-87e5-452835f2fb9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:14.904229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d4f42ebf-c1e2-4048-87e5-452835f2fb9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:14.911869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d4f42ebf-c1e2-4048-87e5-452835f2fb9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.161384 Jul 14 15:45:14.912430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 518/1053] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:14 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:14.916855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b2b9f1d5-c8cc-4ae6-933d-5b7066457f81 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:14.917454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b2b9f1d5-c8cc-4ae6-933d-5b7066457f81 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:14.924407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2b9f1d5-c8cc-4ae6-933d-5b7066457f81 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:14.924852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2b9f1d5-c8cc-4ae6-933d-5b7066457f81 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:14.925618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2b9f1d5-c8cc-4ae6-933d-5b7066457f81 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:14.926052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2b9f1d5-c8cc-4ae6-933d-5b7066457f81 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:14.987670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b2b9f1d5-c8cc-4ae6-933d-5b7066457f81 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:14.996014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b2b9f1d5-c8cc-4ae6-933d-5b7066457f81 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.082458 Jul 14 15:45:14.996601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 519/1054] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:14 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:15.001928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a08aaf6f-e7dd-4dca-ad13-6ecc79273c39 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:15.002845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a08aaf6f-e7dd-4dca-ad13-6ecc79273c39 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:15.009469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a08aaf6f-e7dd-4dca-ad13-6ecc79273c39 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:15.009921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a08aaf6f-e7dd-4dca-ad13-6ecc79273c39 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:15.010689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a08aaf6f-e7dd-4dca-ad13-6ecc79273c39 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:15.011128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a08aaf6f-e7dd-4dca-ad13-6ecc79273c39 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:15.040982 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a08aaf6f-e7dd-4dca-ad13-6ecc79273c39 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043323 Jul 14 15:45:15.041557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 520/1055] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:14 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:15.929006 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8b1b5daa-16b3-4be0-9129-56f8163ff833 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:15.929687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8b1b5daa-16b3-4be0-9129-56f8163ff833 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:15.936202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b1b5daa-16b3-4be0-9129-56f8163ff833 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:15.936650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b1b5daa-16b3-4be0-9129-56f8163ff833 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:15.937405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b1b5daa-16b3-4be0-9129-56f8163ff833 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:15.937840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b1b5daa-16b3-4be0-9129-56f8163ff833 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:16.069015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8b1b5daa-16b3-4be0-9129-56f8163ff833 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:16.076426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8b1b5daa-16b3-4be0-9129-56f8163ff833 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.151294 Jul 14 15:45:16.076991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 521/1056] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:15 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:16.082487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0f259211-b421-4c83-8777-cceae06db38b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:16.083085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0f259211-b421-4c83-8777-cceae06db38b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:16.088677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f259211-b421-4c83-8777-cceae06db38b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:16.089120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f259211-b421-4c83-8777-cceae06db38b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:16.089870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f259211-b421-4c83-8777-cceae06db38b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:16.090305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f259211-b421-4c83-8777-cceae06db38b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:16.151721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0f259211-b421-4c83-8777-cceae06db38b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:16.159988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0f259211-b421-4c83-8777-cceae06db38b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.081962 Jul 14 15:45:16.160556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 522/1057] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:16 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:16.165146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5084450e-14f6-4714-a84f-cca902e4f1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:16.166046 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5084450e-14f6-4714-a84f-cca902e4f1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:16.171920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5084450e-14f6-4714-a84f-cca902e4f1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:16.172277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5084450e-14f6-4714-a84f-cca902e4f1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:16.174324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5084450e-14f6-4714-a84f-cca902e4f1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:16.174764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5084450e-14f6-4714-a84f-cca902e4f1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:16.205007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5084450e-14f6-4714-a84f-cca902e4f1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042309 Jul 14 15:45:16.205497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 523/1058] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:16 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:17.093909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1cd53178-c711-4280-806d-576783ef35bb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:17.095127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1cd53178-c711-4280-806d-576783ef35bb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:17.101718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1cd53178-c711-4280-806d-576783ef35bb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:17.102163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1cd53178-c711-4280-806d-576783ef35bb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:17.102925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1cd53178-c711-4280-806d-576783ef35bb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:17.103357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1cd53178-c711-4280-806d-576783ef35bb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:17.241643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1cd53178-c711-4280-806d-576783ef35bb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:17.249318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1cd53178-c711-4280-806d-576783ef35bb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.159195 Jul 14 15:45:17.249826 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 524/1059] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:17 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:17.254800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8947f77d-3e80-482c-900c-9c141633d71f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:17.255401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8947f77d-3e80-482c-900c-9c141633d71f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:17.262024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8947f77d-3e80-482c-900c-9c141633d71f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:17.262446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8947f77d-3e80-482c-900c-9c141633d71f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:17.263240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8947f77d-3e80-482c-900c-9c141633d71f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:17.263670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8947f77d-3e80-482c-900c-9c141633d71f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:17.325690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8947f77d-3e80-482c-900c-9c141633d71f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:17.334098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8947f77d-3e80-482c-900c-9c141633d71f tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.083337 Jul 14 15:45:17.334667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 525/1060] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:17 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:17.339647 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3a137af1-5715-4962-92b0-22e67a6f75e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:17.340590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3a137af1-5715-4962-92b0-22e67a6f75e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:17.347128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3a137af1-5715-4962-92b0-22e67a6f75e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:17.347577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3a137af1-5715-4962-92b0-22e67a6f75e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:17.348378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3a137af1-5715-4962-92b0-22e67a6f75e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:17.348817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3a137af1-5715-4962-92b0-22e67a6f75e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:17.352629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:17.377547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3a137af1-5715-4962-92b0-22e67a6f75e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041813 Jul 14 15:45:17.378108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 526/1061] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:17 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:18.266728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d1375fbf-f6a9-490d-b30e-3bc7c4c613ea tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:18.267528 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d1375fbf-f6a9-490d-b30e-3bc7c4c613ea tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:18.273855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d1375fbf-f6a9-490d-b30e-3bc7c4c613ea tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:18.274404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d1375fbf-f6a9-490d-b30e-3bc7c4c613ea tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:18.275249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d1375fbf-f6a9-490d-b30e-3bc7c4c613ea tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:18.275718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d1375fbf-f6a9-490d-b30e-3bc7c4c613ea tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:18.430312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d1375fbf-f6a9-490d-b30e-3bc7c4c613ea tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:18.438188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d1375fbf-f6a9-490d-b30e-3bc7c4c613ea tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.175504 Jul 14 15:45:18.438919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 527/1062] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:18 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:18.443467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9b15f81c-9df1-401a-9284-8cd812314736 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:18.444151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9b15f81c-9df1-401a-9284-8cd812314736 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:18.445927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:18.451855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b15f81c-9df1-401a-9284-8cd812314736 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:18.452307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b15f81c-9df1-401a-9284-8cd812314736 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:18.453077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b15f81c-9df1-401a-9284-8cd812314736 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:18.453524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b15f81c-9df1-401a-9284-8cd812314736 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:18.520714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9b15f81c-9df1-401a-9284-8cd812314736 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:18.528347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9b15f81c-9df1-401a-9284-8cd812314736 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.088483 Jul 14 15:45:18.529172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 528/1063] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:18 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:18.534218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ce48a8fc-d6a1-4ba8-8654-742010ba1200 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:18.535130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ce48a8fc-d6a1-4ba8-8654-742010ba1200 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:18.540855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce48a8fc-d6a1-4ba8-8654-742010ba1200 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:18.541305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce48a8fc-d6a1-4ba8-8654-742010ba1200 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:18.542070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce48a8fc-d6a1-4ba8-8654-742010ba1200 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:18.542513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce48a8fc-d6a1-4ba8-8654-742010ba1200 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:18.571645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ce48a8fc-d6a1-4ba8-8654-742010ba1200 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041433 Jul 14 15:45:18.572216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 529/1064] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:18 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:19.455499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-99b6ff0b-1889-4e8c-8652-d041b8fd71f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:19.456186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-99b6ff0b-1889-4e8c-8652-d041b8fd71f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:19.462884 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-99b6ff0b-1889-4e8c-8652-d041b8fd71f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:19.463330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-99b6ff0b-1889-4e8c-8652-d041b8fd71f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:19.464264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-99b6ff0b-1889-4e8c-8652-d041b8fd71f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:19.465410 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-99b6ff0b-1889-4e8c-8652-d041b8fd71f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:19.594717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-99b6ff0b-1889-4e8c-8652-d041b8fd71f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:19.602238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-99b6ff0b-1889-4e8c-8652-d041b8fd71f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.150640 Jul 14 15:45:19.602794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 530/1065] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:19 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:19.607093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7357abf6-0a23-468a-9e4e-8f7b7fb45d1c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:19.607713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7357abf6-0a23-468a-9e4e-8f7b7fb45d1c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:19.613894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7357abf6-0a23-468a-9e4e-8f7b7fb45d1c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:19.614343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7357abf6-0a23-468a-9e4e-8f7b7fb45d1c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:19.615084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7357abf6-0a23-468a-9e4e-8f7b7fb45d1c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:19.615513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7357abf6-0a23-468a-9e4e-8f7b7fb45d1c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:19.676072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7357abf6-0a23-468a-9e4e-8f7b7fb45d1c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:19.683535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7357abf6-0a23-468a-9e4e-8f7b7fb45d1c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.079786 Jul 14 15:45:19.684129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 531/1066] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:19 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:19.689500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b8161035-2824-48ca-bb3e-addc41b0ae56 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:19.690572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b8161035-2824-48ca-bb3e-addc41b0ae56 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:19.696755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8161035-2824-48ca-bb3e-addc41b0ae56 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:19.697195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8161035-2824-48ca-bb3e-addc41b0ae56 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:19.697958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8161035-2824-48ca-bb3e-addc41b0ae56 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:19.698392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8161035-2824-48ca-bb3e-addc41b0ae56 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:19.728603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b8161035-2824-48ca-bb3e-addc41b0ae56 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043427 Jul 14 15:45:19.729180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 532/1067] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:19 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:20.620122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f9b13150-dee3-4702-8cf9-33d27c15e144 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:20.620817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f9b13150-dee3-4702-8cf9-33d27c15e144 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:20.627855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9b13150-dee3-4702-8cf9-33d27c15e144 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:20.628312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9b13150-dee3-4702-8cf9-33d27c15e144 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:20.629077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9b13150-dee3-4702-8cf9-33d27c15e144 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:20.629517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9b13150-dee3-4702-8cf9-33d27c15e144 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:20.766024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f9b13150-dee3-4702-8cf9-33d27c15e144 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:20.776854 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f9b13150-dee3-4702-8cf9-33d27c15e144 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.160525 Jul 14 15:45:20.777436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 533/1068] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:20 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:20.782173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-42b4826c-1300-4c5f-8df8-af2d6c28b347 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:20.782944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-42b4826c-1300-4c5f-8df8-af2d6c28b347 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:20.788845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-42b4826c-1300-4c5f-8df8-af2d6c28b347 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:20.789283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-42b4826c-1300-4c5f-8df8-af2d6c28b347 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:20.790047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-42b4826c-1300-4c5f-8df8-af2d6c28b347 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:20.790485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-42b4826c-1300-4c5f-8df8-af2d6c28b347 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:20.851711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-42b4826c-1300-4c5f-8df8-af2d6c28b347 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:20.859211 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-42b4826c-1300-4c5f-8df8-af2d6c28b347 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.080838 Jul 14 15:45:20.859918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 534/1069] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:20 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:20.864453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-230836d0-5240-4262-8029-e353e9cd1b04 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:20.865356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-230836d0-5240-4262-8029-e353e9cd1b04 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:20.871312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-230836d0-5240-4262-8029-e353e9cd1b04 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:20.871726 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-230836d0-5240-4262-8029-e353e9cd1b04 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:20.872511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-230836d0-5240-4262-8029-e353e9cd1b04 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:20.872941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-230836d0-5240-4262-8029-e353e9cd1b04 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:20.904458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-230836d0-5240-4262-8029-e353e9cd1b04 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043253 Jul 14 15:45:20.905022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 535/1070] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:21.794750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4ef42836-54cc-42ac-abf1-022d78312af5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:21.795387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4ef42836-54cc-42ac-abf1-022d78312af5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:21.803016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ef42836-54cc-42ac-abf1-022d78312af5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:21.803472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ef42836-54cc-42ac-abf1-022d78312af5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:21.804265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ef42836-54cc-42ac-abf1-022d78312af5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:21.804707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ef42836-54cc-42ac-abf1-022d78312af5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:21.946635 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4ef42836-54cc-42ac-abf1-022d78312af5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:21.955035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4ef42836-54cc-42ac-abf1-022d78312af5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.163764 Jul 14 15:45:21.955656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 536/1071] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:21 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:21.960467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e424f87e-3fe9-4ba3-aa18-b0a5d3d07534 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:21.961085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e424f87e-3fe9-4ba3-aa18-b0a5d3d07534 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:21.967293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e424f87e-3fe9-4ba3-aa18-b0a5d3d07534 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:21.967789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e424f87e-3fe9-4ba3-aa18-b0a5d3d07534 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:21.968582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e424f87e-3fe9-4ba3-aa18-b0a5d3d07534 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:21.969023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e424f87e-3fe9-4ba3-aa18-b0a5d3d07534 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:22.038651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e424f87e-3fe9-4ba3-aa18-b0a5d3d07534 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:22.046319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e424f87e-3fe9-4ba3-aa18-b0a5d3d07534 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.089592 Jul 14 15:45:22.046831 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 537/1072] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:21 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:22.051716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9a097b14-3774-4c50-bc8d-8571431dc8ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:22.052639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9a097b14-3774-4c50-bc8d-8571431dc8ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:22.058559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a097b14-3774-4c50-bc8d-8571431dc8ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:22.059008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a097b14-3774-4c50-bc8d-8571431dc8ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:22.059809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a097b14-3774-4c50-bc8d-8571431dc8ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:22.060249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a097b14-3774-4c50-bc8d-8571431dc8ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:22.089765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9a097b14-3774-4c50-bc8d-8571431dc8ea tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041927 Jul 14 15:45:22.090321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 538/1073] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:22 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:22.973477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-51a1d418-2d83-4be8-b7ae-dd132437f299 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:22.974305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-51a1d418-2d83-4be8-b7ae-dd132437f299 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:22.988076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51a1d418-2d83-4be8-b7ae-dd132437f299 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:22.988521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51a1d418-2d83-4be8-b7ae-dd132437f299 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:22.989299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51a1d418-2d83-4be8-b7ae-dd132437f299 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:22.989727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51a1d418-2d83-4be8-b7ae-dd132437f299 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:23.126535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-51a1d418-2d83-4be8-b7ae-dd132437f299 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:23.134111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-51a1d418-2d83-4be8-b7ae-dd132437f299 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.165547 Jul 14 15:45:23.134677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 539/1074] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:22 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:23.139011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-428b5b14-a39c-4f4e-b635-03cf02b3c0e8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:23.139658 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-428b5b14-a39c-4f4e-b635-03cf02b3c0e8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:23.145966 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-428b5b14-a39c-4f4e-b635-03cf02b3c0e8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:23.146410 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-428b5b14-a39c-4f4e-b635-03cf02b3c0e8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:23.147160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-428b5b14-a39c-4f4e-b635-03cf02b3c0e8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:23.147622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-428b5b14-a39c-4f4e-b635-03cf02b3c0e8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:23.208868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-428b5b14-a39c-4f4e-b635-03cf02b3c0e8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:23.216447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-428b5b14-a39c-4f4e-b635-03cf02b3c0e8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.080843 Jul 14 15:45:23.217007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 540/1075] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:23 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:23.222787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-517bc338-9d5f-4dfe-827e-e570b28ea2c8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:23.223823 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-517bc338-9d5f-4dfe-827e-e570b28ea2c8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:23.229570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-517bc338-9d5f-4dfe-827e-e570b28ea2c8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:23.230019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-517bc338-9d5f-4dfe-827e-e570b28ea2c8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:23.230775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-517bc338-9d5f-4dfe-827e-e570b28ea2c8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:23.231218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-517bc338-9d5f-4dfe-827e-e570b28ea2c8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:23.261284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-517bc338-9d5f-4dfe-827e-e570b28ea2c8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043237 Jul 14 15:45:23.261847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 541/1076] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:23 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:24.151790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bc8d5b5b-4607-487d-844f-3f9032cc6185 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:24.152445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bc8d5b5b-4607-487d-844f-3f9032cc6185 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:24.159408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc8d5b5b-4607-487d-844f-3f9032cc6185 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.159887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc8d5b5b-4607-487d-844f-3f9032cc6185 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.160643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc8d5b5b-4607-487d-844f-3f9032cc6185 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.161078 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc8d5b5b-4607-487d-844f-3f9032cc6185 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.296012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bc8d5b5b-4607-487d-844f-3f9032cc6185 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:24.300179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:24.305311 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bc8d5b5b-4607-487d-844f-3f9032cc6185 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.157472 Jul 14 15:45:24.305871 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 542/1077] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:24 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:24.310215 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b1441d0e-d82f-4011-ac62-e4f7869d779c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:24.310817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b1441d0e-d82f-4011-ac62-e4f7869d779c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:24.317218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b1441d0e-d82f-4011-ac62-e4f7869d779c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.317693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b1441d0e-d82f-4011-ac62-e4f7869d779c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.318468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b1441d0e-d82f-4011-ac62-e4f7869d779c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.318910 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b1441d0e-d82f-4011-ac62-e4f7869d779c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.401771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b1441d0e-d82f-4011-ac62-e4f7869d779c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:24.411177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b1441d0e-d82f-4011-ac62-e4f7869d779c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.103823 Jul 14 15:45:24.412047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 543/1078] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:24 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:24.417845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9a51c1df-85db-4968-96c9-22100f86c101 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:24.418837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9a51c1df-85db-4968-96c9-22100f86c101 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:24.430204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a51c1df-85db-4968-96c9-22100f86c101 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.430859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a51c1df-85db-4968-96c9-22100f86c101 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.432080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a51c1df-85db-4968-96c9-22100f86c101 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:24.432719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a51c1df-85db-4968-96c9-22100f86c101 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:24.484384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9a51c1df-85db-4968-96c9-22100f86c101 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.070973 Jul 14 15:45:24.486024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 544/1079] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:24 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:25.331047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7869e878-7982-491d-ab7d-91c8dce70a9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:25.331767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7869e878-7982-491d-ab7d-91c8dce70a9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:25.338453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7869e878-7982-491d-ab7d-91c8dce70a9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:25.338903 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7869e878-7982-491d-ab7d-91c8dce70a9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:25.339685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7869e878-7982-491d-ab7d-91c8dce70a9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:25.340126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7869e878-7982-491d-ab7d-91c8dce70a9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:25.473390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7869e878-7982-491d-ab7d-91c8dce70a9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:25.480925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7869e878-7982-491d-ab7d-91c8dce70a9b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.154527 Jul 14 15:45:25.481490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 545/1080] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:25 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:25.486547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3b0a9a50-356a-4c3c-a8e6-d9ffb7ca6185 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:25.487154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3b0a9a50-356a-4c3c-a8e6-d9ffb7ca6185 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:25.492977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3b0a9a50-356a-4c3c-a8e6-d9ffb7ca6185 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:25.493419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3b0a9a50-356a-4c3c-a8e6-d9ffb7ca6185 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:25.494181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3b0a9a50-356a-4c3c-a8e6-d9ffb7ca6185 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:25.494621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3b0a9a50-356a-4c3c-a8e6-d9ffb7ca6185 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:25.555353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3b0a9a50-356a-4c3c-a8e6-d9ffb7ca6185 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:25.562841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3b0a9a50-356a-4c3c-a8e6-d9ffb7ca6185 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.080424 Jul 14 15:45:25.563392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 546/1081] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:25 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:25.568662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-30945200-8737-4d5f-8981-512f0d4fec49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:25.569749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-30945200-8737-4d5f-8981-512f0d4fec49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:25.575494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30945200-8737-4d5f-8981-512f0d4fec49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:25.575973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30945200-8737-4d5f-8981-512f0d4fec49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:25.576727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30945200-8737-4d5f-8981-512f0d4fec49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:25.577155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30945200-8737-4d5f-8981-512f0d4fec49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:25.605638 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-30945200-8737-4d5f-8981-512f0d4fec49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.040456 Jul 14 15:45:25.606107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 547/1082] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:25 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:26.498271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-254f548c-9591-4500-9569-f7bef2c731dd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:26.498953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-254f548c-9591-4500-9569-f7bef2c731dd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:26.506452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-254f548c-9591-4500-9569-f7bef2c731dd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:26.506895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-254f548c-9591-4500-9569-f7bef2c731dd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:26.507674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-254f548c-9591-4500-9569-f7bef2c731dd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:26.508113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-254f548c-9591-4500-9569-f7bef2c731dd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:26.650334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-254f548c-9591-4500-9569-f7bef2c731dd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:26.658612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-254f548c-9591-4500-9569-f7bef2c731dd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.164206 Jul 14 15:45:26.659180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 548/1083] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:26 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:26.663513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3975575a-50a6-4e3e-b2ca-dbe57bcb7f7e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:26.664142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3975575a-50a6-4e3e-b2ca-dbe57bcb7f7e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:26.669676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3975575a-50a6-4e3e-b2ca-dbe57bcb7f7e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:26.670118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3975575a-50a6-4e3e-b2ca-dbe57bcb7f7e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:26.670870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3975575a-50a6-4e3e-b2ca-dbe57bcb7f7e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:26.671304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3975575a-50a6-4e3e-b2ca-dbe57bcb7f7e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:26.733664 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3975575a-50a6-4e3e-b2ca-dbe57bcb7f7e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:26.741172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3975575a-50a6-4e3e-b2ca-dbe57bcb7f7e tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.080996 Jul 14 15:45:26.741745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 549/1084] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:26 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:26.746671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b82d5aa0-9812-4240-ac4a-ca3dd53ff1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:26.747577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b82d5aa0-9812-4240-ac4a-ca3dd53ff1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:26.753975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b82d5aa0-9812-4240-ac4a-ca3dd53ff1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:26.754363 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b82d5aa0-9812-4240-ac4a-ca3dd53ff1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:26.755119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b82d5aa0-9812-4240-ac4a-ca3dd53ff1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:26.755557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b82d5aa0-9812-4240-ac4a-ca3dd53ff1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:26.785415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b82d5aa0-9812-4240-ac4a-ca3dd53ff1e3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042660 Jul 14 15:45:26.785970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 550/1085] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:26 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:27.675697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9f1c7352-9926-4e93-bda0-4588f34944ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:27.676398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9f1c7352-9926-4e93-bda0-4588f34944ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:27.682816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f1c7352-9926-4e93-bda0-4588f34944ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:27.683257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f1c7352-9926-4e93-bda0-4588f34944ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:27.684031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f1c7352-9926-4e93-bda0-4588f34944ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:27.684462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f1c7352-9926-4e93-bda0-4588f34944ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:27.820804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9f1c7352-9926-4e93-bda0-4588f34944ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:27.828432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9f1c7352-9926-4e93-bda0-4588f34944ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.156601 Jul 14 15:45:27.829063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 551/1086] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:27 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:27.838030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bbd94832-0259-491b-ab72-1c67806bdb7d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:27.839023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bbd94832-0259-491b-ab72-1c67806bdb7d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:27.846980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bbd94832-0259-491b-ab72-1c67806bdb7d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:27.847421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bbd94832-0259-491b-ab72-1c67806bdb7d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:27.848221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bbd94832-0259-491b-ab72-1c67806bdb7d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:27.848648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bbd94832-0259-491b-ab72-1c67806bdb7d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:27.909618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bbd94832-0259-491b-ab72-1c67806bdb7d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:27.917048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bbd94832-0259-491b-ab72-1c67806bdb7d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.086230 Jul 14 15:45:27.917610 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 552/1087] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:27 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:27.922386 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3ba5fc19-902e-4525-b2f9-a5fe808b8302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:27.923309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3ba5fc19-902e-4525-b2f9-a5fe808b8302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:27.929047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ba5fc19-902e-4525-b2f9-a5fe808b8302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:27.929531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ba5fc19-902e-4525-b2f9-a5fe808b8302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:27.930283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ba5fc19-902e-4525-b2f9-a5fe808b8302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:27.930709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ba5fc19-902e-4525-b2f9-a5fe808b8302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:27.960093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3ba5fc19-902e-4525-b2f9-a5fe808b8302 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041318 Jul 14 15:45:27.960656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 553/1088] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:28.847259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e21de70-45cd-439a-9b39-07518787bdd8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:28.848193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e21de70-45cd-439a-9b39-07518787bdd8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:28.856800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e21de70-45cd-439a-9b39-07518787bdd8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:28.857243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e21de70-45cd-439a-9b39-07518787bdd8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:28.857996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e21de70-45cd-439a-9b39-07518787bdd8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:28.858428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e21de70-45cd-439a-9b39-07518787bdd8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:28.990649 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e21de70-45cd-439a-9b39-07518787bdd8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:28.998215 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e21de70-45cd-439a-9b39-07518787bdd8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.155795 Jul 14 15:45:28.998780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 554/1089] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:28 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:29.003890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7362e606-b721-4ede-9ed7-3708d04821f3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:29.004497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7362e606-b721-4ede-9ed7-3708d04821f3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:29.010807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7362e606-b721-4ede-9ed7-3708d04821f3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:29.011257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7362e606-b721-4ede-9ed7-3708d04821f3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:29.012052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7362e606-b721-4ede-9ed7-3708d04821f3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:29.012481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7362e606-b721-4ede-9ed7-3708d04821f3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:29.074181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7362e606-b721-4ede-9ed7-3708d04821f3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:29.081638 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7362e606-b721-4ede-9ed7-3708d04821f3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.081925 Jul 14 15:45:29.082197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 555/1090] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:28 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:29.086880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bb9e6ed2-929a-4650-b533-b5e828722347 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:29.087725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bb9e6ed2-929a-4650-b533-b5e828722347 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:29.093908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb9e6ed2-929a-4650-b533-b5e828722347 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:29.094362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb9e6ed2-929a-4650-b533-b5e828722347 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:29.095789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb9e6ed2-929a-4650-b533-b5e828722347 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:29.096236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb9e6ed2-929a-4650-b533-b5e828722347 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:29.125721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bb9e6ed2-929a-4650-b533-b5e828722347 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042432 Jul 14 15:45:29.126260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 556/1091] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:29 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:30.017523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-767a9326-d01b-42ec-8bc9-89b8d03c88cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:30.018143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-767a9326-d01b-42ec-8bc9-89b8d03c88cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:30.024626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-767a9326-d01b-42ec-8bc9-89b8d03c88cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:30.025080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-767a9326-d01b-42ec-8bc9-89b8d03c88cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:30.025836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-767a9326-d01b-42ec-8bc9-89b8d03c88cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:30.026275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-767a9326-d01b-42ec-8bc9-89b8d03c88cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:30.159738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-767a9326-d01b-42ec-8bc9-89b8d03c88cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:30.169891 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-767a9326-d01b-42ec-8bc9-89b8d03c88cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.156340 Jul 14 15:45:30.170466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 557/1092] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:30 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:30.175618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d8f3a453-4a65-4dae-ae26-da47ab650767 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:30.176227 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d8f3a453-4a65-4dae-ae26-da47ab650767 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:30.182535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8f3a453-4a65-4dae-ae26-da47ab650767 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:30.182998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8f3a453-4a65-4dae-ae26-da47ab650767 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:30.184044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8f3a453-4a65-4dae-ae26-da47ab650767 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:30.184260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8f3a453-4a65-4dae-ae26-da47ab650767 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:30.250300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d8f3a453-4a65-4dae-ae26-da47ab650767 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:30.258581 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d8f3a453-4a65-4dae-ae26-da47ab650767 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.087181 Jul 14 15:45:30.259137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 558/1093] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:30 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:30.263765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-71c1cfd8-4578-4ace-8966-34779dcbddd8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:30.264659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-71c1cfd8-4578-4ace-8966-34779dcbddd8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:30.270509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-71c1cfd8-4578-4ace-8966-34779dcbddd8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:30.270947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-71c1cfd8-4578-4ace-8966-34779dcbddd8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:30.271729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-71c1cfd8-4578-4ace-8966-34779dcbddd8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:30.272160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-71c1cfd8-4578-4ace-8966-34779dcbddd8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:30.289209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:30.302700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-71c1cfd8-4578-4ace-8966-34779dcbddd8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042565 Jul 14 15:45:30.303254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 559/1094] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:30 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:31.190608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-629ecc0b-f40a-442f-b1d4-48fc5bd7387a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:31.191256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-629ecc0b-f40a-442f-b1d4-48fc5bd7387a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:31.197808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-629ecc0b-f40a-442f-b1d4-48fc5bd7387a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:31.198256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-629ecc0b-f40a-442f-b1d4-48fc5bd7387a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:31.199011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-629ecc0b-f40a-442f-b1d4-48fc5bd7387a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:31.199448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-629ecc0b-f40a-442f-b1d4-48fc5bd7387a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:31.332676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-629ecc0b-f40a-442f-b1d4-48fc5bd7387a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:31.341225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-629ecc0b-f40a-442f-b1d4-48fc5bd7387a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.155319 Jul 14 15:45:31.341801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 560/1095] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:31 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:31.347330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fae9411c-d081-48db-a389-8da58f38b55c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:31.348138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fae9411c-d081-48db-a389-8da58f38b55c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:31.354806 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fae9411c-d081-48db-a389-8da58f38b55c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:31.355258 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fae9411c-d081-48db-a389-8da58f38b55c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:31.356128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fae9411c-d081-48db-a389-8da58f38b55c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:31.356565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fae9411c-d081-48db-a389-8da58f38b55c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:31.420020 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fae9411c-d081-48db-a389-8da58f38b55c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:31.428042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fae9411c-d081-48db-a389-8da58f38b55c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.085258 Jul 14 15:45:31.428620 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 561/1096] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:31 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:31.433328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dbceb16b-b8e5-414f-93d4-6cf4d5a271a6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:31.434228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dbceb16b-b8e5-414f-93d4-6cf4d5a271a6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:31.440603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dbceb16b-b8e5-414f-93d4-6cf4d5a271a6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:31.441050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dbceb16b-b8e5-414f-93d4-6cf4d5a271a6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:31.441814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dbceb16b-b8e5-414f-93d4-6cf4d5a271a6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:31.442250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dbceb16b-b8e5-414f-93d4-6cf4d5a271a6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:31.475862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dbceb16b-b8e5-414f-93d4-6cf4d5a271a6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046133 Jul 14 15:45:31.476445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 562/1097] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:31 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:32.358471 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4d43e64a-a36d-4203-84de-5e269556ef2a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:32.359147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4d43e64a-a36d-4203-84de-5e269556ef2a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:32.367031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4d43e64a-a36d-4203-84de-5e269556ef2a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:32.367475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4d43e64a-a36d-4203-84de-5e269556ef2a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:32.368249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4d43e64a-a36d-4203-84de-5e269556ef2a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:32.368680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4d43e64a-a36d-4203-84de-5e269556ef2a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:32.503445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4d43e64a-a36d-4203-84de-5e269556ef2a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:32.511270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4d43e64a-a36d-4203-84de-5e269556ef2a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.156669 Jul 14 15:45:32.511860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 563/1098] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:32 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:32.516199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dc7226fc-4b89-413e-ace3-acf1212383d5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:32.518312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dc7226fc-4b89-413e-ace3-acf1212383d5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:32.524787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dc7226fc-4b89-413e-ace3-acf1212383d5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:32.525216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dc7226fc-4b89-413e-ace3-acf1212383d5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:32.526011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dc7226fc-4b89-413e-ace3-acf1212383d5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:32.526448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dc7226fc-4b89-413e-ace3-acf1212383d5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:32.596025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dc7226fc-4b89-413e-ace3-acf1212383d5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:32.603833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dc7226fc-4b89-413e-ace3-acf1212383d5 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.091009 Jul 14 15:45:32.604404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 564/1099] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:32 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:32.609122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-16f50a00-fa56-4a6c-97bf-422365117fdf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:32.609968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-16f50a00-fa56-4a6c-97bf-422365117fdf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:32.617986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16f50a00-fa56-4a6c-97bf-422365117fdf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:32.618441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16f50a00-fa56-4a6c-97bf-422365117fdf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:32.619219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16f50a00-fa56-4a6c-97bf-422365117fdf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:32.619680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16f50a00-fa56-4a6c-97bf-422365117fdf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:32.650656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-16f50a00-fa56-4a6c-97bf-422365117fdf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045215 Jul 14 15:45:32.651221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 565/1100] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:33.529564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-800ba4f7-0fe9-4efe-89c6-a61e7179ef5b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:33.530221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-800ba4f7-0fe9-4efe-89c6-a61e7179ef5b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:33.537137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-800ba4f7-0fe9-4efe-89c6-a61e7179ef5b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:33.537579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-800ba4f7-0fe9-4efe-89c6-a61e7179ef5b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:33.538341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-800ba4f7-0fe9-4efe-89c6-a61e7179ef5b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:33.538770 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-800ba4f7-0fe9-4efe-89c6-a61e7179ef5b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:33.746734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-800ba4f7-0fe9-4efe-89c6-a61e7179ef5b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:33.759821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-800ba4f7-0fe9-4efe-89c6-a61e7179ef5b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.234114 Jul 14 15:45:33.760817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 566/1101] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:33 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:33.769274 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e4ee75de-343c-4153-985c-84417073dac4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:33.770356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e4ee75de-343c-4153-985c-84417073dac4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:33.780770 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4ee75de-343c-4153-985c-84417073dac4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:33.781541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4ee75de-343c-4153-985c-84417073dac4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:33.783496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4ee75de-343c-4153-985c-84417073dac4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:33.784271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4ee75de-343c-4153-985c-84417073dac4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:33.880727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e4ee75de-343c-4153-985c-84417073dac4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:33.888196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e4ee75de-343c-4153-985c-84417073dac4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.126060 Jul 14 15:45:33.888765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 567/1102] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:33 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:33.893882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c3dc8443-b772-4d2d-9741-5305710fd1d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:33.894792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c3dc8443-b772-4d2d-9741-5305710fd1d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:33.900900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3dc8443-b772-4d2d-9741-5305710fd1d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:33.901350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3dc8443-b772-4d2d-9741-5305710fd1d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:33.902144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3dc8443-b772-4d2d-9741-5305710fd1d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:33.902589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3dc8443-b772-4d2d-9741-5305710fd1d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:33.936957 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c3dc8443-b772-4d2d-9741-5305710fd1d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047130 Jul 14 15:45:33.937525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 568/1103] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:33 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:34.780445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-63e410b2-c379-4f79-bb6e-fa4159f6ecb2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:34.781219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-63e410b2-c379-4f79-bb6e-fa4159f6ecb2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:34.789391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63e410b2-c379-4f79-bb6e-fa4159f6ecb2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:34.790126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63e410b2-c379-4f79-bb6e-fa4159f6ecb2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:34.791370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63e410b2-c379-4f79-bb6e-fa4159f6ecb2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:34.792142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63e410b2-c379-4f79-bb6e-fa4159f6ecb2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:34.965194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-63e410b2-c379-4f79-bb6e-fa4159f6ecb2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:34.974835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-63e410b2-c379-4f79-bb6e-fa4159f6ecb2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.199671 Jul 14 15:45:34.975624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 569/1104] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:34 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:34.982161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d6327336-2965-46b5-955d-7551e2428bfb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:34.982800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d6327336-2965-46b5-955d-7551e2428bfb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:34.991580 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6327336-2965-46b5-955d-7551e2428bfb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:34.992360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6327336-2965-46b5-955d-7551e2428bfb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:34.993333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6327336-2965-46b5-955d-7551e2428bfb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:34.994491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6327336-2965-46b5-955d-7551e2428bfb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:35.068566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d6327336-2965-46b5-955d-7551e2428bfb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:35.076412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d6327336-2965-46b5-955d-7551e2428bfb tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.099381 Jul 14 15:45:35.076934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 570/1105] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:34 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:35.082494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1384d557-c53a-4adb-96db-6ff7c6deaa96 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:35.083392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1384d557-c53a-4adb-96db-6ff7c6deaa96 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:35.090544 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1384d557-c53a-4adb-96db-6ff7c6deaa96 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:35.091049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1384d557-c53a-4adb-96db-6ff7c6deaa96 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:35.091855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1384d557-c53a-4adb-96db-6ff7c6deaa96 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:35.092373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1384d557-c53a-4adb-96db-6ff7c6deaa96 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:35.127929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1384d557-c53a-4adb-96db-6ff7c6deaa96 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049782 Jul 14 15:45:35.128524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 571/1106] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:35 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:35.993909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bbca3ba2-6cbb-49b9-b733-16fd2ccda794 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:35.994698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bbca3ba2-6cbb-49b9-b733-16fd2ccda794 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:36.001993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bbca3ba2-6cbb-49b9-b733-16fd2ccda794 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:36.002448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bbca3ba2-6cbb-49b9-b733-16fd2ccda794 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:36.003212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bbca3ba2-6cbb-49b9-b733-16fd2ccda794 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:36.003668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bbca3ba2-6cbb-49b9-b733-16fd2ccda794 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:36.142264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bbca3ba2-6cbb-49b9-b733-16fd2ccda794 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:36.150054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bbca3ba2-6cbb-49b9-b733-16fd2ccda794 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.160000 Jul 14 15:45:36.150627 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 572/1107] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:35 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:36.155352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9b3901e6-a6a5-448b-87e8-5d372de37e65 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:36.155985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9b3901e6-a6a5-448b-87e8-5d372de37e65 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:36.162207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b3901e6-a6a5-448b-87e8-5d372de37e65 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:36.162783 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b3901e6-a6a5-448b-87e8-5d372de37e65 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:36.163400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b3901e6-a6a5-448b-87e8-5d372de37e65 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:36.163861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b3901e6-a6a5-448b-87e8-5d372de37e65 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:36.228307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9b3901e6-a6a5-448b-87e8-5d372de37e65 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:36.236437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9b3901e6-a6a5-448b-87e8-5d372de37e65 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.084817 Jul 14 15:45:36.237008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 573/1108] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:36 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:36.241711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-27cfb2d8-6a97-4b3a-a21a-5783515602e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:36.242719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-27cfb2d8-6a97-4b3a-a21a-5783515602e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:36.249188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27cfb2d8-6a97-4b3a-a21a-5783515602e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:36.249566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27cfb2d8-6a97-4b3a-a21a-5783515602e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:36.250323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27cfb2d8-6a97-4b3a-a21a-5783515602e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:36.250756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27cfb2d8-6a97-4b3a-a21a-5783515602e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:36.293189 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-27cfb2d8-6a97-4b3a-a21a-5783515602e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.055112 Jul 14 15:45:36.293763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 574/1109] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:36 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:37.167486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ee269444-b62d-4240-93c6-439bd6b4f360 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:37.168473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ee269444-b62d-4240-93c6-439bd6b4f360 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:37.175861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee269444-b62d-4240-93c6-439bd6b4f360 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:37.176316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee269444-b62d-4240-93c6-439bd6b4f360 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:37.177091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee269444-b62d-4240-93c6-439bd6b4f360 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:37.177535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee269444-b62d-4240-93c6-439bd6b4f360 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:37.339532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ee269444-b62d-4240-93c6-439bd6b4f360 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:37.347201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ee269444-b62d-4240-93c6-439bd6b4f360 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.183610 Jul 14 15:45:37.347809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 575/1110] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:37 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:37.352357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3155f815-6cb4-4375-9432-61a947d37aa8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:37.353026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3155f815-6cb4-4375-9432-61a947d37aa8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:37.359538 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3155f815-6cb4-4375-9432-61a947d37aa8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:37.360013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3155f815-6cb4-4375-9432-61a947d37aa8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:37.360849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3155f815-6cb4-4375-9432-61a947d37aa8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:37.361375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3155f815-6cb4-4375-9432-61a947d37aa8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:37.366284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:37.431425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3155f815-6cb4-4375-9432-61a947d37aa8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:37.440712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3155f815-6cb4-4375-9432-61a947d37aa8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.091883 Jul 14 15:45:37.441508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 576/1111] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:37 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:37.446045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-45e46d29-7dee-42f0-8080-59d1ddbd154b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:37.446948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-45e46d29-7dee-42f0-8080-59d1ddbd154b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:37.452965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45e46d29-7dee-42f0-8080-59d1ddbd154b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:37.453418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45e46d29-7dee-42f0-8080-59d1ddbd154b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:37.454224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45e46d29-7dee-42f0-8080-59d1ddbd154b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:37.455118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45e46d29-7dee-42f0-8080-59d1ddbd154b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:37.484452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-45e46d29-7dee-42f0-8080-59d1ddbd154b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042119 Jul 14 15:45:37.485020 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 577/1112] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:37 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:38.366229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a2a913b8-469f-479f-95de-e80651a4e8d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:38.366865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a2a913b8-469f-479f-95de-e80651a4e8d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:38.369120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:38.375104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2a913b8-469f-479f-95de-e80651a4e8d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:38.375556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2a913b8-469f-479f-95de-e80651a4e8d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:38.376587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2a913b8-469f-479f-95de-e80651a4e8d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:38.377028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2a913b8-469f-479f-95de-e80651a4e8d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:38.509651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a2a913b8-469f-479f-95de-e80651a4e8d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:38.522144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a2a913b8-469f-479f-95de-e80651a4e8d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.160203 Jul 14 15:45:38.522749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 578/1113] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:38 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:38.529708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9f6314d3-46ce-40fd-861f-a985a0dfe503 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:38.530318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9f6314d3-46ce-40fd-861f-a985a0dfe503 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:38.538589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f6314d3-46ce-40fd-861f-a985a0dfe503 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:38.539040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f6314d3-46ce-40fd-861f-a985a0dfe503 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:38.539837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f6314d3-46ce-40fd-861f-a985a0dfe503 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:38.540275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f6314d3-46ce-40fd-861f-a985a0dfe503 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:38.603857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9f6314d3-46ce-40fd-861f-a985a0dfe503 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:38.611482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9f6314d3-46ce-40fd-861f-a985a0dfe503 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.087788 Jul 14 15:45:38.612077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 579/1114] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:38 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:38.616679 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f3bd23e8-76ff-40a1-b8dd-8581daea4646 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:38.617562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f3bd23e8-76ff-40a1-b8dd-8581daea4646 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:38.623473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3bd23e8-76ff-40a1-b8dd-8581daea4646 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:38.623960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3bd23e8-76ff-40a1-b8dd-8581daea4646 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:38.624757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3bd23e8-76ff-40a1-b8dd-8581daea4646 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:38.625195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3bd23e8-76ff-40a1-b8dd-8581daea4646 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:38.655268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f3bd23e8-76ff-40a1-b8dd-8581daea4646 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042167 Jul 14 15:45:38.655858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 580/1115] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:39.540488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-27e926ec-ae2a-410f-b3d2-113bfe6656f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:39.541160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-27e926ec-ae2a-410f-b3d2-113bfe6656f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:39.547601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27e926ec-ae2a-410f-b3d2-113bfe6656f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:39.548606 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27e926ec-ae2a-410f-b3d2-113bfe6656f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:39.549364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27e926ec-ae2a-410f-b3d2-113bfe6656f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:39.549803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27e926ec-ae2a-410f-b3d2-113bfe6656f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:39.682405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-27e926ec-ae2a-410f-b3d2-113bfe6656f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:39.690402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-27e926ec-ae2a-410f-b3d2-113bfe6656f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.153943 Jul 14 15:45:39.690980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 581/1116] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:39 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:39.695405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c102b2cd-a618-42d1-b635-5b1e5e9a39d0 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:39.696127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c102b2cd-a618-42d1-b635-5b1e5e9a39d0 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:39.701919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c102b2cd-a618-42d1-b635-5b1e5e9a39d0 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:39.702363 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c102b2cd-a618-42d1-b635-5b1e5e9a39d0 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:39.703176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c102b2cd-a618-42d1-b635-5b1e5e9a39d0 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:39.703551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c102b2cd-a618-42d1-b635-5b1e5e9a39d0 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:39.770427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c102b2cd-a618-42d1-b635-5b1e5e9a39d0 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:39.777917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c102b2cd-a618-42d1-b635-5b1e5e9a39d0 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.086004 Jul 14 15:45:39.778487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 582/1117] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:39 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:39.784514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-67fc5b3d-5ac5-4571-97d9-cb41110d4e7d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:39.785427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-67fc5b3d-5ac5-4571-97d9-cb41110d4e7d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:39.791023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-67fc5b3d-5ac5-4571-97d9-cb41110d4e7d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:39.791473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-67fc5b3d-5ac5-4571-97d9-cb41110d4e7d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:39.792278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-67fc5b3d-5ac5-4571-97d9-cb41110d4e7d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:39.792711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-67fc5b3d-5ac5-4571-97d9-cb41110d4e7d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:39.821779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-67fc5b3d-5ac5-4571-97d9-cb41110d4e7d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042289 Jul 14 15:45:39.822327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 583/1118] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:39 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:40.707820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b074059f-f18e-4b2b-a1e1-be67d5c28760 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:40.708436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b074059f-f18e-4b2b-a1e1-be67d5c28760 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:40.724603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b074059f-f18e-4b2b-a1e1-be67d5c28760 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:40.725054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b074059f-f18e-4b2b-a1e1-be67d5c28760 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:40.725823 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b074059f-f18e-4b2b-a1e1-be67d5c28760 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:40.726260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b074059f-f18e-4b2b-a1e1-be67d5c28760 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:40.862347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b074059f-f18e-4b2b-a1e1-be67d5c28760 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:40.870197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b074059f-f18e-4b2b-a1e1-be67d5c28760 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.166959 Jul 14 15:45:40.870782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 584/1119] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:40 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:40.875442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-63b75827-d278-4aec-ad39-f8081a503cab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:40.876123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-63b75827-d278-4aec-ad39-f8081a503cab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:40.882001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63b75827-d278-4aec-ad39-f8081a503cab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:40.882430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63b75827-d278-4aec-ad39-f8081a503cab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:40.883146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63b75827-d278-4aec-ad39-f8081a503cab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:40.883588 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63b75827-d278-4aec-ad39-f8081a503cab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:40.946894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-63b75827-d278-4aec-ad39-f8081a503cab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:40.954396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-63b75827-d278-4aec-ad39-f8081a503cab tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.082635 Jul 14 15:45:40.954964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 585/1120] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:40 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:40.959608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-abd29eef-fc95-4568-b97f-50db0da31f3c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:40.960521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-abd29eef-fc95-4568-b97f-50db0da31f3c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:40.966361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abd29eef-fc95-4568-b97f-50db0da31f3c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:40.966809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abd29eef-fc95-4568-b97f-50db0da31f3c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:40.967573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abd29eef-fc95-4568-b97f-50db0da31f3c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:40.968050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abd29eef-fc95-4568-b97f-50db0da31f3c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:40.998870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-abd29eef-fc95-4568-b97f-50db0da31f3c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042870 Jul 14 15:45:40.999431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 586/1121] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:40 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:41.887453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dd08ed10-3fa7-4bf1-ae75-a08a615f7cfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:41.888150 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dd08ed10-3fa7-4bf1-ae75-a08a615f7cfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:41.895266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dd08ed10-3fa7-4bf1-ae75-a08a615f7cfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:41.895750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dd08ed10-3fa7-4bf1-ae75-a08a615f7cfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:41.896549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dd08ed10-3fa7-4bf1-ae75-a08a615f7cfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:41.896987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dd08ed10-3fa7-4bf1-ae75-a08a615f7cfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:42.034346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dd08ed10-3fa7-4bf1-ae75-a08a615f7cfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:42.042233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dd08ed10-3fa7-4bf1-ae75-a08a615f7cfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.158671 Jul 14 15:45:42.042806 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 587/1122] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:41 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:42.047437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f188cd82-34ed-4fa0-aaa2-7aebcb612a2b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:42.049321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f188cd82-34ed-4fa0-aaa2-7aebcb612a2b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:42.056837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f188cd82-34ed-4fa0-aaa2-7aebcb612a2b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:42.057454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f188cd82-34ed-4fa0-aaa2-7aebcb612a2b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:42.058244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f188cd82-34ed-4fa0-aaa2-7aebcb612a2b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:42.058681 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f188cd82-34ed-4fa0-aaa2-7aebcb612a2b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:42.122412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f188cd82-34ed-4fa0-aaa2-7aebcb612a2b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:42.131616 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f188cd82-34ed-4fa0-aaa2-7aebcb612a2b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.087767 Jul 14 15:45:42.132259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 588/1123] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:42 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:42.138077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e105e852-ff39-434c-b4e0-b746eb21b3da tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:42.139004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e105e852-ff39-434c-b4e0-b746eb21b3da tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:42.145916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e105e852-ff39-434c-b4e0-b746eb21b3da tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:42.146385 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e105e852-ff39-434c-b4e0-b746eb21b3da tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:42.147187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e105e852-ff39-434c-b4e0-b746eb21b3da tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:42.147806 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e105e852-ff39-434c-b4e0-b746eb21b3da tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:42.178985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e105e852-ff39-434c-b4e0-b746eb21b3da tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045642 Jul 14 15:45:42.179571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 589/1124] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:42 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:43.059994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-389133cf-5140-4dae-b15a-0e312122e2cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:43.060678 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-389133cf-5140-4dae-b15a-0e312122e2cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:43.067825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-389133cf-5140-4dae-b15a-0e312122e2cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:43.068279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-389133cf-5140-4dae-b15a-0e312122e2cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:43.069044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-389133cf-5140-4dae-b15a-0e312122e2cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:43.069482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-389133cf-5140-4dae-b15a-0e312122e2cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:43.217705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-389133cf-5140-4dae-b15a-0e312122e2cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:43.225412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-389133cf-5140-4dae-b15a-0e312122e2cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.169405 Jul 14 15:45:43.225989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 590/1125] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:43 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:43.230572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-665f729b-7328-40b2-8c83-adfed2da14b8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:43.231173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-665f729b-7328-40b2-8c83-adfed2da14b8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:43.237210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-665f729b-7328-40b2-8c83-adfed2da14b8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:43.237650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-665f729b-7328-40b2-8c83-adfed2da14b8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:43.238406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-665f729b-7328-40b2-8c83-adfed2da14b8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:43.238839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-665f729b-7328-40b2-8c83-adfed2da14b8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:43.303505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-665f729b-7328-40b2-8c83-adfed2da14b8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:43.314344 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-665f729b-7328-40b2-8c83-adfed2da14b8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.086619 Jul 14 15:45:43.315028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 591/1126] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:43 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:43.319956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-36855708-8469-49fb-84b2-f3adc5d53d90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:43.320903 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-36855708-8469-49fb-84b2-f3adc5d53d90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:43.327758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36855708-8469-49fb-84b2-f3adc5d53d90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:43.328210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36855708-8469-49fb-84b2-f3adc5d53d90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:43.329586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36855708-8469-49fb-84b2-f3adc5d53d90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:43.330036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36855708-8469-49fb-84b2-f3adc5d53d90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:43.354958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:43.359911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-36855708-8469-49fb-84b2-f3adc5d53d90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043876 Jul 14 15:45:43.360537 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 592/1127] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:43 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:44.243364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2b04d1f8-0416-4362-92bd-14e9e65ac70c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:44.244254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2b04d1f8-0416-4362-92bd-14e9e65ac70c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:44.251643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b04d1f8-0416-4362-92bd-14e9e65ac70c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:44.252145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b04d1f8-0416-4362-92bd-14e9e65ac70c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:44.252922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b04d1f8-0416-4362-92bd-14e9e65ac70c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:44.253363 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b04d1f8-0416-4362-92bd-14e9e65ac70c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:44.398719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2b04d1f8-0416-4362-92bd-14e9e65ac70c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:44.406675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2b04d1f8-0416-4362-92bd-14e9e65ac70c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.167239 Jul 14 15:45:44.407386 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 593/1128] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:44 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:44.412096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b6e21528-c686-4467-bb13-982d47daa154 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:44.412706 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b6e21528-c686-4467-bb13-982d47daa154 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:44.418630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6e21528-c686-4467-bb13-982d47daa154 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:44.419084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6e21528-c686-4467-bb13-982d47daa154 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:44.419890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6e21528-c686-4467-bb13-982d47daa154 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:44.420332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6e21528-c686-4467-bb13-982d47daa154 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:44.495572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b6e21528-c686-4467-bb13-982d47daa154 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:44.504984 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b6e21528-c686-4467-bb13-982d47daa154 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.096363 Jul 14 15:45:44.505490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 594/1129] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:44 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:44.510228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c4ad959e-6e0d-4fb4-b0e7-2fa16fb76471 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:44.511140 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c4ad959e-6e0d-4fb4-b0e7-2fa16fb76471 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:44.517924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4ad959e-6e0d-4fb4-b0e7-2fa16fb76471 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:44.518394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4ad959e-6e0d-4fb4-b0e7-2fa16fb76471 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:44.519169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4ad959e-6e0d-4fb4-b0e7-2fa16fb76471 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:44.519625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4ad959e-6e0d-4fb4-b0e7-2fa16fb76471 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:44.554852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c4ad959e-6e0d-4fb4-b0e7-2fa16fb76471 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.048294 Jul 14 15:45:44.555436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 595/1130] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:45.424289 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4b700ca9-3e4c-4248-865e-cbe6abdeadc0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:45.424971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4b700ca9-3e4c-4248-865e-cbe6abdeadc0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:45.432016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b700ca9-3e4c-4248-865e-cbe6abdeadc0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:45.432458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b700ca9-3e4c-4248-865e-cbe6abdeadc0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:45.433223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b700ca9-3e4c-4248-865e-cbe6abdeadc0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:45.433652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b700ca9-3e4c-4248-865e-cbe6abdeadc0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:45.571630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4b700ca9-3e4c-4248-865e-cbe6abdeadc0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:45.580197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4b700ca9-3e4c-4248-865e-cbe6abdeadc0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.159990 Jul 14 15:45:45.580764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 596/1131] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:45 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:45.585626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e255d319-5ddc-4846-8a98-00c36feda9bf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:45.586292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e255d319-5ddc-4846-8a98-00c36feda9bf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:45.592233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e255d319-5ddc-4846-8a98-00c36feda9bf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:45.592675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e255d319-5ddc-4846-8a98-00c36feda9bf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:45.593423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e255d319-5ddc-4846-8a98-00c36feda9bf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:45.593852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e255d319-5ddc-4846-8a98-00c36feda9bf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:45.658365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e255d319-5ddc-4846-8a98-00c36feda9bf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:45.666281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e255d319-5ddc-4846-8a98-00c36feda9bf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.084524 Jul 14 15:45:45.666870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 597/1132] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:45 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:45.671624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ca536b84-a160-4616-9ded-390454314513 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:45.672541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ca536b84-a160-4616-9ded-390454314513 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:45.679190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ca536b84-a160-4616-9ded-390454314513 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:45.679563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ca536b84-a160-4616-9ded-390454314513 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:45.680365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ca536b84-a160-4616-9ded-390454314513 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:45.680807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ca536b84-a160-4616-9ded-390454314513 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:45.711024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ca536b84-a160-4616-9ded-390454314513 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043002 Jul 14 15:45:45.711767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 598/1133] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:45 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:46.598641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-74d84a82-0e3a-40fd-8a70-5b1a1e68ef54 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:46.599375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-74d84a82-0e3a-40fd-8a70-5b1a1e68ef54 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:46.606592 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74d84a82-0e3a-40fd-8a70-5b1a1e68ef54 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:46.607045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74d84a82-0e3a-40fd-8a70-5b1a1e68ef54 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:46.607893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74d84a82-0e3a-40fd-8a70-5b1a1e68ef54 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:46.608333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74d84a82-0e3a-40fd-8a70-5b1a1e68ef54 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:46.747188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-74d84a82-0e3a-40fd-8a70-5b1a1e68ef54 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:46.755660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-74d84a82-0e3a-40fd-8a70-5b1a1e68ef54 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.161620 Jul 14 15:45:46.756256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 599/1134] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:46 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:46.760962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-20f8cfa4-2010-418f-ba52-7332e66ba4e3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:46.761605 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-20f8cfa4-2010-418f-ba52-7332e66ba4e3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:46.769141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20f8cfa4-2010-418f-ba52-7332e66ba4e3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:46.769588 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20f8cfa4-2010-418f-ba52-7332e66ba4e3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:46.770361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20f8cfa4-2010-418f-ba52-7332e66ba4e3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:46.770793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20f8cfa4-2010-418f-ba52-7332e66ba4e3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:46.835998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-20f8cfa4-2010-418f-ba52-7332e66ba4e3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:46.843422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-20f8cfa4-2010-418f-ba52-7332e66ba4e3 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.086186 Jul 14 15:45:46.844118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 600/1135] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:46 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:46.849510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-81e10b8f-d9b2-4591-a3b5-93735816add0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:46.850833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-81e10b8f-d9b2-4591-a3b5-93735816add0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:46.856470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-81e10b8f-d9b2-4591-a3b5-93735816add0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:46.856919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-81e10b8f-d9b2-4591-a3b5-93735816add0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:46.857681 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-81e10b8f-d9b2-4591-a3b5-93735816add0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:46.858119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-81e10b8f-d9b2-4591-a3b5-93735816add0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:46.888537 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-81e10b8f-d9b2-4591-a3b5-93735816add0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043249 Jul 14 15:45:46.889098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 601/1136] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:46 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:47.773007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2895b24e-3a99-4603-b12c-07c899cdfa73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:47.773849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2895b24e-3a99-4603-b12c-07c899cdfa73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:47.780500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2895b24e-3a99-4603-b12c-07c899cdfa73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:47.780939 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2895b24e-3a99-4603-b12c-07c899cdfa73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:47.781689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2895b24e-3a99-4603-b12c-07c899cdfa73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:47.782765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2895b24e-3a99-4603-b12c-07c899cdfa73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:47.917522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2895b24e-3a99-4603-b12c-07c899cdfa73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:47.925081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2895b24e-3a99-4603-b12c-07c899cdfa73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.156053 Jul 14 15:45:47.925637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 602/1137] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:47 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:47.930146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bb5c0ca9-07f3-4195-a2c0-b29362afbc6d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:47.930746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bb5c0ca9-07f3-4195-a2c0-b29362afbc6d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:47.936653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb5c0ca9-07f3-4195-a2c0-b29362afbc6d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:47.937096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb5c0ca9-07f3-4195-a2c0-b29362afbc6d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:47.937847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb5c0ca9-07f3-4195-a2c0-b29362afbc6d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:47.938296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb5c0ca9-07f3-4195-a2c0-b29362afbc6d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:48.003695 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bb5c0ca9-07f3-4195-a2c0-b29362afbc6d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:48.011303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bb5c0ca9-07f3-4195-a2c0-b29362afbc6d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.084709 Jul 14 15:45:48.011866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 603/1138] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:47 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:48.016908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d36e472f-2be0-412d-a35a-a0a3383d6198 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:48.017817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d36e472f-2be0-412d-a35a-a0a3383d6198 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:48.023669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d36e472f-2be0-412d-a35a-a0a3383d6198 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:48.024064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d36e472f-2be0-412d-a35a-a0a3383d6198 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:48.024818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d36e472f-2be0-412d-a35a-a0a3383d6198 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:48.025247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d36e472f-2be0-412d-a35a-a0a3383d6198 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:48.055058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d36e472f-2be0-412d-a35a-a0a3383d6198 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042165 Jul 14 15:45:48.055618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 604/1139] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:48 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:48.942862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b7adb709-f8d3-4c22-a722-e292747203b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:48.943524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b7adb709-f8d3-4c22-a722-e292747203b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:48.950061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b7adb709-f8d3-4c22-a722-e292747203b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:48.950506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b7adb709-f8d3-4c22-a722-e292747203b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:48.951256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b7adb709-f8d3-4c22-a722-e292747203b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:48.951724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b7adb709-f8d3-4c22-a722-e292747203b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:49.087422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b7adb709-f8d3-4c22-a722-e292747203b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:49.096713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b7adb709-f8d3-4c22-a722-e292747203b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.157015 Jul 14 15:45:49.097297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 605/1140] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:48 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:49.103921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4cc3aa30-9a9d-4516-8888-08fcc842d970 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:49.104521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4cc3aa30-9a9d-4516-8888-08fcc842d970 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:49.111181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4cc3aa30-9a9d-4516-8888-08fcc842d970 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:49.111785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4cc3aa30-9a9d-4516-8888-08fcc842d970 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:49.112555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4cc3aa30-9a9d-4516-8888-08fcc842d970 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:49.112980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4cc3aa30-9a9d-4516-8888-08fcc842d970 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:49.175927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4cc3aa30-9a9d-4516-8888-08fcc842d970 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:49.183772 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4cc3aa30-9a9d-4516-8888-08fcc842d970 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.085481 Jul 14 15:45:49.184338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 606/1141] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:49 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:49.189266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-184156f2-29c4-4a09-a5a7-afedb8b4e1a9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:49.189920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-184156f2-29c4-4a09-a5a7-afedb8b4e1a9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:49.196074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-184156f2-29c4-4a09-a5a7-afedb8b4e1a9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:49.196458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-184156f2-29c4-4a09-a5a7-afedb8b4e1a9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:49.197228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-184156f2-29c4-4a09-a5a7-afedb8b4e1a9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:49.197667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-184156f2-29c4-4a09-a5a7-afedb8b4e1a9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:49.227170 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-184156f2-29c4-4a09-a5a7-afedb8b4e1a9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041780 Jul 14 15:45:49.227777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 607/1142] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:49 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:50.115444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-290b19aa-2f1c-450c-949d-f2ff1d2d08a6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:50.116185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-290b19aa-2f1c-450c-949d-f2ff1d2d08a6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:50.123045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-290b19aa-2f1c-450c-949d-f2ff1d2d08a6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:50.123498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-290b19aa-2f1c-450c-949d-f2ff1d2d08a6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:50.124300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-290b19aa-2f1c-450c-949d-f2ff1d2d08a6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:50.124738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-290b19aa-2f1c-450c-949d-f2ff1d2d08a6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:50.264661 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-290b19aa-2f1c-450c-949d-f2ff1d2d08a6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:50.272182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-290b19aa-2f1c-450c-949d-f2ff1d2d08a6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.160626 Jul 14 15:45:50.272767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 608/1143] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:50 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:50.277179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d6616de3-fcae-4181-83e9-9783225aa654 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:50.277837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d6616de3-fcae-4181-83e9-9783225aa654 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:50.284139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6616de3-fcae-4181-83e9-9783225aa654 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:50.284595 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6616de3-fcae-4181-83e9-9783225aa654 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:50.285361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6616de3-fcae-4181-83e9-9783225aa654 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:50.285802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6616de3-fcae-4181-83e9-9783225aa654 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:50.304707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:50.349077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d6616de3-fcae-4181-83e9-9783225aa654 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:50.356886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d6616de3-fcae-4181-83e9-9783225aa654 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.083111 Jul 14 15:45:50.357454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 609/1144] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:50 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:50.363113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f33e251a-5d05-44ce-8854-cfff0c978939 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:50.364044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f33e251a-5d05-44ce-8854-cfff0c978939 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:50.370032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f33e251a-5d05-44ce-8854-cfff0c978939 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:50.370481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f33e251a-5d05-44ce-8854-cfff0c978939 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:50.371250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f33e251a-5d05-44ce-8854-cfff0c978939 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:50.371714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f33e251a-5d05-44ce-8854-cfff0c978939 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:50.401356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f33e251a-5d05-44ce-8854-cfff0c978939 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042881 Jul 14 15:45:50.401913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 610/1145] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:50 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:51.289420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-93927493-e3f3-4f05-bfb8-e43e4a23c74c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:51.290099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-93927493-e3f3-4f05-bfb8-e43e4a23c74c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:51.296602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93927493-e3f3-4f05-bfb8-e43e4a23c74c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:51.297047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93927493-e3f3-4f05-bfb8-e43e4a23c74c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:51.297898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93927493-e3f3-4f05-bfb8-e43e4a23c74c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:51.298339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93927493-e3f3-4f05-bfb8-e43e4a23c74c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:51.442529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-93927493-e3f3-4f05-bfb8-e43e4a23c74c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:51.450161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-93927493-e3f3-4f05-bfb8-e43e4a23c74c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.164729 Jul 14 15:45:51.450730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 611/1146] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:51 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:51.456373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4563924f-b792-4781-90fd-cfb66453b3fc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:51.456988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4563924f-b792-4781-90fd-cfb66453b3fc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:51.464182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4563924f-b792-4781-90fd-cfb66453b3fc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:51.464726 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4563924f-b792-4781-90fd-cfb66453b3fc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:51.465515 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4563924f-b792-4781-90fd-cfb66453b3fc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:51.465947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4563924f-b792-4781-90fd-cfb66453b3fc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:51.537602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4563924f-b792-4781-90fd-cfb66453b3fc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:51.545202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4563924f-b792-4781-90fd-cfb66453b3fc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.093520 Jul 14 15:45:51.545779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 612/1147] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:51 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:51.550764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-04b2cf00-da3c-45c5-aeba-dbab9284482b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:51.551693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-04b2cf00-da3c-45c5-aeba-dbab9284482b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:51.558045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-04b2cf00-da3c-45c5-aeba-dbab9284482b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:51.558486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-04b2cf00-da3c-45c5-aeba-dbab9284482b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:51.559244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-04b2cf00-da3c-45c5-aeba-dbab9284482b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:51.559707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-04b2cf00-da3c-45c5-aeba-dbab9284482b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:51.591047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-04b2cf00-da3c-45c5-aeba-dbab9284482b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044225 Jul 14 15:45:51.591639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 613/1148] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:51 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:52.470094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6cfc6165-872c-4dba-b749-6887dbdba263 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:52.471221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6cfc6165-872c-4dba-b749-6887dbdba263 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:52.478021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cfc6165-872c-4dba-b749-6887dbdba263 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:52.478471 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cfc6165-872c-4dba-b749-6887dbdba263 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:52.479271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cfc6165-872c-4dba-b749-6887dbdba263 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:52.479757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cfc6165-872c-4dba-b749-6887dbdba263 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:52.625588 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6cfc6165-872c-4dba-b749-6887dbdba263 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:52.633416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6cfc6165-872c-4dba-b749-6887dbdba263 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.167775 Jul 14 15:45:52.633999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 614/1149] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:52 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:52.638484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6b58aa89-9d2d-4052-9504-189050dd9c4d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:52.639096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6b58aa89-9d2d-4052-9504-189050dd9c4d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:52.645995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b58aa89-9d2d-4052-9504-189050dd9c4d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:52.646446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b58aa89-9d2d-4052-9504-189050dd9c4d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:52.647264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b58aa89-9d2d-4052-9504-189050dd9c4d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:52.647694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b58aa89-9d2d-4052-9504-189050dd9c4d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:52.712756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6b58aa89-9d2d-4052-9504-189050dd9c4d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:52.721077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6b58aa89-9d2d-4052-9504-189050dd9c4d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.085996 Jul 14 15:45:52.721561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 615/1150] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:52 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:52.726199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-045a05e6-6f5e-4ff9-bb16-582c555e764c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:52.727313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-045a05e6-6f5e-4ff9-bb16-582c555e764c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:52.733893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-045a05e6-6f5e-4ff9-bb16-582c555e764c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:52.734341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-045a05e6-6f5e-4ff9-bb16-582c555e764c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:52.735111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-045a05e6-6f5e-4ff9-bb16-582c555e764c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:52.735708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-045a05e6-6f5e-4ff9-bb16-582c555e764c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:52.766395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-045a05e6-6f5e-4ff9-bb16-582c555e764c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043689 Jul 14 15:45:52.767453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 616/1151] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:52 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:53.752368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7db46be1-598a-4f6c-b7f7-39a7d392fd17 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:53.752964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7db46be1-598a-4f6c-b7f7-39a7d392fd17 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:53.759942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7db46be1-598a-4f6c-b7f7-39a7d392fd17 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:53.760729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7db46be1-598a-4f6c-b7f7-39a7d392fd17 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:53.762076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7db46be1-598a-4f6c-b7f7-39a7d392fd17 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:53.762839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7db46be1-598a-4f6c-b7f7-39a7d392fd17 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:53.904864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7db46be1-598a-4f6c-b7f7-39a7d392fd17 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:53.913030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7db46be1-598a-4f6c-b7f7-39a7d392fd17 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.266603 Jul 14 15:45:53.913593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 617/1152] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:53 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:53.917910 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bb46a03f-f81a-42dd-8bbe-3819247ce118 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:53.918511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bb46a03f-f81a-42dd-8bbe-3819247ce118 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:53.924484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb46a03f-f81a-42dd-8bbe-3819247ce118 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:53.924933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb46a03f-f81a-42dd-8bbe-3819247ce118 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:53.925689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb46a03f-f81a-42dd-8bbe-3819247ce118 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:53.926123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb46a03f-f81a-42dd-8bbe-3819247ce118 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:53.987271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bb46a03f-f81a-42dd-8bbe-3819247ce118 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:53.994848 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bb46a03f-f81a-42dd-8bbe-3819247ce118 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.080293 Jul 14 15:45:53.995419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 618/1153] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:53 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:54.000222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f5fc2820-fb46-4760-a750-0f00ea5e459d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:54.001351 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f5fc2820-fb46-4760-a750-0f00ea5e459d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:54.007169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5fc2820-fb46-4760-a750-0f00ea5e459d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:54.007619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5fc2820-fb46-4760-a750-0f00ea5e459d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:54.008396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5fc2820-fb46-4760-a750-0f00ea5e459d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:54.008825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5fc2820-fb46-4760-a750-0f00ea5e459d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:54.038230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f5fc2820-fb46-4760-a750-0f00ea5e459d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041721 Jul 14 15:45:54.038774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 619/1154] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:53 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:54.930299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b1c59431-aa06-4ee7-8b1f-556e79aee499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:54.930970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b1c59431-aa06-4ee7-8b1f-556e79aee499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:54.937682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b1c59431-aa06-4ee7-8b1f-556e79aee499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:54.938150 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b1c59431-aa06-4ee7-8b1f-556e79aee499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:54.939784 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b1c59431-aa06-4ee7-8b1f-556e79aee499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:54.940228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b1c59431-aa06-4ee7-8b1f-556e79aee499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:55.071245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b1c59431-aa06-4ee7-8b1f-556e79aee499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:55.078737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b1c59431-aa06-4ee7-8b1f-556e79aee499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.152462 Jul 14 15:45:55.079280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 620/1155] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:54 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:55.083654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-99040db6-40a2-4ff1-8a09-857322d46501 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:55.084258 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-99040db6-40a2-4ff1-8a09-857322d46501 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:55.089807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-99040db6-40a2-4ff1-8a09-857322d46501 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:55.090256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-99040db6-40a2-4ff1-8a09-857322d46501 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:55.091009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-99040db6-40a2-4ff1-8a09-857322d46501 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:55.091444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-99040db6-40a2-4ff1-8a09-857322d46501 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:55.157452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-99040db6-40a2-4ff1-8a09-857322d46501 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:55.165209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-99040db6-40a2-4ff1-8a09-857322d46501 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.084950 Jul 14 15:45:55.165768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 621/1156] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:55 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:55.170319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d7641db2-637f-4503-a5b3-d281ab635532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:55.171264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d7641db2-637f-4503-a5b3-d281ab635532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:55.182247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d7641db2-637f-4503-a5b3-d281ab635532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:55.182617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d7641db2-637f-4503-a5b3-d281ab635532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:55.183393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d7641db2-637f-4503-a5b3-d281ab635532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:55.183852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d7641db2-637f-4503-a5b3-d281ab635532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:55.213164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d7641db2-637f-4503-a5b3-d281ab635532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046384 Jul 14 15:45:55.213742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 622/1157] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:55 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:56.095082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f135ff91-626d-4b4b-962b-af1c72e94b78 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:56.095755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f135ff91-626d-4b4b-962b-af1c72e94b78 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:56.102281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f135ff91-626d-4b4b-962b-af1c72e94b78 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:56.102736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f135ff91-626d-4b4b-962b-af1c72e94b78 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:56.103492 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f135ff91-626d-4b4b-962b-af1c72e94b78 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:56.103959 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f135ff91-626d-4b4b-962b-af1c72e94b78 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:56.234887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f135ff91-626d-4b4b-962b-af1c72e94b78 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:56.243762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f135ff91-626d-4b4b-962b-af1c72e94b78 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.152333 Jul 14 15:45:56.244440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 623/1158] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:56 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:56.249030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e91c00de-1d72-4f59-ab17-6bf84b42a5fd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:56.249572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e91c00de-1d72-4f59-ab17-6bf84b42a5fd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:56.256650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e91c00de-1d72-4f59-ab17-6bf84b42a5fd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:56.257091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e91c00de-1d72-4f59-ab17-6bf84b42a5fd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:56.257861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e91c00de-1d72-4f59-ab17-6bf84b42a5fd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:56.258287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e91c00de-1d72-4f59-ab17-6bf84b42a5fd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:56.320115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e91c00de-1d72-4f59-ab17-6bf84b42a5fd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:56.327651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e91c00de-1d72-4f59-ab17-6bf84b42a5fd tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.082254 Jul 14 15:45:56.328213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 624/1159] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:56 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:56.332816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-542a5da5-71b5-4f46-8384-efaf7ed00212 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:56.333720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-542a5da5-71b5-4f46-8384-efaf7ed00212 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:56.339434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-542a5da5-71b5-4f46-8384-efaf7ed00212 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:56.339915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-542a5da5-71b5-4f46-8384-efaf7ed00212 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:56.340666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-542a5da5-71b5-4f46-8384-efaf7ed00212 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:56.341096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-542a5da5-71b5-4f46-8384-efaf7ed00212 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:56.370354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-542a5da5-71b5-4f46-8384-efaf7ed00212 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041076 Jul 14 15:45:56.370910 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 625/1160] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:56 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:57.261713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-194d1f16-4103-4888-b4e1-6e9d113dc09a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:57.262356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-194d1f16-4103-4888-b4e1-6e9d113dc09a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:57.269573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-194d1f16-4103-4888-b4e1-6e9d113dc09a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:57.270030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-194d1f16-4103-4888-b4e1-6e9d113dc09a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:57.270763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-194d1f16-4103-4888-b4e1-6e9d113dc09a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:57.271189 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-194d1f16-4103-4888-b4e1-6e9d113dc09a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:57.275140 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:57.409055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-194d1f16-4103-4888-b4e1-6e9d113dc09a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:57.416711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-194d1f16-4103-4888-b4e1-6e9d113dc09a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.158926 Jul 14 15:45:57.417274 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 626/1161] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:57 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:57.421604 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8421165f-79c4-495a-a01a-552a90727941 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:57.422203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8421165f-79c4-495a-a01a-552a90727941 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:57.428053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8421165f-79c4-495a-a01a-552a90727941 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:57.428501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8421165f-79c4-495a-a01a-552a90727941 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:57.429287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8421165f-79c4-495a-a01a-552a90727941 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:57.429722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8421165f-79c4-495a-a01a-552a90727941 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:57.491497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8421165f-79c4-495a-a01a-552a90727941 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:57.499061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8421165f-79c4-495a-a01a-552a90727941 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.080851 Jul 14 15:45:57.499698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 627/1162] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:57 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:57.505268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-189fd97d-799d-4963-8d95-5db601d00545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:57.506185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-189fd97d-799d-4963-8d95-5db601d00545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:57.508099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:45:57.513514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-189fd97d-799d-4963-8d95-5db601d00545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:57.513907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-189fd97d-799d-4963-8d95-5db601d00545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:57.514678 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-189fd97d-799d-4963-8d95-5db601d00545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:57.515118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-189fd97d-799d-4963-8d95-5db601d00545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:57.550800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-189fd97d-799d-4963-8d95-5db601d00545 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.049988 Jul 14 15:45:57.551379 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 628/1163] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:57 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:58.433958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7e386760-e25e-46f8-adbd-6484efba52a5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:58.434656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7e386760-e25e-46f8-adbd-6484efba52a5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:58.441307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e386760-e25e-46f8-adbd-6484efba52a5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:58.441750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e386760-e25e-46f8-adbd-6484efba52a5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:58.442497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e386760-e25e-46f8-adbd-6484efba52a5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:58.442928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e386760-e25e-46f8-adbd-6484efba52a5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:58.578320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7e386760-e25e-46f8-adbd-6484efba52a5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:58.586429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7e386760-e25e-46f8-adbd-6484efba52a5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.156323 Jul 14 15:45:58.586994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 629/1164] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:58 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 15:45:58.591459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-90b626d8-62d8-42a0-83f0-cb8f6d11712c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:58.592099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-90b626d8-62d8-42a0-83f0-cb8f6d11712c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:58.598813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90b626d8-62d8-42a0-83f0-cb8f6d11712c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:58.599288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90b626d8-62d8-42a0-83f0-cb8f6d11712c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:58.600162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90b626d8-62d8-42a0-83f0-cb8f6d11712c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:58.600630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90b626d8-62d8-42a0-83f0-cb8f6d11712c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:58.665796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-90b626d8-62d8-42a0-83f0-cb8f6d11712c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:45:58.673518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-90b626d8-62d8-42a0-83f0-cb8f6d11712c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.085538 Jul 14 15:45:58.674111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 630/1165] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:45:58 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:45:58.678684 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-de3398df-3bd3-43c1-a2d5-2e8a50d242c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:58.679639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-de3398df-3bd3-43c1-a2d5-2e8a50d242c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:58.685520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de3398df-3bd3-43c1-a2d5-2e8a50d242c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:58.685963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de3398df-3bd3-43c1-a2d5-2e8a50d242c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:58.686712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de3398df-3bd3-43c1-a2d5-2e8a50d242c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:58.687142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de3398df-3bd3-43c1-a2d5-2e8a50d242c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:58.717954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-de3398df-3bd3-43c1-a2d5-2e8a50d242c6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042798 Jul 14 15:45:58.718511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 631/1166] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:45:58 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:45:58.945406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7a3efd0b-ba57-4acc-bd14-7ee9ba4a5f14 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:45:58.945894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7a3efd0b-ba57-4acc-bd14-7ee9ba4a5f14 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:45:58.951986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a3efd0b-ba57-4acc-bd14-7ee9ba4a5f14 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:58.952431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a3efd0b-ba57-4acc-bd14-7ee9ba4a5f14 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:45:58.953186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a3efd0b-ba57-4acc-bd14-7ee9ba4a5f14 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:45:58.953617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a3efd0b-ba57-4acc-bd14-7ee9ba4a5f14 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:46:01.401506 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-010ef732-9008-483e-ac48-b0243f3d4ca9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'services' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:46:01.502162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-7a3efd0b-ba57-4acc-bd14-7ee9ba4a5f14 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'services' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:46:08.949976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=9 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:11.437715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=4 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:11.506801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=42 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:46:40.466172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:46:40.466922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:46:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:46:48.816878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:46:48.817488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:46:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:46:58.861999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:46:58.862682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:46:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:47:13.307654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:47:13.308309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:47:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:47:31.555513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:47:31.556212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:47:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:48:01.760790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-010ef732-9008-483e-ac48-b0243f3d4ca9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f" status: 202 len: 0 microversion: 2.1 time: 182.878281 Jul 14 15:48:01.761730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 536/1167] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:44:58 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f => generated 0 bytes in 182880 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 15:48:01.767357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7f0c69d5-c714-4cb4-8132-7ae5d72caa76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:01.768114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7f0c69d5-c714-4cb4-8132-7ae5d72caa76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:01.775939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7f0c69d5-c714-4cb4-8132-7ae5d72caa76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:01.776653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7f0c69d5-c714-4cb4-8132-7ae5d72caa76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:01.777427 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7f0c69d5-c714-4cb4-8132-7ae5d72caa76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:01.778066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7f0c69d5-c714-4cb4-8132-7ae5d72caa76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:01.841323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-7a3efd0b-ba57-4acc-bd14-7ee9ba4a5f14 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0c3a26b-4d51-4ac6-9611-be0a5992cc67) Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7a3efd0b-ba57-4acc-bd14-7ee9ba4a5f14 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f HTTP/1.1 Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 15:48:01.845755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 15:48:01.847242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:48:01.847242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:48:01.847242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:48:01.847242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:48:01.847242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:48:01.847242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 15:48:01.847242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 15:48:01.847242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 15:48:01.847242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:48:01.847242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0c3a26b-4d51-4ac6-9611-be0a5992cc67) Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'server_id': 'd4e7b59f-1959-4ed1-ba26-c70f4d9336bb', 'id': 'c8af675f-e8c6-4320-9d18-1156dda9bb6f'} Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:48:01.847918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0c3a26b-4d51-4ac6-9611-be0a5992cc67) Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:48:01.849816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0c3a26b-4d51-4ac6-9611-be0a5992cc67) Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:01.853181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0c3a26b-4d51-4ac6-9611-be0a5992cc67) Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:01.855516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0c3a26b-4d51-4ac6-9611-be0a5992cc67) Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0c3a26b-4d51-4ac6-9611-be0a5992cc67) Jul 14 15:48:01.860123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:48:01.861529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7a3efd0b-ba57-4acc-bd14-7ee9ba4a5f14 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f0c3a26b-4d51-4ac6-9611-be0a5992cc67) {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:48:01.861529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7a3efd0b-ba57-4acc-bd14-7ee9ba4a5f14 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f" status: 400 len: 269 microversion: 2.1 time: 122.917853 Jul 14 15:48:01.861846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 632/1168] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:45:58 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f => generated 269 bytes in 122921 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 15:48:01.869785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c0184863-1e8c-4435-be2a-3ff5e793a532 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:01.870877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c0184863-1e8c-4435-be2a-3ff5e793a532 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:01.877762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0184863-1e8c-4435-be2a-3ff5e793a532 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:01.878363 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0184863-1e8c-4435-be2a-3ff5e793a532 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:01.879285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0184863-1e8c-4435-be2a-3ff5e793a532 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:01.879760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0184863-1e8c-4435-be2a-3ff5e793a532 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:01.922145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7f0c69d5-c714-4cb4-8132-7ae5d72caa76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:01.930064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7f0c69d5-c714-4cb4-8132-7ae5d72caa76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.167166 Jul 14 15:48:01.930664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 537/1169] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:01 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:01.959571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c0184863-1e8c-4435-be2a-3ff5e793a532 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:01.969494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c0184863-1e8c-4435-be2a-3ff5e793a532 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.106289 Jul 14 15:48:01.970078 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 633/1170] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:01 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:01.975156 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f38877bf-74fa-42ba-9035-d73ba248a9d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:01.975693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f38877bf-74fa-42ba-9035-d73ba248a9d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:01.981708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f38877bf-74fa-42ba-9035-d73ba248a9d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:01.982154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f38877bf-74fa-42ba-9035-d73ba248a9d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:01.982931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f38877bf-74fa-42ba-9035-d73ba248a9d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:01.983372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f38877bf-74fa-42ba-9035-d73ba248a9d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:02.024061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-552b026d-ce4b-4c9f-9fef-ed7a5c9c5912 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:02.025389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-552b026d-ce4b-4c9f-9fef-ed7a5c9c5912 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:02.033291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-552b026d-ce4b-4c9f-9fef-ed7a5c9c5912 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:02.033682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-552b026d-ce4b-4c9f-9fef-ed7a5c9c5912 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:02.034679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-552b026d-ce4b-4c9f-9fef-ed7a5c9c5912 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:02.035170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-552b026d-ce4b-4c9f-9fef-ed7a5c9c5912 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:02.066725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-552b026d-ce4b-4c9f-9fef-ed7a5c9c5912 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.134739 Jul 14 15:48:02.067886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 538/1171] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:48:01 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:48:02.072667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bd18a4a8-ab41-4aac-a391-1f892327bf1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:02.073387 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bd18a4a8-ab41-4aac-a391-1f892327bf1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:02.079520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bd18a4a8-ab41-4aac-a391-1f892327bf1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:02.080012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bd18a4a8-ab41-4aac-a391-1f892327bf1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:02.080789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bd18a4a8-ab41-4aac-a391-1f892327bf1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:02.081236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bd18a4a8-ab41-4aac-a391-1f892327bf1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:02.221613 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bd18a4a8-ab41-4aac-a391-1f892327bf1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:02.230529 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bd18a4a8-ab41-4aac-a391-1f892327bf1a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.161495 Jul 14 15:48:02.231110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 539/1172] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:02 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:02.235541 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e6470592-df27-496f-b4be-ae05c196fcfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:02.236178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e6470592-df27-496f-b4be-ae05c196fcfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:02.243703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6470592-df27-496f-b4be-ae05c196fcfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:02.244191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6470592-df27-496f-b4be-ae05c196fcfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:02.245074 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6470592-df27-496f-b4be-ae05c196fcfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:02.245554 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e6470592-df27-496f-b4be-ae05c196fcfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:02.310622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e6470592-df27-496f-b4be-ae05c196fcfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:48:02.319537 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e6470592-df27-496f-b4be-ae05c196fcfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.086981 Jul 14 15:48:02.320629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 540/1173] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:48:02 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:48:02.329213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-66d43cc8-426e-44a8-8e1d-ee8d65145c41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:02.330477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-66d43cc8-426e-44a8-8e1d-ee8d65145c41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:02.337697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66d43cc8-426e-44a8-8e1d-ee8d65145c41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:02.338153 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66d43cc8-426e-44a8-8e1d-ee8d65145c41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:02.338939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66d43cc8-426e-44a8-8e1d-ee8d65145c41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:02.339386 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66d43cc8-426e-44a8-8e1d-ee8d65145c41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:02.369653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-66d43cc8-426e-44a8-8e1d-ee8d65145c41 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.047550 Jul 14 15:48:02.370228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 541/1174] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:48:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:48:02.374812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dd24381c-036f-42d5-bb5a-b39fc7b0ebc2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:48:02.375299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dd24381c-036f-42d5-bb5a-b39fc7b0ebc2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:48:02.383350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dd24381c-036f-42d5-bb5a-b39fc7b0ebc2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:02.384140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dd24381c-036f-42d5-bb5a-b39fc7b0ebc2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:02.385416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dd24381c-036f-42d5-bb5a-b39fc7b0ebc2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:48:02.386150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dd24381c-036f-42d5-bb5a-b39fc7b0ebc2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:48:11.979916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=4 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:12.009036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=10 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:12.378936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=12 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:12.407456 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:48:23.805193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:48:23.805887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:48:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:50:00.475954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:50:00.476622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:50:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:50:02.101919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-f38877bf-74fa-42ba-9035-d73ba248a9d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'services' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:50:02.148338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-dd24381c-036f-42d5-bb5a-b39fc7b0ebc2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'services' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:50:08.826536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:50:08.827367 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:50:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:50:12.106698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=4 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:12.152771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=4 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:50:33.317293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:50:33.317840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:50:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:50:51.564003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:50:51.565098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:50:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:51:43.813335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:51:43.813992 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:51:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:52:02.308079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-f38877bf-74fa-42ba-9035-d73ba248a9d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3975f643-37ef-4fad-9375-609158557ac9) Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f38877bf-74fa-42ba-9035-d73ba248a9d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f HTTP/1.1 Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 15:52:02.310241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 15:52:02.312138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:52:02.312138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:52:02.312138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:52:02.312138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:52:02.312138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:52:02.312138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 15:52:02.312138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 15:52:02.312138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 15:52:02.312138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:52:02.312138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3975f643-37ef-4fad-9375-609158557ac9) Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'server_id': 'd4e7b59f-1959-4ed1-ba26-c70f4d9336bb', 'id': 'c8af675f-e8c6-4320-9d18-1156dda9bb6f'} Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:52:02.313252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3975f643-37ef-4fad-9375-609158557ac9) Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:52:02.314763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3975f643-37ef-4fad-9375-609158557ac9) Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:52:02.316212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3975f643-37ef-4fad-9375-609158557ac9) Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:52:02.317440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3975f643-37ef-4fad-9375-609158557ac9) Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3975f643-37ef-4fad-9375-609158557ac9) Jul 14 15:52:02.318999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.320523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f38877bf-74fa-42ba-9035-d73ba248a9d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3975f643-37ef-4fad-9375-609158557ac9) {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:52:02.320523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f38877bf-74fa-42ba-9035-d73ba248a9d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f" status: 400 len: 269 microversion: 2.1 time: 240.340699 Jul 14 15:52:02.320523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:52:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:52:02.320523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:52:02 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (10.222.0.99) Jul 14 15:52:02.320523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: CRITICAL nova [None req-f38877bf-74fa-42ba-9035-d73ba248a9d2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Unhandled error: OSError: write error Jul 14 15:52:02.320523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova OSError: write error Jul 14 15:52:02.320523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova Jul 14 15:52:02.321612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 634/1175] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:48:01 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f => generated 0 bytes in 240342 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:52:02.345598 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-dd24381c-036f-42d5-bb5a-b39fc7b0ebc2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18286483-2465-49a3-a08d-56343f5e2510) Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dd24381c-036f-42d5-bb5a-b39fc7b0ebc2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f HTTP/1.1 Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:52:02.347916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:52:02.349473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:52:02.349473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:52:02.349473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:52:02.349473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:52:02.349473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:52:02.349473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:52:02.349473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:52:02.349473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 15:52:02.349473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:52:02.349473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18286483-2465-49a3-a08d-56343f5e2510) Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'server_id': 'd4e7b59f-1959-4ed1-ba26-c70f4d9336bb', 'id': 'c8af675f-e8c6-4320-9d18-1156dda9bb6f'} Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:52:02.351557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18286483-2465-49a3-a08d-56343f5e2510) Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:52:02.352980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18286483-2465-49a3-a08d-56343f5e2510) Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:52:02.354167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18286483-2465-49a3-a08d-56343f5e2510) Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:52:02.355345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18286483-2465-49a3-a08d-56343f5e2510) Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18286483-2465-49a3-a08d-56343f5e2510) Jul 14 15:52:02.356758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:52:02.357991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dd24381c-036f-42d5-bb5a-b39fc7b0ebc2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-18286483-2465-49a3-a08d-56343f5e2510) {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:52:02.357991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dd24381c-036f-42d5-bb5a-b39fc7b0ebc2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f" status: 400 len: 269 microversion: 2.1 time: 239.978185 Jul 14 15:52:02.357991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 542/1176] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:48:02 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f => generated 269 bytes in 239980 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 15:52:02.466931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c5ff49e6-a7f6-4663-8e15-fbcd07aabdd0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:02.467817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c5ff49e6-a7f6-4663-8e15-fbcd07aabdd0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:02.474969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5ff49e6-a7f6-4663-8e15-fbcd07aabdd0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.475837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5ff49e6-a7f6-4663-8e15-fbcd07aabdd0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.476689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5ff49e6-a7f6-4663-8e15-fbcd07aabdd0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.477038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5ff49e6-a7f6-4663-8e15-fbcd07aabdd0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.505449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-93c2a35a-5b54-4fbb-b76c-2b2ed5a4eae8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:02.506642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-93c2a35a-5b54-4fbb-b76c-2b2ed5a4eae8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:02.513652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93c2a35a-5b54-4fbb-b76c-2b2ed5a4eae8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.514122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93c2a35a-5b54-4fbb-b76c-2b2ed5a4eae8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.514939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93c2a35a-5b54-4fbb-b76c-2b2ed5a4eae8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.515385 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93c2a35a-5b54-4fbb-b76c-2b2ed5a4eae8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.578234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-93c2a35a-5b54-4fbb-b76c-2b2ed5a4eae8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:02.586570 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-93c2a35a-5b54-4fbb-b76c-2b2ed5a4eae8 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.234912 Jul 14 15:52:02.587146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 543/1177] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:02 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:02.591961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ed168656-6557-4e4c-89f5-ed66840f4949 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:02.592944 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ed168656-6557-4e4c-89f5-ed66840f4949 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:02.598744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed168656-6557-4e4c-89f5-ed66840f4949 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.599186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed168656-6557-4e4c-89f5-ed66840f4949 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.600547 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed168656-6557-4e4c-89f5-ed66840f4949 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.601028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed168656-6557-4e4c-89f5-ed66840f4949 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.626364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c5ff49e6-a7f6-4663-8e15-fbcd07aabdd0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:02.631472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ed168656-6557-4e4c-89f5-ed66840f4949 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042623 Jul 14 15:52:02.632291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 544/1178] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:52:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:52:02.635057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c5ff49e6-a7f6-4663-8e15-fbcd07aabdd0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.321028 Jul 14 15:52:02.635633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 635/1179] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:02 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:02.636907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f07feee5-2a33-4e10-830f-99e06c61fec5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:02.637398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f07feee5-2a33-4e10-830f-99e06c61fec5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:02.640324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e7d66148-9e0d-4c4f-a24d-800d76cc81cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:02.640926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e7d66148-9e0d-4c4f-a24d-800d76cc81cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:02.643165 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f07feee5-2a33-4e10-830f-99e06c61fec5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.643651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f07feee5-2a33-4e10-830f-99e06c61fec5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.644421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f07feee5-2a33-4e10-830f-99e06c61fec5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.644865 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f07feee5-2a33-4e10-830f-99e06c61fec5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.647345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e7d66148-9e0d-4c4f-a24d-800d76cc81cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.647817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e7d66148-9e0d-4c4f-a24d-800d76cc81cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.648583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e7d66148-9e0d-4c4f-a24d-800d76cc81cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.649022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e7d66148-9e0d-4c4f-a24d-800d76cc81cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.778709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e7d66148-9e0d-4c4f-a24d-800d76cc81cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:02.786544 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e7d66148-9e0d-4c4f-a24d-800d76cc81cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.149807 Jul 14 15:52:02.787639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 636/1180] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:02 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:02.792384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1427292a-7ccc-4311-b655-fcc9a06d3574 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:02.792989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1427292a-7ccc-4311-b655-fcc9a06d3574 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:02.798482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1427292a-7ccc-4311-b655-fcc9a06d3574 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.798930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1427292a-7ccc-4311-b655-fcc9a06d3574 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.799712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1427292a-7ccc-4311-b655-fcc9a06d3574 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.800150 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1427292a-7ccc-4311-b655-fcc9a06d3574 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.864442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1427292a-7ccc-4311-b655-fcc9a06d3574 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:52:02.872262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1427292a-7ccc-4311-b655-fcc9a06d3574 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.083290 Jul 14 15:52:02.872835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 637/1181] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:52:02 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 15:52:02.877363 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-43f2adfb-4365-4254-b6ce-db4c021f9263 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:02.878343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-43f2adfb-4365-4254-b6ce-db4c021f9263 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:02.884494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-43f2adfb-4365-4254-b6ce-db4c021f9263 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.884943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-43f2adfb-4365-4254-b6ce-db4c021f9263 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.885740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-43f2adfb-4365-4254-b6ce-db4c021f9263 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.886177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-43f2adfb-4365-4254-b6ce-db4c021f9263 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.915323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-43f2adfb-4365-4254-b6ce-db4c021f9263 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041467 Jul 14 15:52:02.915916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 638/1182] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:52:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 15:52:02.920340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9d163f77-4766-439b-8178-0f3a809dbffd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:52:02.920822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9d163f77-4766-439b-8178-0f3a809dbffd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:52:02.926324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d163f77-4766-439b-8178-0f3a809dbffd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.926779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d163f77-4766-439b-8178-0f3a809dbffd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:02.927530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d163f77-4766-439b-8178-0f3a809dbffd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:52:02.928226 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d163f77-4766-439b-8178-0f3a809dbffd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:52:12.641444 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=6 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:12.664058 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=16 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:12.923917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=10 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:52:12.946365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=28 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:53:20.485037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:53:20.485811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:53:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:53:28.835653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:53:28.836243 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:53:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:53:38.874753 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:53:38.875566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:53:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:53:53.325644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:53:53.326196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:53:53 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:54:02.811936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-f07feee5-2a33-4e10-830f-99e06c61fec5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'services' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:54:03.186807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-9d163f77-4766-439b-8178-0f3a809dbffd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'services' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:54:11.573547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:54:11.574620 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:54:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:54:12.816166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=4 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:54:13.191481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=4 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:55:03.821983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:55:03.822679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:55:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:56:03.246832 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-f07feee5-2a33-4e10-830f-99e06c61fec5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54d59f06-4ed1-427f-a750-e36d1ae29a51) Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f07feee5-2a33-4e10-830f-99e06c61fec5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f HTTP/1.1 Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:56:03.249034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:56:03.250455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:56:03.250455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:56:03.250455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:56:03.250455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:56:03.250455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:56:03.250455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:56:03.250455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:56:03.250455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 15:56:03.250455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:56:03.250455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54d59f06-4ed1-427f-a750-e36d1ae29a51) Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'server_id': 'd4e7b59f-1959-4ed1-ba26-c70f4d9336bb', 'id': 'c8af675f-e8c6-4320-9d18-1156dda9bb6f'} Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:56:03.251536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54d59f06-4ed1-427f-a750-e36d1ae29a51) Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:56:03.253619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54d59f06-4ed1-427f-a750-e36d1ae29a51) Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:03.255171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54d59f06-4ed1-427f-a750-e36d1ae29a51) Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:03.256480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54d59f06-4ed1-427f-a750-e36d1ae29a51) Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54d59f06-4ed1-427f-a750-e36d1ae29a51) Jul 14 15:56:03.257857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.259187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f07feee5-2a33-4e10-830f-99e06c61fec5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-54d59f06-4ed1-427f-a750-e36d1ae29a51) {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:03.259187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f07feee5-2a33-4e10-830f-99e06c61fec5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f" status: 400 len: 269 microversion: 2.1 time: 240.617230 Jul 14 15:56:03.259187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:56:03.259187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:03 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (10.222.0.99) Jul 14 15:56:03.259187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-f07feee5-2a33-4e10-830f-99e06c61fec5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Unhandled error: OSError: write error Jul 14 15:56:03.259187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 15:56:03.259187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 15:56:03.259814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 545/1183] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:52:02 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f => generated 0 bytes in 240619 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:56:03.259814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-aef5a2f5-e5c9-43e0-bf78-f03f048fe6ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:03.259814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-aef5a2f5-e5c9-43e0-bf78-f03f048fe6ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:03.265975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aef5a2f5-e5c9-43e0-bf78-f03f048fe6ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.266426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aef5a2f5-e5c9-43e0-bf78-f03f048fe6ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.267213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aef5a2f5-e5c9-43e0-bf78-f03f048fe6ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.267682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aef5a2f5-e5c9-43e0-bf78-f03f048fe6ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.352021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-9d163f77-4766-439b-8178-0f3a809dbffd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e4a0682-d177-4196-a73d-e02d0915d23d) Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9d163f77-4766-439b-8178-0f3a809dbffd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f HTTP/1.1 Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 15:56:03.354865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 15:56:03.356525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:56:03.356525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:56:03.356525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:56:03.356525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:56:03.356525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:56:03.356525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 15:56:03.356525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 15:56:03.356525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 15:56:03.356525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:56:03.356525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e4a0682-d177-4196-a73d-e02d0915d23d) Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'server_id': 'd4e7b59f-1959-4ed1-ba26-c70f4d9336bb', 'id': 'c8af675f-e8c6-4320-9d18-1156dda9bb6f'} Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:56:03.357542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e4a0682-d177-4196-a73d-e02d0915d23d) Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:56:03.358608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e4a0682-d177-4196-a73d-e02d0915d23d) Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:03.361399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e4a0682-d177-4196-a73d-e02d0915d23d) Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:03.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e4a0682-d177-4196-a73d-e02d0915d23d) Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e4a0682-d177-4196-a73d-e02d0915d23d) Jul 14 15:56:03.368378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:56:03.369428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9d163f77-4766-439b-8178-0f3a809dbffd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5e4a0682-d177-4196-a73d-e02d0915d23d) {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:56:03.369428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9d163f77-4766-439b-8178-0f3a809dbffd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f" status: 400 len: 269 microversion: 2.1 time: 240.439654 Jul 14 15:56:03.369428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:56:03.369428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:56:03 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (10.222.0.99) Jul 14 15:56:03.369428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: CRITICAL nova [None req-9d163f77-4766-439b-8178-0f3a809dbffd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Unhandled error: OSError: write error Jul 14 15:56:03.369428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova OSError: write error Jul 14 15:56:03.369428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova Jul 14 15:56:03.369894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 639/1184] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:52:02 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f => generated 0 bytes in 240442 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:56:03.369894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5f8c7072-3c89-40d7-b484-666cfd24cd9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:03.369894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5f8c7072-3c89-40d7-b484-666cfd24cd9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:03.374960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f8c7072-3c89-40d7-b484-666cfd24cd9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.375454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f8c7072-3c89-40d7-b484-666cfd24cd9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.377176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f8c7072-3c89-40d7-b484-666cfd24cd9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.377176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f8c7072-3c89-40d7-b484-666cfd24cd9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.419618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aef5a2f5-e5c9-43e0-bf78-f03f048fe6ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:03.427994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-aef5a2f5-e5c9-43e0-bf78-f03f048fe6ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.174916 Jul 14 15:56:03.428538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (ip 10.222.0.99) !!! Jul 14 15:56:03.428538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:03 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (10.222.0.99) Jul 14 15:56:03.429104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-aef5a2f5-e5c9-43e0-bf78-f03f048fe6ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Unhandled error: OSError: write error Jul 14 15:56:03.429104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 15:56:03.429104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 15:56:03.429369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 546/1185] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:03 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 0 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:56:03.441594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5f8c7072-3c89-40d7-b484-666cfd24cd9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:03.449048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5f8c7072-3c89-40d7-b484-666cfd24cd9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.089147 Jul 14 15:56:03.449539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 (ip 10.222.0.99) !!! Jul 14 15:56:03.449539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:56:03 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 (10.222.0.99) Jul 14 15:56:03.450105 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: CRITICAL nova [None req-5f8c7072-3c89-40d7-b484-666cfd24cd9c tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Unhandled error: OSError: write error Jul 14 15:56:03.450105 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova OSError: write error Jul 14 15:56:03.450105 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova Jul 14 15:56:03.450362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 640/1186] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:03 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 0 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:56:03.455468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3f36ee3a-e2b4-4af8-b8fd-96ef9954fc66 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:03.456070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3f36ee3a-e2b4-4af8-b8fd-96ef9954fc66 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:03.462370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f36ee3a-e2b4-4af8-b8fd-96ef9954fc66 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.462813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f36ee3a-e2b4-4af8-b8fd-96ef9954fc66 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.463804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f36ee3a-e2b4-4af8-b8fd-96ef9954fc66 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.464241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f36ee3a-e2b4-4af8-b8fd-96ef9954fc66 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.606612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0c4b9728-0ec8-482f-ba48-52cda288b270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:03.607578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0c4b9728-0ec8-482f-ba48-52cda288b270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:03.613713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c4b9728-0ec8-482f-ba48-52cda288b270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.614164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c4b9728-0ec8-482f-ba48-52cda288b270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.614920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c4b9728-0ec8-482f-ba48-52cda288b270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.615352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c4b9728-0ec8-482f-ba48-52cda288b270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.647068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0c4b9728-0ec8-482f-ba48-52cda288b270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.216817 Jul 14 15:56:03.647941 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments (ip 10.222.0.99) !!! Jul 14 15:56:03.647941 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:03 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments (10.222.0.99) Jul 14 15:56:03.648528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-0c4b9728-0ec8-482f-ba48-52cda288b270 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Unhandled error: OSError: write error Jul 14 15:56:03.648528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 15:56:03.648528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 15:56:03.648798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 547/1187] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:56:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 0 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:56:03.653024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9b4d25af-55ca-42e8-b3db-339e24151afb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:03.653614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9b4d25af-55ca-42e8-b3db-339e24151afb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:03.660691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b4d25af-55ca-42e8-b3db-339e24151afb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.661160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b4d25af-55ca-42e8-b3db-339e24151afb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.661936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b4d25af-55ca-42e8-b3db-339e24151afb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.662410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b4d25af-55ca-42e8-b3db-339e24151afb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.805334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9b4d25af-55ca-42e8-b3db-339e24151afb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:03.812899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9b4d25af-55ca-42e8-b3db-339e24151afb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.163348 Jul 14 15:56:03.814080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (ip 10.222.0.99) !!! Jul 14 15:56:03.814080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:03 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (10.222.0.99) Jul 14 15:56:03.814735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-9b4d25af-55ca-42e8-b3db-339e24151afb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Unhandled error: OSError: write error Jul 14 15:56:03.814735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 15:56:03.814735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 15:56:03.815011 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 548/1188] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:03 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 0 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:56:03.819319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e43f29c5-3c30-499e-9cfe-3a7a31a96062 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:03.819960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e43f29c5-3c30-499e-9cfe-3a7a31a96062 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:03.825497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e43f29c5-3c30-499e-9cfe-3a7a31a96062 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.825953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e43f29c5-3c30-499e-9cfe-3a7a31a96062 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.826715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e43f29c5-3c30-499e-9cfe-3a7a31a96062 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.827156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e43f29c5-3c30-499e-9cfe-3a7a31a96062 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.896314 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e43f29c5-3c30-499e-9cfe-3a7a31a96062 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a0e4900b6ad24eb19fe169d9c8d8c3a7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '599a768f6b9d4134a4b8e05a7e5f5e87', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:56:03.904098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e43f29c5-3c30-499e-9cfe-3a7a31a96062 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 200 len: 1225 microversion: 2.1 time: 0.088287 Jul 14 15:56:03.904615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 (ip 10.222.0.99) !!! Jul 14 15:56:03.904615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:03 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 (10.222.0.99) Jul 14 15:56:03.905188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-e43f29c5-3c30-499e-9cfe-3a7a31a96062 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Unhandled error: OSError: write error Jul 14 15:56:03.905188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 15:56:03.905188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 15:56:03.905472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 549/1189] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:56:03 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 0 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:56:03.910565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-28c98f96-a443-4506-9706-68932edb8b85 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:03.911517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-28c98f96-a443-4506-9706-68932edb8b85 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:03.917077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-28c98f96-a443-4506-9706-68932edb8b85 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.917532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-28c98f96-a443-4506-9706-68932edb8b85 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.918289 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-28c98f96-a443-4506-9706-68932edb8b85 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.918729 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-28c98f96-a443-4506-9706-68932edb8b85 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.948906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-28c98f96-a443-4506-9706-68932edb8b85 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042594 Jul 14 15:56:03.949423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments (ip 10.222.0.99) !!! Jul 14 15:56:03.949423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:03 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments (10.222.0.99) Jul 14 15:56:03.950053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-28c98f96-a443-4506-9706-68932edb8b85 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Unhandled error: OSError: write error Jul 14 15:56:03.950053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 15:56:03.950053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 15:56:03.950379 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 550/1190] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:56:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:56:03.955914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5d1f6ea9-c41d-417b-854b-7161aaa14972 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:56:03.956406 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5d1f6ea9-c41d-417b-854b-7161aaa14972 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:56:03.962258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d1f6ea9-c41d-417b-854b-7161aaa14972 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.962704 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d1f6ea9-c41d-417b-854b-7161aaa14972 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:03.963462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d1f6ea9-c41d-417b-854b-7161aaa14972 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:56:03.963934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d1f6ea9-c41d-417b-854b-7161aaa14972 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:56:13.459663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=4 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:13.483042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=10 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:13.960337 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=12 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:13.984807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=34 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:56:40.493517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:56:40.494075 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:56:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:56:48.844355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:56:48.844966 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:56:58.883562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:56:58.884211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:56:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:56:59.551924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-3f36ee3a-e2b4-4af8-b8fd-96ef9954fc66 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'services' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:57:09.556591 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=4 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:57:13.333961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:57:13.334523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:57:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:57:31.582303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:57:31.583060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:57:31 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:58:03.435318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-5d1f6ea9-c41d-417b-854b-7161aaa14972 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'services' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:58:03.503919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-3f36ee3a-e2b4-4af8-b8fd-96ef9954fc66 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adc22d5-bdde-4bca-94eb-e07e5df1ba04) Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3f36ee3a-e2b4-4af8-b8fd-96ef9954fc66 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f HTTP/1.1 Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 15:58:03.506086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 15:58:03.507468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:58:03.507468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:58:03.507468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:58:03.507468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:58:03.507468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:58:03.507468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 15:58:03.507468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 15:58:03.507468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 15:58:03.507468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:58:03.507468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adc22d5-bdde-4bca-94eb-e07e5df1ba04) Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'server_id': 'd4e7b59f-1959-4ed1-ba26-c70f4d9336bb', 'id': 'c8af675f-e8c6-4320-9d18-1156dda9bb6f'} Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:58:03.508414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adc22d5-bdde-4bca-94eb-e07e5df1ba04) Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:58:03.512129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adc22d5-bdde-4bca-94eb-e07e5df1ba04) Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:03.513536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adc22d5-bdde-4bca-94eb-e07e5df1ba04) Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:03.514930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adc22d5-bdde-4bca-94eb-e07e5df1ba04) Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adc22d5-bdde-4bca-94eb-e07e5df1ba04) Jul 14 15:58:03.516409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:03.519484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3f36ee3a-e2b4-4af8-b8fd-96ef9954fc66 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-3adc22d5-bdde-4bca-94eb-e07e5df1ba04) {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:58:03.519484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3f36ee3a-e2b4-4af8-b8fd-96ef9954fc66 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f" status: 400 len: 269 microversion: 2.1 time: 120.056371 Jul 14 15:58:03.519484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:58:03.519484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:58:03 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (10.222.0.99) Jul 14 15:58:03.519484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: CRITICAL nova [None req-3f36ee3a-e2b4-4af8-b8fd-96ef9954fc66 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Unhandled error: OSError: write error Jul 14 15:58:03.519484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova OSError: write error Jul 14 15:58:03.519484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova Jul 14 15:58:03.520810 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 641/1191] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:56:03 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f => generated 0 bytes in 120058 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:58:03.660207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ed474812-a225-4dd1-9224-bf8114308573 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:03.660830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ed474812-a225-4dd1-9224-bf8114308573 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:03.667016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ed474812-a225-4dd1-9224-bf8114308573 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.667559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ed474812-a225-4dd1-9224-bf8114308573 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.668432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ed474812-a225-4dd1-9224-bf8114308573 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.668941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ed474812-a225-4dd1-9224-bf8114308573 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.801372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ed474812-a225-4dd1-9224-bf8114308573 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:03.809977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ed474812-a225-4dd1-9224-bf8114308573 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.300419 Jul 14 15:58:03.810497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (ip 10.222.0.99) !!! Jul 14 15:58:03.810497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:58:03 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (10.222.0.99) Jul 14 15:58:03.811072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: CRITICAL nova [None req-ed474812-a225-4dd1-9224-bf8114308573 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Unhandled error: OSError: write error Jul 14 15:58:03.811072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova OSError: write error Jul 14 15:58:03.811072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova Jul 14 15:58:03.811368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 642/1192] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:03 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 0 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:58:03.815704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-850136c8-ba44-4035-bdb8-9431806bd82a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:03.816660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-850136c8-ba44-4035-bdb8-9431806bd82a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:03.822921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-850136c8-ba44-4035-bdb8-9431806bd82a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.823441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-850136c8-ba44-4035-bdb8-9431806bd82a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.824226 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-850136c8-ba44-4035-bdb8-9431806bd82a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.824662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-850136c8-ba44-4035-bdb8-9431806bd82a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.855767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-850136c8-ba44-4035-bdb8-9431806bd82a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043451 Jul 14 15:58:03.856272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:58:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments (ip 10.222.0.99) !!! Jul 14 15:58:03.856272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:58:03 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments (10.222.0.99) Jul 14 15:58:03.856847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: CRITICAL nova [None req-850136c8-ba44-4035-bdb8-9431806bd82a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Unhandled error: OSError: write error Jul 14 15:58:03.856847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova OSError: write error Jul 14 15:58:03.856847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova Jul 14 15:58:03.857105 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 643/1193] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:58:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 0 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:58:03.971870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b357748c-6884-481a-b12a-dff701a538d4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:03.972487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b357748c-6884-481a-b12a-dff701a538d4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:03.980520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b357748c-6884-481a-b12a-dff701a538d4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.980983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b357748c-6884-481a-b12a-dff701a538d4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.981748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b357748c-6884-481a-b12a-dff701a538d4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:03.982196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b357748c-6884-481a-b12a-dff701a538d4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:03.996870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-b357748c-6884-481a-b12a-dff701a538d4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] HTTP exception thrown: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b357748c-6884-481a-b12a-dff701a538d4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Request method failure captured: Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 HTTP/1.1 Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DiYNRhhmKB71Qj0w5c8D6JdKxf-x3FK94lGFmKfAtr01LMY0-XVv6z_pn988VQdnj9C-SNWVqeKCgTZ0OkFUVog5zBMPm3ZTPqKLcFeFjJfhT36aZziFihpHT59bR-Eg-V2etjp-Cw5wFADG381B0Ie_z5TBOtik5jtW3zWGCU_Edk Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 15:58:03.998306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 15:58:03.999967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:58:03.999967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-TestVolumeBootPattern-1564107289 Jul 14 15:58:03.999967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 15:58:03.999967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 15:58:03.999967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-TestVolumeBootPattern-1564107289-project Jul 14 15:58:03.999967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 15:58:03.999967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 15:58:03.999967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: a0e4900b6ad24eb19fe169d9c8d8c3a7 Jul 14 15:58:03.999967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-TestVolumeBootPattern-1564107289-project Jul 14 15:58:03.999967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 15:58:03.999967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 15:58:03.999967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': '7ea27265-d9b4-48a9-80e7-00f4be8ca323'} Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:58:04.000917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 15:58:04.002394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 15:58:04.003890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b357748c-6884-481a-b12a-dff701a538d4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Returning 404 to user: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:58:04.003890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b357748c-6884-481a-b12a-dff701a538d4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 404 len: 111 microversion: 2.1 time: 0.141862 Jul 14 15:58:04.003890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:58:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 (ip 10.222.0.99) !!! Jul 14 15:58:04.003890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 15:58:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 (10.222.0.99) Jul 14 15:58:04.003890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: CRITICAL nova [None req-b357748c-6884-481a-b12a-dff701a538d4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Unhandled error: OSError: write error Jul 14 15:58:04.003890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova OSError: write error Jul 14 15:58:04.003890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova Jul 14 15:58:04.003890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 644/1194] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:03 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 0 bytes in 143 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:58:04.005340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-aaa87c44-bbf5-4c47-8ebc-e31acf307792 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:04.005825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-aaa87c44-bbf5-4c47-8ebc-e31acf307792 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:04.011901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aaa87c44-bbf5-4c47-8ebc-e31acf307792 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:04.012360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aaa87c44-bbf5-4c47-8ebc-e31acf307792 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:04.013118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aaa87c44-bbf5-4c47-8ebc-e31acf307792 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:04.013558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aaa87c44-bbf5-4c47-8ebc-e31acf307792 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:13.439993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=4 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:14.009975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=8 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:14.031527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=18 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:58:23.832274 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 15:58:23.832883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:58:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:58:59.608497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-5d1f6ea9-c41d-417b-854b-7161aaa14972 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227582b-a365-4fba-a79d-cd11bdf37a4e) Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5d1f6ea9-c41d-417b-854b-7161aaa14972 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f HTTP/1.1 Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:58:59.610727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:58:59.612383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:58:59.612383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:58:59.612383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 15:58:59.612383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 15:58:59.612383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:58:59.612383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:58:59.612383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:58:59.612383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 15:58:59.612383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 15:58:59.612383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227582b-a365-4fba-a79d-cd11bdf37a4e) Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'server_id': 'd4e7b59f-1959-4ed1-ba26-c70f4d9336bb', 'id': 'c8af675f-e8c6-4320-9d18-1156dda9bb6f'} Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:58:59.613407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227582b-a365-4fba-a79d-cd11bdf37a4e) Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 15:58:59.614510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227582b-a365-4fba-a79d-cd11bdf37a4e) Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:59.615694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227582b-a365-4fba-a79d-cd11bdf37a4e) Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:59.616765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227582b-a365-4fba-a79d-cd11bdf37a4e) Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227582b-a365-4fba-a79d-cd11bdf37a4e) Jul 14 15:58:59.617895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.618932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5d1f6ea9-c41d-417b-854b-7161aaa14972 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-0227582b-a365-4fba-a79d-cd11bdf37a4e) {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:58:59.618932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5d1f6ea9-c41d-417b-854b-7161aaa14972 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f" status: 400 len: 269 microversion: 2.1 time: 175.661248 Jul 14 15:58:59.618932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:58:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 15:58:59.618932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:58:59 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (10.222.0.99) Jul 14 15:58:59.618932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-5d1f6ea9-c41d-417b-854b-7161aaa14972 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Unhandled error: OSError: write error Jul 14 15:58:59.618932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 15:58:59.618932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 15:58:59.619446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 551/1195] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:56:03 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f => generated 0 bytes in 175663 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:58:59.619446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7c66e2c3-d41c-494a-a715-63dfb09cee33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:59.620131 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7c66e2c3-d41c-494a-a715-63dfb09cee33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:59.626211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c66e2c3-d41c-494a-a715-63dfb09cee33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:59.626667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c66e2c3-d41c-494a-a715-63dfb09cee33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:59.627470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c66e2c3-d41c-494a-a715-63dfb09cee33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:59.627949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c66e2c3-d41c-494a-a715-63dfb09cee33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:59.661224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-aaa87c44-bbf5-4c47-8ebc-e31acf307792 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'services' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 15:58:59.767978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7c66e2c3-d41c-494a-a715-63dfb09cee33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 15:58:59.775383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7c66e2c3-d41c-494a-a715-63dfb09cee33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1567 microversion: 2.1 time: 0.160931 Jul 14 15:58:59.775919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:58:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (ip 10.222.0.99) !!! Jul 14 15:58:59.775919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:58:59 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (10.222.0.99) Jul 14 15:58:59.777115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-7c66e2c3-d41c-494a-a715-63dfb09cee33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Unhandled error: OSError: write error Jul 14 15:58:59.777115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 15:58:59.777115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 15:58:59.777579 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 552/1196] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:59 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 0 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:58:59.782010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b496eb98-bc6b-4b39-a666-b8b373f48eb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:59.782907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b496eb98-bc6b-4b39-a666-b8b373f48eb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:59.788717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b496eb98-bc6b-4b39-a666-b8b373f48eb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:59.789159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b496eb98-bc6b-4b39-a666-b8b373f48eb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:59.789909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b496eb98-bc6b-4b39-a666-b8b373f48eb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:59.790341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b496eb98-bc6b-4b39-a666-b8b373f48eb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:59.820149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b496eb98-bc6b-4b39-a666-b8b373f48eb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041741 Jul 14 15:58:59.820649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:58:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments (ip 10.222.0.99) !!! Jul 14 15:58:59.820649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:58:59 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments (10.222.0.99) Jul 14 15:58:59.821215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-b496eb98-bc6b-4b39-a666-b8b373f48eb1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Unhandled error: OSError: write error Jul 14 15:58:59.821215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 15:58:59.821215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 15:58:59.821476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 553/1197] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 15:58:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 0 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:58:59.826107 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7e703e6-0a10-4851-b187-d00ba8962758 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:59.826704 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d7e703e6-0a10-4851-b187-d00ba8962758 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:59.832213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7e703e6-0a10-4851-b187-d00ba8962758 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:59.832656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7e703e6-0a10-4851-b187-d00ba8962758 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:59.833403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7e703e6-0a10-4851-b187-d00ba8962758 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:59.833834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7e703e6-0a10-4851-b187-d00ba8962758 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:59.848610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-d7e703e6-0a10-4851-b187-d00ba8962758 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] HTTP exception thrown: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7e703e6-0a10-4851-b187-d00ba8962758 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Request method failure captured: Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 HTTP/1.1 Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DiYNRhhmKB71Qj0w5c8D6JdKxf-x3FK94lGFmKfAtr01LMY0-XVv6z_pn988VQdnj9C-SNWVqeKCgTZ0OkFUVog5zBMPm3ZTPqKLcFeFjJfhT36aZziFihpHT59bR-Eg-V2etjp-Cw5wFADG381B0Ie_z5TBOtik5jtW3zWGCU_Edk Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 15:58:59.850096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 15:58:59.851647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 15:58:59.851647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-TestVolumeBootPattern-1564107289 Jul 14 15:58:59.851647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 15:58:59.851647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 15:58:59.851647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-TestVolumeBootPattern-1564107289-project Jul 14 15:58:59.851647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 15:58:59.851647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 15:58:59.851647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: a0e4900b6ad24eb19fe169d9c8d8c3a7 Jul 14 15:58:59.851647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-TestVolumeBootPattern-1564107289-project Jul 14 15:58:59.851647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 15:58:59.851647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 15:58:59.851647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '7ea27265-d9b4-48a9-80e7-00f4be8ca323'} Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 15:58:59.852627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 15:58:59.854075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 15:58:59.855884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7e703e6-0a10-4851-b187-d00ba8962758 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Returning 404 to user: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 15:58:59.855884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d7e703e6-0a10-4851-b187-d00ba8962758 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 404 len: 111 microversion: 2.1 time: 0.029243 Jul 14 15:58:59.855884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:58:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 (ip 10.222.0.99) !!! Jul 14 15:58:59.855884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 15:58:59 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 (10.222.0.99) Jul 14 15:58:59.855884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-d7e703e6-0a10-4851-b187-d00ba8962758 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Unhandled error: OSError: write error Jul 14 15:58:59.855884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 15:58:59.855884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 15:58:59.855884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 554/1198] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 15:58:59 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 0 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jul 14 15:58:59.856943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5faa7bd7-0529-4d38-8bd5-fcfe070673ed tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 15:58:59.857420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5faa7bd7-0529-4d38-8bd5-fcfe070673ed tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 15:58:59.862791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5faa7bd7-0529-4d38-8bd5-fcfe070673ed tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:59.863232 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5faa7bd7-0529-4d38-8bd5-fcfe070673ed tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:58:59.864016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5faa7bd7-0529-4d38-8bd5-fcfe070673ed tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 15:58:59.864453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5faa7bd7-0529-4d38-8bd5-fcfe070673ed tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 15:59:09.665856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=4 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:09.860895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=8 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 15:59:09.882211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=18 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:00.503523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:00:00.504208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:00:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 16:00:03.872461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-aaa87c44-bbf5-4c47-8ebc-e31acf307792 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f242fa55-1275-44e3-9e60-38dd62027a8e) Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-aaa87c44-bbf5-4c47-8ebc-e31acf307792 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f HTTP/1.1 Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:00:03.874685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:00:03.876139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:03.876139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:00:03.876139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 16:00:03.876139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:00:03.876139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 16:00:03.876139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:00:03.876139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:00:03.876139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 16:00:03.876139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 16:00:03.876139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f242fa55-1275-44e3-9e60-38dd62027a8e) Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'server_id': 'd4e7b59f-1959-4ed1-ba26-c70f4d9336bb', 'id': 'c8af675f-e8c6-4320-9d18-1156dda9bb6f'} Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 16:00:03.876789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f242fa55-1275-44e3-9e60-38dd62027a8e) Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:00:03.878080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f242fa55-1275-44e3-9e60-38dd62027a8e) Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:03.880381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f242fa55-1275-44e3-9e60-38dd62027a8e) Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:03.882579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f242fa55-1275-44e3-9e60-38dd62027a8e) Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f242fa55-1275-44e3-9e60-38dd62027a8e) Jul 14 16:00:03.884497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:03.886314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-aaa87c44-bbf5-4c47-8ebc-e31acf307792 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-f242fa55-1275-44e3-9e60-38dd62027a8e) {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:03.886314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-aaa87c44-bbf5-4c47-8ebc-e31acf307792 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f" status: 400 len: 269 microversion: 2.1 time: 119.874799 Jul 14 16:00:03.886314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:00:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 16:00:03.886314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:00:03 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (10.222.0.99) Jul 14 16:00:03.886314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: CRITICAL nova [None req-aaa87c44-bbf5-4c47-8ebc-e31acf307792 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Unhandled error: OSError: write error Jul 14 16:00:03.886314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova OSError: write error Jul 14 16:00:03.886314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova Jul 14 16:00:03.887554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 645/1199] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:58:04 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f => generated 0 bytes in 119876 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 16:00:03.887554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a68de691-d4a8-47e3-9c04-6787c38521b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:03.887554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a68de691-d4a8-47e3-9c04-6787c38521b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:03.893979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a68de691-d4a8-47e3-9c04-6787c38521b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.894415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a68de691-d4a8-47e3-9c04-6787c38521b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.895184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a68de691-d4a8-47e3-9c04-6787c38521b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:03.895666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a68de691-d4a8-47e3-9c04-6787c38521b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:03.977554 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-5faa7bd7-0529-4d38-8bd5-fcfe070673ed tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'services' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:04.049681 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a68de691-d4a8-47e3-9c04-6787c38521b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.057485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a68de691-d4a8-47e3-9c04-6787c38521b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1561 microversion: 2.1 time: 0.178615 Jul 14 16:00:04.058044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (ip 10.222.0.99) !!! Jul 14 16:00:04.058044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:00:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (10.222.0.99) Jul 14 16:00:04.059038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: CRITICAL nova [None req-a68de691-d4a8-47e3-9c04-6787c38521b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Unhandled error: OSError: write error Jul 14 16:00:04.059038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova OSError: write error Jul 14 16:00:04.059038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova Jul 14 16:00:04.059341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 646/1200] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:03 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 0 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 16:00:04.072431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f3308553-e04b-4dac-a231-0b55364530ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.073539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f3308553-e04b-4dac-a231-0b55364530ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.080440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3308553-e04b-4dac-a231-0b55364530ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.080971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3308553-e04b-4dac-a231-0b55364530ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.081862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3308553-e04b-4dac-a231-0b55364530ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.082384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3308553-e04b-4dac-a231-0b55364530ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.103649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-5faa7bd7-0529-4d38-8bd5-fcfe070673ed tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f255987-9848-45a9-b927-b0c3072af671) Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5faa7bd7-0529-4d38-8bd5-fcfe070673ed tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f HTTP/1.1 Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:00:04.106068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:00:04.107458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:04.107458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:00:04.107458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 16:00:04.107458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:00:04.107458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 16:00:04.107458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:00:04.107458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:00:04.107458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 16:00:04.107458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 16:00:04.107458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f255987-9848-45a9-b927-b0c3072af671) Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'server_id': 'd4e7b59f-1959-4ed1-ba26-c70f4d9336bb', 'id': 'c8af675f-e8c6-4320-9d18-1156dda9bb6f'} Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 16:00:04.108149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f255987-9848-45a9-b927-b0c3072af671) Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:00:04.109167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f255987-9848-45a9-b927-b0c3072af671) Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.110277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f255987-9848-45a9-b927-b0c3072af671) Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.111269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f255987-9848-45a9-b927-b0c3072af671) Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f255987-9848-45a9-b927-b0c3072af671) Jul 14 16:00:04.112350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.113392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5faa7bd7-0529-4d38-8bd5-fcfe070673ed tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-7f255987-9848-45a9-b927-b0c3072af671) {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:04.113392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5faa7bd7-0529-4d38-8bd5-fcfe070673ed tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f" status: 400 len: 269 microversion: 2.1 time: 64.254164 Jul 14 16:00:04.113392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 16:00:04.113392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:00:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (10.222.0.99) Jul 14 16:00:04.113392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-5faa7bd7-0529-4d38-8bd5-fcfe070673ed tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Unhandled error: OSError: write error Jul 14 16:00:04.113392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 16:00:04.113392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 16:00:04.113868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 555/1201] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 15:58:59 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f => generated 0 bytes in 64256 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 16:00:04.114234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6a17c7a9-0321-4e1b-a05c-b0d9d7656a3d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.115244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f3308553-e04b-4dac-a231-0b55364530ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054065 Jul 14 16:00:04.115244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments (ip 10.222.0.99) !!! Jul 14 16:00:04.115244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:00:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments (10.222.0.99) Jul 14 16:00:04.115759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6a17c7a9-0321-4e1b-a05c-b0d9d7656a3d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.115853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: CRITICAL nova [None req-f3308553-e04b-4dac-a231-0b55364530ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Unhandled error: OSError: write error Jul 14 16:00:04.115853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova OSError: write error Jul 14 16:00:04.115853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova Jul 14 16:00:04.115853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 647/1202] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 0 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 16:00:04.120645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-858a7838-f1c6-46cc-a143-67e227e7d749 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.121122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a17c7a9-0321-4e1b-a05c-b0d9d7656a3d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.121277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-858a7838-f1c6-46cc-a143-67e227e7d749 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.121579 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a17c7a9-0321-4e1b-a05c-b0d9d7656a3d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.122355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a17c7a9-0321-4e1b-a05c-b0d9d7656a3d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.122800 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a17c7a9-0321-4e1b-a05c-b0d9d7656a3d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.127204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-858a7838-f1c6-46cc-a143-67e227e7d749 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.127938 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-858a7838-f1c6-46cc-a143-67e227e7d749 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.128580 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-858a7838-f1c6-46cc-a143-67e227e7d749 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.129027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-858a7838-f1c6-46cc-a143-67e227e7d749 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.139728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-6a17c7a9-0321-4e1b-a05c-b0d9d7656a3d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] HTTP exception thrown: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6a17c7a9-0321-4e1b-a05c-b0d9d7656a3d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Request method failure captured: Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 HTTP/1.1 Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DiYNRhhmKB71Qj0w5c8D6JdKxf-x3FK94lGFmKfAtr01LMY0-XVv6z_pn988VQdnj9C-SNWVqeKCgTZ0OkFUVog5zBMPm3ZTPqKLcFeFjJfhT36aZziFihpHT59bR-Eg-V2etjp-Cw5wFADG381B0Ie_z5TBOtik5jtW3zWGCU_Edk Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:00:04.141895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:00:04.143730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:04.143730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:04.143730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:04.143730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:04.143730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:04.143730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:00:04.143730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:00:04.143730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: a0e4900b6ad24eb19fe169d9c8d8c3a7 Jul 14 16:00:04.143730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:04.143730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:00:04.143730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.143730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '7ea27265-d9b4-48a9-80e7-00f4be8ca323'} Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:04.144653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.146090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.147452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6a17c7a9-0321-4e1b-a05c-b0d9d7656a3d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Returning 404 to user: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:04.147452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6a17c7a9-0321-4e1b-a05c-b0d9d7656a3d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 404 len: 111 microversion: 2.1 time: 0.033483 Jul 14 16:00:04.147452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 (ip 10.222.0.99) !!! Jul 14 16:00:04.147452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:00:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 (10.222.0.99) Jul 14 16:00:04.147452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-6a17c7a9-0321-4e1b-a05c-b0d9d7656a3d tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Unhandled error: OSError: write error Jul 14 16:00:04.147452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 16:00:04.147452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 16:00:04.147452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 556/1203] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 0 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jul 14 16:00:04.149639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4e9c34ef-24d8-4339-ba89-ba9c0233b494 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.149785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4e9c34ef-24d8-4339-ba89-ba9c0233b494 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.156387 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e9c34ef-24d8-4339-ba89-ba9c0233b494 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.156832 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e9c34ef-24d8-4339-ba89-ba9c0233b494 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.157591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e9c34ef-24d8-4339-ba89-ba9c0233b494 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.158023 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e9c34ef-24d8-4339-ba89-ba9c0233b494 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.221597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-858a7838-f1c6-46cc-a143-67e227e7d749 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'services' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:04.285328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-858a7838-f1c6-46cc-a143-67e227e7d749 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-34be847d-1ca7-46b5-a1ae-18e2a218e7c1) Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-858a7838-f1c6-46cc-a143-67e227e7d749 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f HTTP/1.1 Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:00:04.287881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:00:04.289432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:04.289432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:00:04.289432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 16:00:04.289432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:00:04.289432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 16:00:04.289432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:00:04.289432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:00:04.289432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 16:00:04.289432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 16:00:04.289432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-34be847d-1ca7-46b5-a1ae-18e2a218e7c1) Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'server_id': 'd4e7b59f-1959-4ed1-ba26-c70f4d9336bb', 'id': 'c8af675f-e8c6-4320-9d18-1156dda9bb6f'} Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 16:00:04.290210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-34be847d-1ca7-46b5-a1ae-18e2a218e7c1) Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:00:04.291335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-34be847d-1ca7-46b5-a1ae-18e2a218e7c1) Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.293314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-34be847d-1ca7-46b5-a1ae-18e2a218e7c1) Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.294455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-34be847d-1ca7-46b5-a1ae-18e2a218e7c1) Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-34be847d-1ca7-46b5-a1ae-18e2a218e7c1) Jul 14 16:00:04.295740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.296782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-858a7838-f1c6-46cc-a143-67e227e7d749 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-34be847d-1ca7-46b5-a1ae-18e2a218e7c1) {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:04.296782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-858a7838-f1c6-46cc-a143-67e227e7d749 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f" status: 400 len: 269 microversion: 2.1 time: 0.172917 Jul 14 16:00:04.296782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (ip 10.222.0.99) !!! Jul 14 16:00:04.296782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:00:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f (10.222.0.99) Jul 14 16:00:04.296782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: CRITICAL nova [None req-858a7838-f1c6-46cc-a143-67e227e7d749 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Unhandled error: OSError: write error Jul 14 16:00:04.296782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova OSError: write error Jul 14 16:00:04.296782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova Jul 14 16:00:04.297268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 648/1204] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 16:00:04 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments/c8af675f-e8c6-4320-9d18-1156dda9bb6f => generated 0 bytes in 174 msecs (HTTP/1.1 400) 9 headers in 0 bytes (0 switches on core 0) Jul 14 16:00:04.297268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fb68324f-aaeb-4518-85f1-21787fdf945c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.297825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fb68324f-aaeb-4518-85f1-21787fdf945c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.304479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb68324f-aaeb-4518-85f1-21787fdf945c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.304987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb68324f-aaeb-4518-85f1-21787fdf945c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.305698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb68324f-aaeb-4518-85f1-21787fdf945c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.306144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb68324f-aaeb-4518-85f1-21787fdf945c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.307526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4e9c34ef-24d8-4339-ba89-ba9c0233b494 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.315681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4e9c34ef-24d8-4339-ba89-ba9c0233b494 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1561 microversion: 2.1 time: 0.169965 Jul 14 16:00:04.316245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (ip 10.222.0.99) !!! Jul 14 16:00:04.316245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:00:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (10.222.0.99) Jul 14 16:00:04.316859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-4e9c34ef-24d8-4339-ba89-ba9c0233b494 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Unhandled error: OSError: write error Jul 14 16:00:04.316859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 16:00:04.316859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 16:00:04.317292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 557/1205] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 0 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 16:00:04.321483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4bd29c42-f6a4-453b-b989-4100c175afe4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.322095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4bd29c42-f6a4-453b-b989-4100c175afe4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.328639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4bd29c42-f6a4-453b-b989-4100c175afe4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.329407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4bd29c42-f6a4-453b-b989-4100c175afe4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.330198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4bd29c42-f6a4-453b-b989-4100c175afe4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.330640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4bd29c42-f6a4-453b-b989-4100c175afe4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.337585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fb68324f-aaeb-4518-85f1-21787fdf945c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046121 Jul 14 16:00:04.338254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments (ip 10.222.0.99) !!! Jul 14 16:00:04.338254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:00:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments (10.222.0.99) Jul 14 16:00:04.338991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: CRITICAL nova [None req-fb68324f-aaeb-4518-85f1-21787fdf945c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Unhandled error: OSError: write error Jul 14 16:00:04.338991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova OSError: write error Jul 14 16:00:04.338991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova Jul 14 16:00:04.339883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 649/1206] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 0 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 0 bytes (0 switches on core 0) Jul 14 16:00:04.344657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-818c8de4-869f-4510-8297-35ebac9b3588 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.344816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-4bd29c42-f6a4-453b-b989-4100c175afe4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] HTTP exception thrown: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.345713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-818c8de4-869f-4510-8297-35ebac9b3588 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4bd29c42-f6a4-453b-b989-4100c175afe4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Request method failure captured: Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 HTTP/1.1 Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DiYNRhhmKB71Qj0w5c8D6JdKxf-x3FK94lGFmKfAtr01LMY0-XVv6z_pn988VQdnj9C-SNWVqeKCgTZ0OkFUVog5zBMPm3ZTPqKLcFeFjJfhT36aZziFihpHT59bR-Eg-V2etjp-Cw5wFADG381B0Ie_z5TBOtik5jtW3zWGCU_Edk Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:00:04.346317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:00:04.347843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:04.347843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:04.347843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:04.347843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:04.347843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:04.347843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:00:04.347843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:00:04.347843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: a0e4900b6ad24eb19fe169d9c8d8c3a7 Jul 14 16:00:04.347843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:04.347843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:00:04.347843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.347843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '7ea27265-d9b4-48a9-80e7-00f4be8ca323'} Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:04.348733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.350147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.351443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4bd29c42-f6a4-453b-b989-4100c175afe4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Returning 404 to user: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:04.351443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4bd29c42-f6a4-453b-b989-4100c175afe4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 404 len: 111 microversion: 2.1 time: 0.029817 Jul 14 16:00:04.351443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:00:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 (ip 10.222.0.99) !!! Jul 14 16:00:04.351443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:00:04 2022 - uwsgi_response_writev_headers_and_body_do(): Broken pipe [core/writer.c line 306] during GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 (10.222.0.99) Jul 14 16:00:04.351443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: CRITICAL nova [None req-4bd29c42-f6a4-453b-b989-4100c175afe4 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Unhandled error: OSError: write error Jul 14 16:00:04.351443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova OSError: write error Jul 14 16:00:04.351443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova Jul 14 16:00:04.351443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 558/1207] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 0 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 0 bytes (0 switches on core 0) Jul 14 16:00:04.353305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-739edc45-e9cb-4b05-b428-52c0339d09f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.353915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-739edc45-e9cb-4b05-b428-52c0339d09f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.357915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-818c8de4-869f-4510-8297-35ebac9b3588 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.358369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-818c8de4-869f-4510-8297-35ebac9b3588 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.359172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-818c8de4-869f-4510-8297-35ebac9b3588 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.359636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-818c8de4-869f-4510-8297-35ebac9b3588 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.360961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-739edc45-e9cb-4b05-b428-52c0339d09f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.361421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-739edc45-e9cb-4b05-b428-52c0339d09f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.362203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-739edc45-e9cb-4b05-b428-52c0339d09f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.362646 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-739edc45-e9cb-4b05-b428-52c0339d09f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.390158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-818c8de4-869f-4510-8297-35ebac9b3588 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049106 Jul 14 16:00:04.390853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 650/1208] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:04.395640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2f0017e6-178b-4e65-a11c-9317d0ef184e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.396580 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2f0017e6-178b-4e65-a11c-9317d0ef184e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.403698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f0017e6-178b-4e65-a11c-9317d0ef184e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.404115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f0017e6-178b-4e65-a11c-9317d0ef184e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.404879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f0017e6-178b-4e65-a11c-9317d0ef184e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.405533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f0017e6-178b-4e65-a11c-9317d0ef184e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.435901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2f0017e6-178b-4e65-a11c-9317d0ef184e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.043926 Jul 14 16:00:04.436496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 651/1209] 10.222.0.99 () {60 vars in 1342 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:00:04.441067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6ee2906f-b69d-41cb-84a9-fa37d3bb1bcc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.441682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6ee2906f-b69d-41cb-84a9-fa37d3bb1bcc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.447718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6ee2906f-b69d-41cb-84a9-fa37d3bb1bcc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.448279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6ee2906f-b69d-41cb-84a9-fa37d3bb1bcc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.449152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6ee2906f-b69d-41cb-84a9-fa37d3bb1bcc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.449542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6ee2906f-b69d-41cb-84a9-fa37d3bb1bcc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.463202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-6ee2906f-b69d-41cb-84a9-fa37d3bb1bcc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] HTTP exception thrown: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6ee2906f-b69d-41cb-84a9-fa37d3bb1bcc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Request method failure captured: Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 HTTP/1.1 Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DiYNRhhmKB71Qj0w5c8D6JdKxf-x3FK94lGFmKfAtr01LMY0-XVv6z_pn988VQdnj9C-SNWVqeKCgTZ0OkFUVog5zBMPm3ZTPqKLcFeFjJfhT36aZziFihpHT59bR-Eg-V2etjp-Cw5wFADG381B0Ie_z5TBOtik5jtW3zWGCU_Edk Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:00:04.465520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:00:04.468667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:04.468667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:04.468667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:04.468667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:04.468667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:04.468667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:00:04.468667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:00:04.468667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: a0e4900b6ad24eb19fe169d9c8d8c3a7 Jul 14 16:00:04.468667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:04.468667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:00:04.468667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.468667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': '7ea27265-d9b4-48a9-80e7-00f4be8ca323'} Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:04.470238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.473657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.475705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6ee2906f-b69d-41cb-84a9-fa37d3bb1bcc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Returning 404 to user: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:04.475705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6ee2906f-b69d-41cb-84a9-fa37d3bb1bcc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 404 len: 111 microversion: 2.1 time: 0.029493 Jul 14 16:00:04.475705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 652/1210] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:04.507516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-739edc45-e9cb-4b05-b428-52c0339d09f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:04.515653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-739edc45-e9cb-4b05-b428-52c0339d09f1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1561 microversion: 2.1 time: 0.165688 Jul 14 16:00:04.516563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 559/1211] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1561 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:04.521171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1f04883f-7f9a-4785-9fc8-4cedd6ebc601 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.522169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1f04883f-7f9a-4785-9fc8-4cedd6ebc601 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.528691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f04883f-7f9a-4785-9fc8-4cedd6ebc601 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.529148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f04883f-7f9a-4785-9fc8-4cedd6ebc601 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.529925 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f04883f-7f9a-4785-9fc8-4cedd6ebc601 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.530373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f04883f-7f9a-4785-9fc8-4cedd6ebc601 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.544425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d9a9f0f8-562a-4977-9fc9-f094cae76445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.545002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d9a9f0f8-562a-4977-9fc9-f094cae76445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.551139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d9a9f0f8-562a-4977-9fc9-f094cae76445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.551700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d9a9f0f8-562a-4977-9fc9-f094cae76445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.552543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d9a9f0f8-562a-4977-9fc9-f094cae76445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.553052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d9a9f0f8-562a-4977-9fc9-f094cae76445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.561792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1f04883f-7f9a-4785-9fc8-4cedd6ebc601 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044161 Jul 14 16:00:04.562376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 560/1212] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:04.567110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-01b7c529-0e8c-4f5d-8271-58c4c1622a33 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.567624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-01b7c529-0e8c-4f5d-8271-58c4c1622a33 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.573574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01b7c529-0e8c-4f5d-8271-58c4c1622a33 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.574034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01b7c529-0e8c-4f5d-8271-58c4c1622a33 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.574802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01b7c529-0e8c-4f5d-8271-58c4c1622a33 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.575244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01b7c529-0e8c-4f5d-8271-58c4c1622a33 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.589011 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-01b7c529-0e8c-4f5d-8271-58c4c1622a33 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] HTTP exception thrown: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-01b7c529-0e8c-4f5d-8271-58c4c1622a33 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Request method failure captured: Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 HTTP/1.1 Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DiYNRhhmKB71Qj0w5c8D6JdKxf-x3FK94lGFmKfAtr01LMY0-XVv6z_pn988VQdnj9C-SNWVqeKCgTZ0OkFUVog5zBMPm3ZTPqKLcFeFjJfhT36aZziFihpHT59bR-Eg-V2etjp-Cw5wFADG381B0Ie_z5TBOtik5jtW3zWGCU_Edk Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:00:04.591228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:00:04.592754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:04.592754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:04.592754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:04.592754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:04.592754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:04.592754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:00:04.592754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:00:04.592754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: a0e4900b6ad24eb19fe169d9c8d8c3a7 Jul 14 16:00:04.592754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:04.592754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:00:04.592754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.592754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '7ea27265-d9b4-48a9-80e7-00f4be8ca323'} Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:04.593605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:04.594792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.596399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-01b7c529-0e8c-4f5d-8271-58c4c1622a33 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Returning 404 to user: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:04.596399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-01b7c529-0e8c-4f5d-8271-58c4c1622a33 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 404 len: 111 microversion: 2.1 time: 0.029062 Jul 14 16:00:04.596399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 561/1213] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:00:04 2022] DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:04.598202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-78d80c90-8a2c-41fc-9953-3875dff5a862 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.598706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-78d80c90-8a2c-41fc-9953-3875dff5a862 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.604839 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78d80c90-8a2c-41fc-9953-3875dff5a862 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.605916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78d80c90-8a2c-41fc-9953-3875dff5a862 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.606697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78d80c90-8a2c-41fc-9953-3875dff5a862 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.607136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78d80c90-8a2c-41fc-9953-3875dff5a862 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.634025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-78d80c90-8a2c-41fc-9953-3875dff5a862 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:00:04.645694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-d9a9f0f8-562a-4977-9fc9-f094cae76445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lazy-loading 'services' on Instance uuid 58c05da0-6e6d-422a-b119-197a7a41a2b9 {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:04.696681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR oslo.messaging._drivers.impl_rabbit [None req-78d80c90-8a2c-41fc-9953-3875dff5a862 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [b48851c6-dbfd-41b0-8993-0bb7cc36d21b] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 16:00:04.729004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d9a9f0f8-562a-4977-9fc9-f094cae76445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments/bd59aa1e-6759-47fa-bf04-eaa6bc8732fb" status: 202 len: 0 microversion: 2.1 time: 0.259835 Jul 14 16:00:04.729660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 653/1214] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 16:00:04 2022] DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments/bd59aa1e-6759-47fa-bf04-eaa6bc8732fb => generated 0 bytes in 261 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:00:04.791160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-6c0ba847-cfab-4d53-a8c9-f7c50f48e70b req-7a3418e2-3dbd-4a65-9c43-ac777a0c4911 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fde2fb02-e844-471d-b2bc-81fc89534875", "tag": "fed6f852-a2ff-4105-8fe1-d37f2cf9b9cd"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:04.800819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-6c0ba847-cfab-4d53-a8c9-f7c50f48e70b req-7a3418e2-3dbd-4a65-9c43-ac777a0c4911 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.801265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-6c0ba847-cfab-4d53-a8c9-f7c50f48e70b req-7a3418e2-3dbd-4a65-9c43-ac777a0c4911 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.814402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-6c0ba847-cfab-4d53-a8c9-f7c50f48e70b req-7a3418e2-3dbd-4a65-9c43-ac777a0c4911 service nova] Creating event network-changed:fed6f852-a2ff-4105-8fe1-d37f2cf9b9cd for instance fde2fb02-e844-471d-b2bc-81fc89534875 on hv-cinder-82651 Jul 14 16:00:04.819508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-6c0ba847-cfab-4d53-a8c9-f7c50f48e70b req-7a3418e2-3dbd-4a65-9c43-ac777a0c4911 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088480 Jul 14 16:00:04.820362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 654/1215] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:04.826430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c6d47a87-270d-4b58-a3ea-4e2ab099a6a9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.827001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c6d47a87-270d-4b58-a3ea-4e2ab099a6a9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:04.833541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c6d47a87-270d-4b58-a3ea-4e2ab099a6a9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.833993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c6d47a87-270d-4b58-a3ea-4e2ab099a6a9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.834771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c6d47a87-270d-4b58-a3ea-4e2ab099a6a9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:04.835717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c6d47a87-270d-4b58-a3ea-4e2ab099a6a9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:04.923752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-c6d47a87-270d-4b58-a3ea-4e2ab099a6a9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lazy-loading 'services' on Instance uuid 58c05da0-6e6d-422a-b119-197a7a41a2b9 {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:04.987226 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-c6d47a87-270d-4b58-a3ea-4e2ab099a6a9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-504d0c92-52e9-4de2-971d-0ba89e29a427) Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c6d47a87-270d-4b58-a3ea-4e2ab099a6a9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Request method failure captured: Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments/bd59aa1e-6759-47fa-bf04-eaa6bc8732fb HTTP/1.1 Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0Dh-OnjgsX7oqQQNhgIDd2Id9QBoxzEw71St--jFuY59_FWrT8o0xifBEAh4tiT9uEN6NKtRvZKVFa8ijs9mZVlsB_oya6bTxN09k3urFjY_khy9Z2f6PkYlx_yNfc1Fu9ml67Wtce0XZUA7bHhQeOSF4Y9w3ufMuC-4_1jHFDTjD2k Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 858bb49b6e1e48568e2055eacc1ee7e5 Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2074780834 Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:00:04.989593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:00:04.991255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:04.991255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-VolumesSnapshotTestJSON-2074780834 Jul 14 16:00:04.991255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 858bb49b6e1e48568e2055eacc1ee7e5 Jul 14 16:00:04.991255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2074780834 Jul 14 16:00:04.991255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-VolumesSnapshotTestJSON-2074780834-project Jul 14 16:00:04.991255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:00:04.991255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:00:04.991255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 71bc270c6253426baa4f79638d466b20 Jul 14 16:00:04.991255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-VolumesSnapshotTestJSON-2074780834-project Jul 14 16:00:04.991255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-504d0c92-52e9-4de2-971d-0ba89e29a427) Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'server_id': '58c05da0-6e6d-422a-b119-197a7a41a2b9', 'id': 'bd59aa1e-6759-47fa-bf04-eaa6bc8732fb'} Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 16:00:04.992091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-504d0c92-52e9-4de2-971d-0ba89e29a427) Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:00:04.993345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-504d0c92-52e9-4de2-971d-0ba89e29a427) Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.994623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-504d0c92-52e9-4de2-971d-0ba89e29a427) Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.996781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-504d0c92-52e9-4de2-971d-0ba89e29a427) Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-504d0c92-52e9-4de2-971d-0ba89e29a427) Jul 14 16:00:04.998093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:04.999364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c6d47a87-270d-4b58-a3ea-4e2ab099a6a9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-504d0c92-52e9-4de2-971d-0ba89e29a427) {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:04.999364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c6d47a87-270d-4b58-a3ea-4e2ab099a6a9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments/bd59aa1e-6759-47fa-bf04-eaa6bc8732fb" status: 400 len: 269 microversion: 2.1 time: 0.169686 Jul 14 16:00:04.999364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 655/1216] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 16:00:04 2022] DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments/bd59aa1e-6759-47fa-bf04-eaa6bc8732fb => generated 269 bytes in 171 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:00:04.999364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-678d426f-8047-459c-8f1e-8e76ffd58d8c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:04.999778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-678d426f-8047-459c-8f1e-8e76ffd58d8c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.004721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-678d426f-8047-459c-8f1e-8e76ffd58d8c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.005202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-678d426f-8047-459c-8f1e-8e76ffd58d8c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.005975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-678d426f-8047-459c-8f1e-8e76ffd58d8c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.006439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-678d426f-8047-459c-8f1e-8e76ffd58d8c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.040015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-678d426f-8047-459c-8f1e-8e76ffd58d8c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044156 Jul 14 16:00:05.040015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 656/1217] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:04 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:05.042301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f83f0aa9-607c-434d-86d9-5e8364ec8587 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.043360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f83f0aa9-607c-434d-86d9-5e8364ec8587 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.049415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f83f0aa9-607c-434d-86d9-5e8364ec8587 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.049862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f83f0aa9-607c-434d-86d9-5e8364ec8587 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.050667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f83f0aa9-607c-434d-86d9-5e8364ec8587 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.051105 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f83f0aa9-607c-434d-86d9-5e8364ec8587 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.068043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-f83f0aa9-607c-434d-86d9-5e8364ec8587 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] HTTP exception thrown: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f83f0aa9-607c-434d-86d9-5e8364ec8587 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Request method failure captured: Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 HTTP/1.1 Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DiYNRhhmKB71Qj0w5c8D6JdKxf-x3FK94lGFmKfAtr01LMY0-XVv6z_pn988VQdnj9C-SNWVqeKCgTZ0OkFUVog5zBMPm3ZTPqKLcFeFjJfhT36aZziFihpHT59bR-Eg-V2etjp-Cw5wFADG381B0Ie_z5TBOtik5jtW3zWGCU_Edk Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:00:05.070634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:00:05.072019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:05.072019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:05.072019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:05.072019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:05.072019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:05.072019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:00:05.072019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:00:05.072019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: a0e4900b6ad24eb19fe169d9c8d8c3a7 Jul 14 16:00:05.072019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:05.072019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:00:05.072019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.072019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': '7ea27265-d9b4-48a9-80e7-00f4be8ca323'} Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:05.072864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.074091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.075301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f83f0aa9-607c-434d-86d9-5e8364ec8587 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Returning 404 to user: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:05.075301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f83f0aa9-607c-434d-86d9-5e8364ec8587 tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 404 len: 111 microversion: 2.1 time: 0.033015 Jul 14 16:00:05.075301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 657/1218] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:00:05 2022] DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:05.080522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-30347fd4-c600-4c7b-978e-4d602aff8aa4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.080923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-30347fd4-c600-4c7b-978e-4d602aff8aa4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.090909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30347fd4-c600-4c7b-978e-4d602aff8aa4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.091373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30347fd4-c600-4c7b-978e-4d602aff8aa4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.092187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30347fd4-c600-4c7b-978e-4d602aff8aa4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.092629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30347fd4-c600-4c7b-978e-4d602aff8aa4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.133660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-30347fd4-c600-4c7b-978e-4d602aff8aa4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Going to try to terminate instance {{(pid=124503) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:00:05.182022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.compute.api [None req-30347fd4-c600-4c7b-978e-4d602aff8aa4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Instance is already in deleting state, ignoring this request Jul 14 16:00:05.182863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-30347fd4-c600-4c7b-978e-4d602aff8aa4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "DELETE /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 204 len: 0 microversion: 2.1 time: 0.109735 Jul 14 16:00:05.183811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 658/1219] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:00:05 2022] DELETE /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:00:05.261882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1af14a80-de2b-4163-aa9e-3e32207df629 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.263019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1af14a80-de2b-4163-aa9e-3e32207df629 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.269126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1af14a80-de2b-4163-aa9e-3e32207df629 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.269602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1af14a80-de2b-4163-aa9e-3e32207df629 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.270362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1af14a80-de2b-4163-aa9e-3e32207df629 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.270811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1af14a80-de2b-4163-aa9e-3e32207df629 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.303367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1af14a80-de2b-4163-aa9e-3e32207df629 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.118490 Jul 14 16:00:05.303974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 659/1220] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:05.309363 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c4abf802-ba4d-4735-bfb7-16eb19cfbf30 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.309860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c4abf802-ba4d-4735-bfb7-16eb19cfbf30 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.316037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4abf802-ba4d-4735-bfb7-16eb19cfbf30 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.316493 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4abf802-ba4d-4735-bfb7-16eb19cfbf30 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.317269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4abf802-ba4d-4735-bfb7-16eb19cfbf30 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.317707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4abf802-ba4d-4735-bfb7-16eb19cfbf30 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.409811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-c4abf802-ba4d-4735-bfb7-16eb19cfbf30 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lazy-loading 'services' on Instance uuid 58c05da0-6e6d-422a-b119-197a7a41a2b9 {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:05.469276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-c4abf802-ba4d-4735-bfb7-16eb19cfbf30 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfe8e0fd-f51f-48b7-90c3-1614feb1b49e) Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c4abf802-ba4d-4735-bfb7-16eb19cfbf30 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Request method failure captured: Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments/bd59aa1e-6759-47fa-bf04-eaa6bc8732fb HTTP/1.1 Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0Dh-OnjgsX7oqQQNhgIDd2Id9QBoxzEw71St--jFuY59_FWrT8o0xifBEAh4tiT9uEN6NKtRvZKVFa8ijs9mZVlsB_oya6bTxN09k3urFjY_khy9Z2f6PkYlx_yNfc1Fu9ml67Wtce0XZUA7bHhQeOSF4Y9w3ufMuC-4_1jHFDTjD2k Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 858bb49b6e1e48568e2055eacc1ee7e5 Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2074780834 Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:00:05.471694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:00:05.473364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:05.473364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-VolumesSnapshotTestJSON-2074780834 Jul 14 16:00:05.473364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 858bb49b6e1e48568e2055eacc1ee7e5 Jul 14 16:00:05.473364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2074780834 Jul 14 16:00:05.473364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-VolumesSnapshotTestJSON-2074780834-project Jul 14 16:00:05.473364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:00:05.473364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:00:05.473364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 71bc270c6253426baa4f79638d466b20 Jul 14 16:00:05.473364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-VolumesSnapshotTestJSON-2074780834-project Jul 14 16:00:05.473364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfe8e0fd-f51f-48b7-90c3-1614feb1b49e) Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'server_id': '58c05da0-6e6d-422a-b119-197a7a41a2b9', 'id': 'bd59aa1e-6759-47fa-bf04-eaa6bc8732fb'} Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 16:00:05.474286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfe8e0fd-f51f-48b7-90c3-1614feb1b49e) Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:00:05.475569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfe8e0fd-f51f-48b7-90c3-1614feb1b49e) Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.476973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfe8e0fd-f51f-48b7-90c3-1614feb1b49e) Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:05.478235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfe8e0fd-f51f-48b7-90c3-1614feb1b49e) Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfe8e0fd-f51f-48b7-90c3-1614feb1b49e) Jul 14 16:00:05.479546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.481130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c4abf802-ba4d-4735-bfb7-16eb19cfbf30 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-bfe8e0fd-f51f-48b7-90c3-1614feb1b49e) {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:05.481130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c4abf802-ba4d-4735-bfb7-16eb19cfbf30 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments/bd59aa1e-6759-47fa-bf04-eaa6bc8732fb" status: 400 len: 269 microversion: 2.1 time: 0.168282 Jul 14 16:00:05.481130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 660/1221] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 16:00:05 2022] DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments/bd59aa1e-6759-47fa-bf04-eaa6bc8732fb => generated 269 bytes in 169 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:00:05.481130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-84b19d4f-5f50-4e16-9147-f6e602ecb2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.481650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-84b19d4f-5f50-4e16-9147-f6e602ecb2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.486829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84b19d4f-5f50-4e16-9147-f6e602ecb2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.487314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84b19d4f-5f50-4e16-9147-f6e602ecb2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.488128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84b19d4f-5f50-4e16-9147-f6e602ecb2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.488569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84b19d4f-5f50-4e16-9147-f6e602ecb2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.505979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=1,nova_cell1:UPDATE=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:05.523183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-84b19d4f-5f50-4e16-9147-f6e602ecb2fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048043 Jul 14 16:00:05.523712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 661/1222] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:05.528888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b58d9dae-3636-4ab3-ba1d-1f4f1cfd458b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.529380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b58d9dae-3636-4ab3-ba1d-1f4f1cfd458b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.535865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b58d9dae-3636-4ab3-ba1d-1f4f1cfd458b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.536322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b58d9dae-3636-4ab3-ba1d-1f4f1cfd458b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.537088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b58d9dae-3636-4ab3-ba1d-1f4f1cfd458b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.537526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b58d9dae-3636-4ab3-ba1d-1f4f1cfd458b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.551143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-b58d9dae-3636-4ab3-ba1d-1f4f1cfd458b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] HTTP exception thrown: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b58d9dae-3636-4ab3-ba1d-1f4f1cfd458b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Request method failure captured: Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 HTTP/1.1 Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DiYNRhhmKB71Qj0w5c8D6JdKxf-x3FK94lGFmKfAtr01LMY0-XVv6z_pn988VQdnj9C-SNWVqeKCgTZ0OkFUVog5zBMPm3ZTPqKLcFeFjJfhT36aZziFihpHT59bR-Eg-V2etjp-Cw5wFADG381B0Ie_z5TBOtik5jtW3zWGCU_Edk Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:00:05.552717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:00:05.554265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:05.554265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:05.554265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:05.554265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:05.554265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:05.554265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:00:05.554265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:00:05.554265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: a0e4900b6ad24eb19fe169d9c8d8c3a7 Jul 14 16:00:05.554265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:05.554265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:00:05.554265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.554265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': '7ea27265-d9b4-48a9-80e7-00f4be8ca323'} Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:05.555162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.556728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.558378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b58d9dae-3636-4ab3-ba1d-1f4f1cfd458b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Returning 404 to user: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:05.558378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b58d9dae-3636-4ab3-ba1d-1f4f1cfd458b tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 404 len: 111 microversion: 2.1 time: 0.029371 Jul 14 16:00:05.558378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 662/1223] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:00:05 2022] DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:05.559288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6a4ff57b-6dab-4ead-a08a-cda711561740 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.559821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6a4ff57b-6dab-4ead-a08a-cda711561740 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.565913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a4ff57b-6dab-4ead-a08a-cda711561740 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.566364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a4ff57b-6dab-4ead-a08a-cda711561740 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.567133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a4ff57b-6dab-4ead-a08a-cda711561740 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.567572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a4ff57b-6dab-4ead-a08a-cda711561740 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.595024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6a4ff57b-6dab-4ead-a08a-cda711561740 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Going to try to terminate instance {{(pid=124503) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:00:05.645440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.compute.api [None req-6a4ff57b-6dab-4ead-a08a-cda711561740 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Instance is already in deleting state, ignoring this request Jul 14 16:00:05.646270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6a4ff57b-6dab-4ead-a08a-cda711561740 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "DELETE /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 204 len: 0 microversion: 2.1 time: 0.090502 Jul 14 16:00:05.646836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 663/1224] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:00:05 2022] DELETE /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:00:05.651422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f20d8f0f-4d95-4a9f-a13d-8f8d70079b5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.653545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f20d8f0f-4d95-4a9f-a13d-8f8d70079b5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.659562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f20d8f0f-4d95-4a9f-a13d-8f8d70079b5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.660042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f20d8f0f-4d95-4a9f-a13d-8f8d70079b5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.660800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f20d8f0f-4d95-4a9f-a13d-8f8d70079b5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.661236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f20d8f0f-4d95-4a9f-a13d-8f8d70079b5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.691114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f20d8f0f-4d95-4a9f-a13d-8f8d70079b5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043233 Jul 14 16:00:05.691703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 664/1225] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:05.696201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-550fea7f-af97-465b-aac0-e605853e160b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.696685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-550fea7f-af97-465b-aac0-e605853e160b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.703747 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-550fea7f-af97-465b-aac0-e605853e160b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.704206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-550fea7f-af97-465b-aac0-e605853e160b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.704835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [None req-78d80c90-8a2c-41fc-9953-3875dff5a862 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [b48851c6-dbfd-41b0-8993-0bb7cc36d21b] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 43020. Jul 14 16:00:05.705305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-550fea7f-af97-465b-aac0-e605853e160b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.705421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-550fea7f-af97-465b-aac0-e605853e160b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.728553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-78d80c90-8a2c-41fc-9953-3875dff5a862 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "DELETE /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 204 len: 0 microversion: 2.1 time: 1.133950 Jul 14 16:00:05.729149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 562/1226] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:00:04 2022] DELETE /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 0 bytes in 1135 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:00:05.736294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f7b8767b-52c7-4071-a93b-5cad69a95a87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.737517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f7b8767b-52c7-4071-a93b-5cad69a95a87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.744338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7b8767b-52c7-4071-a93b-5cad69a95a87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.744797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7b8767b-52c7-4071-a93b-5cad69a95a87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.745546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7b8767b-52c7-4071-a93b-5cad69a95a87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.746037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7b8767b-52c7-4071-a93b-5cad69a95a87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.777412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f7b8767b-52c7-4071-a93b-5cad69a95a87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046282 Jul 14 16:00:05.778528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 563/1227] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:05.788284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4f2cb469-ee55-4525-84e9-d00d34c41cee tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.788794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4f2cb469-ee55-4525-84e9-d00d34c41cee tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.795234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4f2cb469-ee55-4525-84e9-d00d34c41cee tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.795719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4f2cb469-ee55-4525-84e9-d00d34c41cee tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.796505 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4f2cb469-ee55-4525-84e9-d00d34c41cee tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.796954 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4f2cb469-ee55-4525-84e9-d00d34c41cee tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.800365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-550fea7f-af97-465b-aac0-e605853e160b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lazy-loading 'services' on Instance uuid 58c05da0-6e6d-422a-b119-197a7a41a2b9 {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:00:05.811238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-4f2cb469-ee55-4525-84e9-d00d34c41cee tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] HTTP exception thrown: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4f2cb469-ee55-4525-84e9-d00d34c41cee tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Request method failure captured: Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 HTTP/1.1 Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DiYNRhhmKB71Qj0w5c8D6JdKxf-x3FK94lGFmKfAtr01LMY0-XVv6z_pn988VQdnj9C-SNWVqeKCgTZ0OkFUVog5zBMPm3ZTPqKLcFeFjJfhT36aZziFihpHT59bR-Eg-V2etjp-Cw5wFADG381B0Ie_z5TBOtik5jtW3zWGCU_Edk Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:00:05.812969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:00:05.814612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:05.814612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:05.814612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:05.814612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:05.814612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:05.814612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:00:05.814612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:00:05.814612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: a0e4900b6ad24eb19fe169d9c8d8c3a7 Jul 14 16:00:05.814612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:05.814612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:00:05.814612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.814612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '7ea27265-d9b4-48a9-80e7-00f4be8ca323'} Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:05.815498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.817203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.819412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4f2cb469-ee55-4525-84e9-d00d34c41cee tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Returning 404 to user: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:05.819412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4f2cb469-ee55-4525-84e9-d00d34c41cee tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 404 len: 111 microversion: 2.1 time: 0.030308 Jul 14 16:00:05.819412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 564/1228] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:00:05 2022] DELETE /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:05.822977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0c822a19-30a4-417a-8607-e75a9a94c452 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.823481 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0c822a19-30a4-417a-8607-e75a9a94c452 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.830632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c822a19-30a4-417a-8607-e75a9a94c452 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.831084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c822a19-30a4-417a-8607-e75a9a94c452 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.831889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c822a19-30a4-417a-8607-e75a9a94c452 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.832338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c822a19-30a4-417a-8607-e75a9a94c452 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.858077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0c822a19-30a4-417a-8607-e75a9a94c452 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:00:05.858248 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-550fea7f-af97-465b-aac0-e605853e160b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] HTTP exception thrown: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d77878a-198a-4e9f-b4a8-da4ace5306e2) Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-550fea7f-af97-465b-aac0-e605853e160b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Request method failure captured: Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments/bd59aa1e-6759-47fa-bf04-eaa6bc8732fb HTTP/1.1 Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0Dh-OnjgsX7oqQQNhgIDd2Id9QBoxzEw71St--jFuY59_FWrT8o0xifBEAh4tiT9uEN6NKtRvZKVFa8ijs9mZVlsB_oya6bTxN09k3urFjY_khy9Z2f6PkYlx_yNfc1Fu9ml67Wtce0XZUA7bHhQeOSF4Y9w3ufMuC-4_1jHFDTjD2k Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 858bb49b6e1e48568e2055eacc1ee7e5 Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2074780834 Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:00:05.860495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:00:05.862074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/858bb49b6e1e48568e2055eacc1ee7e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:05.862074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-VolumesSnapshotTestJSON-2074780834 Jul 14 16:00:05.862074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 858bb49b6e1e48568e2055eacc1ee7e5 Jul 14 16:00:05.862074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2074780834 Jul 14 16:00:05.862074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-VolumesSnapshotTestJSON-2074780834-project Jul 14 16:00:05.862074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:00:05.862074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:00:05.862074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 71bc270c6253426baa4f79638d466b20 Jul 14 16:00:05.862074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-VolumesSnapshotTestJSON-2074780834-project Jul 14 16:00:05.862074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d77878a-198a-4e9f-b4a8-da4ace5306e2) Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'server_id': '58c05da0-6e6d-422a-b119-197a7a41a2b9', 'id': 'bd59aa1e-6759-47fa-bf04-eaa6bc8732fb'} Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 16:00:05.862896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.BadRequest: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d77878a-198a-4e9f-b4a8-da4ace5306e2) Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5049, in _detach_volume Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.volume_api.begin_detaching(context, volume['id']) Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 403, in wrapper Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi _reraise(exception.InvalidInput(reason=err_msg)) Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:00:05.864103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 560, in begin_detaching Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.begin_detaching(volume_id) Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 310, in begin_detaching Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._action('os-begin_detaching', volume) Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 257, in _action Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.post(url, body=body) Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 227, in post Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'POST', **kwargs) Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidInput: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d77878a-198a-4e9f-b4a8-da4ace5306e2) Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.865564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5071, in detach_volume Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._detach_volume(context, instance, volume) Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 228, in wrapped Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5051, in _detach_volume Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=exc.format_message()) Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d77878a-198a-4e9f-b4a8-da4ace5306e2) Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:05.866901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 567, in delete Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d77878a-198a-4e9f-b4a8-da4ace5306e2) Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d77878a-198a-4e9f-b4a8-da4ace5306e2) Jul 14 16:00:05.868597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.869970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-550fea7f-af97-465b-aac0-e605853e160b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Returning 400 to user: Invalid volume: Invalid input received: Invalid volume: Unable to detach volume. Volume status must be 'in-use' and attach_status must be 'attached' to detach. (HTTP 400) (Request-ID: req-5d77878a-198a-4e9f-b4a8-da4ace5306e2) {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:05.869970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-550fea7f-af97-465b-aac0-e605853e160b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments/bd59aa1e-6759-47fa-bf04-eaa6bc8732fb" status: 400 len: 269 microversion: 2.1 time: 0.170011 Jul 14 16:00:05.869970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 665/1229] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 16:00:05 2022] DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9/os-volume_attachments/bd59aa1e-6759-47fa-bf04-eaa6bc8732fb => generated 269 bytes in 172 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:00:05.875668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-70de40c0-3c43-473f-85be-4776b26f1fcc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.876629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-70de40c0-3c43-473f-85be-4776b26f1fcc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.889285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70de40c0-3c43-473f-85be-4776b26f1fcc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.889736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70de40c0-3c43-473f-85be-4776b26f1fcc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.890653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70de40c0-3c43-473f-85be-4776b26f1fcc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.891084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70de40c0-3c43-473f-85be-4776b26f1fcc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.923921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-70de40c0-3c43-473f-85be-4776b26f1fcc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053817 Jul 14 16:00:05.925150 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 666/1230] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:05.929908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-51e29e31-53bd-4b70-9cd2-2eecabba4ecf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.930502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-51e29e31-53bd-4b70-9cd2-2eecabba4ecf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] [instance: 7ea27265-d9b4-48a9-80e7-00f4be8ca323] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.932728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.compute.api [None req-0c822a19-30a4-417a-8607-e75a9a94c452 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Instance is already in deleting state, ignoring this request Jul 14 16:00:05.934409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0c822a19-30a4-417a-8607-e75a9a94c452 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "DELETE /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 204 len: 0 microversion: 2.1 time: 0.116878 Jul 14 16:00:05.935498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 565/1231] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:00:05 2022] DELETE /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:00:05.937020 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51e29e31-53bd-4b70-9cd2-2eecabba4ecf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.937471 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51e29e31-53bd-4b70-9cd2-2eecabba4ecf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.938310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51e29e31-53bd-4b70-9cd2-2eecabba4ecf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.938741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51e29e31-53bd-4b70-9cd2-2eecabba4ecf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.944662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8d830562-2c16-46a7-8775-b7036b02ddfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:05.945275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8d830562-2c16-46a7-8775-b7036b02ddfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:05.952533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d830562-2c16-46a7-8775-b7036b02ddfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.952984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d830562-2c16-46a7-8775-b7036b02ddfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.953188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-51e29e31-53bd-4b70-9cd2-2eecabba4ecf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] HTTP exception thrown: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.953753 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d830562-2c16-46a7-8775-b7036b02ddfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:05.954202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d830562-2c16-46a7-8775-b7036b02ddfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-51e29e31-53bd-4b70-9cd2-2eecabba4ecf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Request method failure captured: Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 HTTP/1.1 Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DiYNRhhmKB71Qj0w5c8D6JdKxf-x3FK94lGFmKfAtr01LMY0-XVv6z_pn988VQdnj9C-SNWVqeKCgTZ0OkFUVog5zBMPm3ZTPqKLcFeFjJfhT36aZziFihpHT59bR-Eg-V2etjp-Cw5wFADG381B0Ie_z5TBOtik5jtW3zWGCU_Edk Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:00:05.954741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:00:05.956440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/599a768f6b9d4134a4b8e05a7e5f5e87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:00:05.956440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:05.956440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 599a768f6b9d4134a4b8e05a7e5f5e87 Jul 14 16:00:05.956440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-TestVolumeBootPattern-1564107289 Jul 14 16:00:05.956440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:05.956440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:00:05.956440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:00:05.956440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: a0e4900b6ad24eb19fe169d9c8d8c3a7 Jul 14 16:00:05.956440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-TestVolumeBootPattern-1564107289-project Jul 14 16:00:05.956440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:00:05.956440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.956440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': '7ea27265-d9b4-48a9-80e7-00f4be8ca323'} Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:00:05.957316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. Jul 14 16:00:05.958559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:00:05.959991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-51e29e31-53bd-4b70-9cd2-2eecabba4ecf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Returning 404 to user: Instance 7ea27265-d9b4-48a9-80e7-00f4be8ca323 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:00:05.959991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-51e29e31-53bd-4b70-9cd2-2eecabba4ecf tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323" status: 404 len: 111 microversion: 2.1 time: 0.029915 Jul 14 16:00:05.959991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 667/1232] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/7ea27265-d9b4-48a9-80e7-00f4be8ca323 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:00:06.119766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8d830562-2c16-46a7-8775-b7036b02ddfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:06.127408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8d830562-2c16-46a7-8775-b7036b02ddfb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1449 microversion: 2.1 time: 0.186407 Jul 14 16:00:06.128124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 566/1233] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:05 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1449 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:06.790893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-98a73db5-db90-4e01-b9ac-a27039d0c4bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:06.791881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-98a73db5-db90-4e01-b9ac-a27039d0c4bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:06.798797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-98a73db5-db90-4e01-b9ac-a27039d0c4bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.799284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-98a73db5-db90-4e01-b9ac-a27039d0c4bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.800033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-98a73db5-db90-4e01-b9ac-a27039d0c4bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.800470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-98a73db5-db90-4e01-b9ac-a27039d0c4bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.829839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-98a73db5-db90-4e01-b9ac-a27039d0c4bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042981 Jul 14 16:00:06.830403 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 668/1234] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:06 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:06.834506 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-8edc6d05-b96d-40e5-982e-baf3292d0750 req-637b1d68-a074-45a9-a14f-32878d9282e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fde2fb02-e844-471d-b2bc-81fc89534875", "name": "network-vif-deleted", "tag": "fed6f852-a2ff-4105-8fe1-d37f2cf9b9cd"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:00:06.843725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-8edc6d05-b96d-40e5-982e-baf3292d0750 req-637b1d68-a074-45a9-a14f-32878d9282e3 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.844171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-8edc6d05-b96d-40e5-982e-baf3292d0750 req-637b1d68-a074-45a9-a14f-32878d9282e3 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.854590 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-8edc6d05-b96d-40e5-982e-baf3292d0750 req-637b1d68-a074-45a9-a14f-32878d9282e3 service nova] Creating event network-vif-deleted:fed6f852-a2ff-4105-8fe1-d37f2cf9b9cd for instance fde2fb02-e844-471d-b2bc-81fc89534875 on hv-cinder-82651 Jul 14 16:00:06.860475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-8edc6d05-b96d-40e5-982e-baf3292d0750 req-637b1d68-a074-45a9-a14f-32878d9282e3 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029643 Jul 14 16:00:06.861041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 567/1235] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:00:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:06.936513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5bf72846-6772-4d08-8163-1557ea298a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:06.937443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5bf72846-6772-4d08-8163-1557ea298a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:06.944148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5bf72846-6772-4d08-8163-1557ea298a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.944601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5bf72846-6772-4d08-8163-1557ea298a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.945382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5bf72846-6772-4d08-8163-1557ea298a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:06.945827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5bf72846-6772-4d08-8163-1557ea298a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:06.976754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5bf72846-6772-4d08-8163-1557ea298a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044309 Jul 14 16:00:06.977329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 669/1236] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:06 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:07.146115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0a7c8f0d-623a-4597-bcf3-51c69d70e710 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:07.146824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0a7c8f0d-623a-4597-bcf3-51c69d70e710 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:07.153657 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a7c8f0d-623a-4597-bcf3-51c69d70e710 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.154109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a7c8f0d-623a-4597-bcf3-51c69d70e710 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.154876 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a7c8f0d-623a-4597-bcf3-51c69d70e710 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.155326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a7c8f0d-623a-4597-bcf3-51c69d70e710 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.217571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0a7c8f0d-623a-4597-bcf3-51c69d70e710 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:07.225307 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0a7c8f0d-623a-4597-bcf3-51c69d70e710 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083459 Jul 14 16:00:07.225888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 568/1237] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:07 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:07.842302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3e4837bb-2d8a-4f78-b530-118ba2da7877 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:07.843295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3e4837bb-2d8a-4f78-b530-118ba2da7877 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:07.849702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3e4837bb-2d8a-4f78-b530-118ba2da7877 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.850153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3e4837bb-2d8a-4f78-b530-118ba2da7877 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.850926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3e4837bb-2d8a-4f78-b530-118ba2da7877 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.851368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3e4837bb-2d8a-4f78-b530-118ba2da7877 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.882527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3e4837bb-2d8a-4f78-b530-118ba2da7877 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044810 Jul 14 16:00:07.883104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 670/1238] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:07 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:07.989980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-37249dbd-5712-4788-8b9b-a927b2cae4df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:07.990969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-37249dbd-5712-4788-8b9b-a927b2cae4df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:07.997972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-37249dbd-5712-4788-8b9b-a927b2cae4df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.998428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-37249dbd-5712-4788-8b9b-a927b2cae4df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:07.999197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-37249dbd-5712-4788-8b9b-a927b2cae4df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:07.999656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-37249dbd-5712-4788-8b9b-a927b2cae4df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.031736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-37249dbd-5712-4788-8b9b-a927b2cae4df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046177 Jul 14 16:00:08.032540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 569/1239] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:07 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:08.244402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e1e1e96f-cd41-448e-81d2-edee48acaa89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:08.245014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e1e1e96f-cd41-448e-81d2-edee48acaa89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:08.253479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e1e1e96f-cd41-448e-81d2-edee48acaa89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.253932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e1e1e96f-cd41-448e-81d2-edee48acaa89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.254702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e1e1e96f-cd41-448e-81d2-edee48acaa89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.255796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e1e1e96f-cd41-448e-81d2-edee48acaa89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.321505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e1e1e96f-cd41-448e-81d2-edee48acaa89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:08.330424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e1e1e96f-cd41-448e-81d2-edee48acaa89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090247 Jul 14 16:00:08.331000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 671/1240] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:08 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:08.853531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:00:08.853807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:00:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:00:08.894538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a77dc142-7b19-4fbd-810b-6f7291316821 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:08.895467 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a77dc142-7b19-4fbd-810b-6f7291316821 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:08.901649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a77dc142-7b19-4fbd-810b-6f7291316821 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.902653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a77dc142-7b19-4fbd-810b-6f7291316821 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.903629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a77dc142-7b19-4fbd-810b-6f7291316821 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:08.904077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a77dc142-7b19-4fbd-810b-6f7291316821 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:08.937955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a77dc142-7b19-4fbd-810b-6f7291316821 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047308 Jul 14 16:00:08.938538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 570/1241] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:08 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:09.043654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-52fe94ec-e86f-43bb-a76b-c1454d2fae2b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:09.045321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-52fe94ec-e86f-43bb-a76b-c1454d2fae2b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:09.051447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52fe94ec-e86f-43bb-a76b-c1454d2fae2b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.051924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52fe94ec-e86f-43bb-a76b-c1454d2fae2b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.052682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52fe94ec-e86f-43bb-a76b-c1454d2fae2b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.053117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52fe94ec-e86f-43bb-a76b-c1454d2fae2b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.094791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-52fe94ec-e86f-43bb-a76b-c1454d2fae2b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054730 Jul 14 16:00:09.095855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 672/1242] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:09 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:09.347479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4056a41f-f0ad-42d3-b1b2-f78f0e222a1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:09.348122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4056a41f-f0ad-42d3-b1b2-f78f0e222a1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:09.354482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4056a41f-f0ad-42d3-b1b2-f78f0e222a1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.355425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4056a41f-f0ad-42d3-b1b2-f78f0e222a1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.356393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4056a41f-f0ad-42d3-b1b2-f78f0e222a1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.356830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4056a41f-f0ad-42d3-b1b2-f78f0e222a1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.423008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4056a41f-f0ad-42d3-b1b2-f78f0e222a1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:09.430713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4056a41f-f0ad-42d3-b1b2-f78f0e222a1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087126 Jul 14 16:00:09.431277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 571/1243] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:09 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:09.949876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-87e3d5c1-46a2-415f-af8d-3920f8c2a3cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:09.950794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-87e3d5c1-46a2-415f-af8d-3920f8c2a3cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:09.957307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-87e3d5c1-46a2-415f-af8d-3920f8c2a3cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.957755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-87e3d5c1-46a2-415f-af8d-3920f8c2a3cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.958515 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-87e3d5c1-46a2-415f-af8d-3920f8c2a3cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:09.958960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-87e3d5c1-46a2-415f-af8d-3920f8c2a3cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:09.987614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-87e3d5c1-46a2-415f-af8d-3920f8c2a3cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041692 Jul 14 16:00:09.988184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 673/1244] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:09 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:10.107327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d60005f3-8967-4707-aebc-40a2c7b1a1c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:10.108280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d60005f3-8967-4707-aebc-40a2c7b1a1c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:10.114262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d60005f3-8967-4707-aebc-40a2c7b1a1c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.114711 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d60005f3-8967-4707-aebc-40a2c7b1a1c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.115473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d60005f3-8967-4707-aebc-40a2c7b1a1c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.115940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d60005f3-8967-4707-aebc-40a2c7b1a1c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.119447 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:10.147352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d60005f3-8967-4707-aebc-40a2c7b1a1c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044244 Jul 14 16:00:10.147956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 572/1245] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:10 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:10.448109 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9f8d473b-cb95-4b10-8324-558cf92709e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:10.449239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9f8d473b-cb95-4b10-8324-558cf92709e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:10.455240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f8d473b-cb95-4b10-8324-558cf92709e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.455728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f8d473b-cb95-4b10-8324-558cf92709e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.456542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f8d473b-cb95-4b10-8324-558cf92709e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:10.456964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f8d473b-cb95-4b10-8324-558cf92709e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:10.527585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9f8d473b-cb95-4b10-8324-558cf92709e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:10.536525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9f8d473b-cb95-4b10-8324-558cf92709e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.092559 Jul 14 16:00:10.537110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 674/1246] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:10 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:10.998867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dc0a7a34-145a-4dab-a860-412a7bcb859e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:10.999820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dc0a7a34-145a-4dab-a860-412a7bcb859e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:11.005771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc0a7a34-145a-4dab-a860-412a7bcb859e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.006215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc0a7a34-145a-4dab-a860-412a7bcb859e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.006970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc0a7a34-145a-4dab-a860-412a7bcb859e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.007402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc0a7a34-145a-4dab-a860-412a7bcb859e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.038314 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dc0a7a34-145a-4dab-a860-412a7bcb859e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 Jul 14 16:00:11.038899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 573/1247] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:10 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:11.158317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-131ce829-5e1c-46b6-9ba2-42034c5d58f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:11.159527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-131ce829-5e1c-46b6-9ba2-42034c5d58f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:11.165999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-131ce829-5e1c-46b6-9ba2-42034c5d58f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.166451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-131ce829-5e1c-46b6-9ba2-42034c5d58f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.167223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-131ce829-5e1c-46b6-9ba2-42034c5d58f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.167860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-131ce829-5e1c-46b6-9ba2-42034c5d58f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.197103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-131ce829-5e1c-46b6-9ba2-42034c5d58f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042753 Jul 14 16:00:11.197665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 675/1248] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:11 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:11.553619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-57e5c534-daac-4fcb-8bd4-0d37ca30fd1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:11.554241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-57e5c534-daac-4fcb-8bd4-0d37ca30fd1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:11.561475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-57e5c534-daac-4fcb-8bd4-0d37ca30fd1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.561857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-57e5c534-daac-4fcb-8bd4-0d37ca30fd1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.562619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-57e5c534-daac-4fcb-8bd4-0d37ca30fd1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:11.563055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-57e5c534-daac-4fcb-8bd4-0d37ca30fd1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:11.626817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-57e5c534-daac-4fcb-8bd4-0d37ca30fd1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:11.634308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-57e5c534-daac-4fcb-8bd4-0d37ca30fd1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084649 Jul 14 16:00:11.634873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 574/1249] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:11 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:12.050000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b7c88e0e-7ecc-4f7e-abd7-eea99a78c052 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:12.050910 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b7c88e0e-7ecc-4f7e-abd7-eea99a78c052 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:12.057003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b7c88e0e-7ecc-4f7e-abd7-eea99a78c052 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.057445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b7c88e0e-7ecc-4f7e-abd7-eea99a78c052 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.058933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b7c88e0e-7ecc-4f7e-abd7-eea99a78c052 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.059359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b7c88e0e-7ecc-4f7e-abd7-eea99a78c052 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.090004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b7c88e0e-7ecc-4f7e-abd7-eea99a78c052 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043902 Jul 14 16:00:12.090553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 676/1250] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:12.209574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-708959da-91a2-4dbd-8619-f764678640a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:12.210409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-708959da-91a2-4dbd-8619-f764678640a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:12.217410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-708959da-91a2-4dbd-8619-f764678640a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.217863 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-708959da-91a2-4dbd-8619-f764678640a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.218630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-708959da-91a2-4dbd-8619-f764678640a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.219069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-708959da-91a2-4dbd-8619-f764678640a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.249818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-708959da-91a2-4dbd-8619-f764678640a7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044286 Jul 14 16:00:12.250381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 575/1251] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:12.651033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3416ca13-6344-4ee8-811d-0b68ee247239 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:12.652273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3416ca13-6344-4ee8-811d-0b68ee247239 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:12.659459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3416ca13-6344-4ee8-811d-0b68ee247239 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.659943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3416ca13-6344-4ee8-811d-0b68ee247239 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.660714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3416ca13-6344-4ee8-811d-0b68ee247239 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:12.661149 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3416ca13-6344-4ee8-811d-0b68ee247239 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:12.732647 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3416ca13-6344-4ee8-811d-0b68ee247239 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:12.736098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:12.741072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3416ca13-6344-4ee8-811d-0b68ee247239 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.093933 Jul 14 16:00:12.741647 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 677/1252] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:12 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:13.101990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0be59aed-ea5c-4df2-8ce1-09e734a36210 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:13.102939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0be59aed-ea5c-4df2-8ce1-09e734a36210 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:13.111238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0be59aed-ea5c-4df2-8ce1-09e734a36210 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.111721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0be59aed-ea5c-4df2-8ce1-09e734a36210 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.112535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0be59aed-ea5c-4df2-8ce1-09e734a36210 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.112978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0be59aed-ea5c-4df2-8ce1-09e734a36210 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.155144 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0be59aed-ea5c-4df2-8ce1-09e734a36210 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057196 Jul 14 16:00:13.155762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 576/1253] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:13 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:13.262706 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-03145205-89b5-4469-a756-7559a867fd91 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:13.263574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-03145205-89b5-4469-a756-7559a867fd91 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:13.270234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03145205-89b5-4469-a756-7559a867fd91 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.270704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03145205-89b5-4469-a756-7559a867fd91 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.271449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03145205-89b5-4469-a756-7559a867fd91 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.271911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03145205-89b5-4469-a756-7559a867fd91 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.302230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-03145205-89b5-4469-a756-7559a867fd91 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045026 Jul 14 16:00:13.302798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 678/1254] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:13 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:13.757542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f7a801b2-4b0c-4725-83aa-14095b870de7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:13.758443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f7a801b2-4b0c-4725-83aa-14095b870de7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:13.765413 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7a801b2-4b0c-4725-83aa-14095b870de7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.765860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7a801b2-4b0c-4725-83aa-14095b870de7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.766638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7a801b2-4b0c-4725-83aa-14095b870de7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:13.767079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7a801b2-4b0c-4725-83aa-14095b870de7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:13.830890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f7a801b2-4b0c-4725-83aa-14095b870de7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:13.838627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f7a801b2-4b0c-4725-83aa-14095b870de7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084942 Jul 14 16:00:13.839235 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 577/1255] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:13 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:14.167755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9d329201-2ff6-45fe-9289-7f47b0015a84 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:14.170204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9d329201-2ff6-45fe-9289-7f47b0015a84 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:14.176822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d329201-2ff6-45fe-9289-7f47b0015a84 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.177271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d329201-2ff6-45fe-9289-7f47b0015a84 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.178022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d329201-2ff6-45fe-9289-7f47b0015a84 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.178455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d329201-2ff6-45fe-9289-7f47b0015a84 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.207709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9d329201-2ff6-45fe-9289-7f47b0015a84 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044449 Jul 14 16:00:14.208266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 679/1256] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:14 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:14.314883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-773a02f2-ee92-42cf-a2c7-f0090079d1c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:14.315756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-773a02f2-ee92-42cf-a2c7-f0090079d1c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:14.321815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-773a02f2-ee92-42cf-a2c7-f0090079d1c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.322273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-773a02f2-ee92-42cf-a2c7-f0090079d1c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.323035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-773a02f2-ee92-42cf-a2c7-f0090079d1c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.324153 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-773a02f2-ee92-42cf-a2c7-f0090079d1c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.352513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-773a02f2-ee92-42cf-a2c7-f0090079d1c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041693 Jul 14 16:00:14.353066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 578/1257] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:14 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:14.855725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ffeed500-f15b-4c55-a93e-483828b33647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:14.856266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ffeed500-f15b-4c55-a93e-483828b33647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:14.862505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffeed500-f15b-4c55-a93e-483828b33647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.862945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffeed500-f15b-4c55-a93e-483828b33647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.863720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffeed500-f15b-4c55-a93e-483828b33647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:14.864153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffeed500-f15b-4c55-a93e-483828b33647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:14.924879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ffeed500-f15b-4c55-a93e-483828b33647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:14.932235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ffeed500-f15b-4c55-a93e-483828b33647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.080612 Jul 14 16:00:14.933316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 680/1258] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:14 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:15.220272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-43c27551-660f-42fc-9a6f-f4deb1df6576 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:15.221179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-43c27551-660f-42fc-9a6f-f4deb1df6576 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:15.227753 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43c27551-660f-42fc-9a6f-f4deb1df6576 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.228206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43c27551-660f-42fc-9a6f-f4deb1df6576 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.228967 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43c27551-660f-42fc-9a6f-f4deb1df6576 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.229405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43c27551-660f-42fc-9a6f-f4deb1df6576 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.258769 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-43c27551-660f-42fc-9a6f-f4deb1df6576 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042699 Jul 14 16:00:15.259324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 579/1259] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:15 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:15.364704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dce166d8-9517-4fc6-96e9-d219ad217772 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:15.365626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dce166d8-9517-4fc6-96e9-d219ad217772 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:15.373053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dce166d8-9517-4fc6-96e9-d219ad217772 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.373507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dce166d8-9517-4fc6-96e9-d219ad217772 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.374309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dce166d8-9517-4fc6-96e9-d219ad217772 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.374745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dce166d8-9517-4fc6-96e9-d219ad217772 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.405194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dce166d8-9517-4fc6-96e9-d219ad217772 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044531 Jul 14 16:00:15.405753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 681/1260] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:15 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:15.950319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c1a1546c-12c6-4f39-89d8-f82be9e89cc7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:15.950936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c1a1546c-12c6-4f39-89d8-f82be9e89cc7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:15.957109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1a1546c-12c6-4f39-89d8-f82be9e89cc7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.957562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1a1546c-12c6-4f39-89d8-f82be9e89cc7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:15.958328 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1a1546c-12c6-4f39-89d8-f82be9e89cc7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:15.958773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1a1546c-12c6-4f39-89d8-f82be9e89cc7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.020804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c1a1546c-12c6-4f39-89d8-f82be9e89cc7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:16.029012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c1a1546c-12c6-4f39-89d8-f82be9e89cc7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083268 Jul 14 16:00:16.029600 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 580/1261] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:15 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:16.271806 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e1d15df-3be6-447d-8a2e-9340aace036b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:16.272626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e1d15df-3be6-447d-8a2e-9340aace036b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:16.280264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e1d15df-3be6-447d-8a2e-9340aace036b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.280717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e1d15df-3be6-447d-8a2e-9340aace036b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.281490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e1d15df-3be6-447d-8a2e-9340aace036b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.281928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e1d15df-3be6-447d-8a2e-9340aace036b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.314436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e1d15df-3be6-447d-8a2e-9340aace036b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046689 Jul 14 16:00:16.315011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 682/1262] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:16 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:16.416742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5fc0baa9-42f5-4b13-8923-414e2f3cfdc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:16.417838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5fc0baa9-42f5-4b13-8923-414e2f3cfdc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:16.424291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5fc0baa9-42f5-4b13-8923-414e2f3cfdc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.424742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5fc0baa9-42f5-4b13-8923-414e2f3cfdc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.425509 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5fc0baa9-42f5-4b13-8923-414e2f3cfdc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:16.425947 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5fc0baa9-42f5-4b13-8923-414e2f3cfdc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:16.456024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5fc0baa9-42f5-4b13-8923-414e2f3cfdc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043169 Jul 14 16:00:16.456592 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 581/1263] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:16 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:17.046182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-760471e8-3ca8-482f-a87a-20c4eeda8b76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:17.046844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-760471e8-3ca8-482f-a87a-20c4eeda8b76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:17.053612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-760471e8-3ca8-482f-a87a-20c4eeda8b76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.054071 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-760471e8-3ca8-482f-a87a-20c4eeda8b76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.054839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-760471e8-3ca8-482f-a87a-20c4eeda8b76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.055277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-760471e8-3ca8-482f-a87a-20c4eeda8b76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.119409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-760471e8-3ca8-482f-a87a-20c4eeda8b76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:17.127613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-760471e8-3ca8-482f-a87a-20c4eeda8b76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085399 Jul 14 16:00:17.128193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 683/1264] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:17 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:17.326283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-90f74e65-7fab-49c1-90aa-e46c34ebb351 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:17.327157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-90f74e65-7fab-49c1-90aa-e46c34ebb351 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:17.333324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-90f74e65-7fab-49c1-90aa-e46c34ebb351 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.333782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-90f74e65-7fab-49c1-90aa-e46c34ebb351 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.334548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-90f74e65-7fab-49c1-90aa-e46c34ebb351 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.335021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-90f74e65-7fab-49c1-90aa-e46c34ebb351 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.364954 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-90f74e65-7fab-49c1-90aa-e46c34ebb351 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042758 Jul 14 16:00:17.365518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 582/1265] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:17 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:17.468123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f68aaa89-9856-47e3-93bb-d84a959d4dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:17.469061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f68aaa89-9856-47e3-93bb-d84a959d4dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:17.475041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f68aaa89-9856-47e3-93bb-d84a959d4dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.475493 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f68aaa89-9856-47e3-93bb-d84a959d4dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.476300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f68aaa89-9856-47e3-93bb-d84a959d4dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:17.476746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f68aaa89-9856-47e3-93bb-d84a959d4dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:17.505230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f68aaa89-9856-47e3-93bb-d84a959d4dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041631 Jul 14 16:00:17.505830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 684/1266] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:17 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:18.145109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7d5a2b09-2665-4752-8728-68ec6c1c4f72 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:18.145728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7d5a2b09-2665-4752-8728-68ec6c1c4f72 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:18.152276 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d5a2b09-2665-4752-8728-68ec6c1c4f72 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.152730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d5a2b09-2665-4752-8728-68ec6c1c4f72 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.153493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d5a2b09-2665-4752-8728-68ec6c1c4f72 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.153937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d5a2b09-2665-4752-8728-68ec6c1c4f72 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.217880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7d5a2b09-2665-4752-8728-68ec6c1c4f72 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:18.225523 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7d5a2b09-2665-4752-8728-68ec6c1c4f72 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084288 Jul 14 16:00:18.226096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 583/1267] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:18 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:18.377657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4e4d012c-e47d-4bbb-99d3-1eba8889d9c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:18.378493 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4e4d012c-e47d-4bbb-99d3-1eba8889d9c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:18.385321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e4d012c-e47d-4bbb-99d3-1eba8889d9c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.386026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e4d012c-e47d-4bbb-99d3-1eba8889d9c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.387056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e4d012c-e47d-4bbb-99d3-1eba8889d9c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.387497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e4d012c-e47d-4bbb-99d3-1eba8889d9c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.416615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4e4d012c-e47d-4bbb-99d3-1eba8889d9c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Jul 14 16:00:18.417772 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 685/1268] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:18 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:18.517391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-77ea88b5-a127-451a-bb29-97bb5789cf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:18.518306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-77ea88b5-a127-451a-bb29-97bb5789cf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:18.524264 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-77ea88b5-a127-451a-bb29-97bb5789cf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.524708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-77ea88b5-a127-451a-bb29-97bb5789cf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.525464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-77ea88b5-a127-451a-bb29-97bb5789cf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:18.525891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-77ea88b5-a127-451a-bb29-97bb5789cf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:18.555398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-77ea88b5-a127-451a-bb29-97bb5789cf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041931 Jul 14 16:00:18.555973 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 584/1269] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:18 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:19.243429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-470d3265-2d9d-4dbb-ad02-da1d7ffba3b6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:19.244084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-470d3265-2d9d-4dbb-ad02-da1d7ffba3b6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:19.250526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-470d3265-2d9d-4dbb-ad02-da1d7ffba3b6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.250894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-470d3265-2d9d-4dbb-ad02-da1d7ffba3b6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.251678 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-470d3265-2d9d-4dbb-ad02-da1d7ffba3b6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.252123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-470d3265-2d9d-4dbb-ad02-da1d7ffba3b6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.318655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-470d3265-2d9d-4dbb-ad02-da1d7ffba3b6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:19.327276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-470d3265-2d9d-4dbb-ad02-da1d7ffba3b6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087680 Jul 14 16:00:19.328148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 686/1270] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:19 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:19.428781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-42c9ae9f-5f77-45ef-b8a7-790d9ad456de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:19.429699 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-42c9ae9f-5f77-45ef-b8a7-790d9ad456de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:19.436511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-42c9ae9f-5f77-45ef-b8a7-790d9ad456de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.436954 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-42c9ae9f-5f77-45ef-b8a7-790d9ad456de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.437709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-42c9ae9f-5f77-45ef-b8a7-790d9ad456de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.438145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-42c9ae9f-5f77-45ef-b8a7-790d9ad456de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.469987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-42c9ae9f-5f77-45ef-b8a7-790d9ad456de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045142 Jul 14 16:00:19.470544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 585/1271] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:19 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:19.567844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4f1948fa-966c-4510-85ae-e41af20ff67a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:19.568696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4f1948fa-966c-4510-85ae-e41af20ff67a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:19.575805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f1948fa-966c-4510-85ae-e41af20ff67a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.576398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f1948fa-966c-4510-85ae-e41af20ff67a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.577177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f1948fa-966c-4510-85ae-e41af20ff67a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:19.577618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f1948fa-966c-4510-85ae-e41af20ff67a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:19.607978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4f1948fa-966c-4510-85ae-e41af20ff67a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044127 Jul 14 16:00:19.608547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 687/1272] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:19 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:20.345457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b8575d88-a70b-422d-baee-5fdeef389b25 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:20.345986 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b8575d88-a70b-422d-baee-5fdeef389b25 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:20.352063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8575d88-a70b-422d-baee-5fdeef389b25 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.352522 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8575d88-a70b-422d-baee-5fdeef389b25 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.353282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8575d88-a70b-422d-baee-5fdeef389b25 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.353724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8575d88-a70b-422d-baee-5fdeef389b25 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.414257 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b8575d88-a70b-422d-baee-5fdeef389b25 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:20.422524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b8575d88-a70b-422d-baee-5fdeef389b25 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081136 Jul 14 16:00:20.423086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 586/1273] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:20 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:20.481771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5c563c33-91cc-455e-9d01-11d382165b49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:20.482692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5c563c33-91cc-455e-9d01-11d382165b49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:20.488721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5c563c33-91cc-455e-9d01-11d382165b49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.489167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5c563c33-91cc-455e-9d01-11d382165b49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.489922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5c563c33-91cc-455e-9d01-11d382165b49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.490357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5c563c33-91cc-455e-9d01-11d382165b49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.520728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5c563c33-91cc-455e-9d01-11d382165b49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043142 Jul 14 16:00:20.521275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 688/1274] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:20 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:20.619733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ed0b3c4e-727b-4a1c-9663-6ce3f9485b04 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:20.620621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ed0b3c4e-727b-4a1c-9663-6ce3f9485b04 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:20.627062 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed0b3c4e-727b-4a1c-9663-6ce3f9485b04 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.627506 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed0b3c4e-727b-4a1c-9663-6ce3f9485b04 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.628294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed0b3c4e-727b-4a1c-9663-6ce3f9485b04 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:20.628726 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed0b3c4e-727b-4a1c-9663-6ce3f9485b04 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:20.657872 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ed0b3c4e-727b-4a1c-9663-6ce3f9485b04 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042154 Jul 14 16:00:20.658429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 587/1275] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:20 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:21.439476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-37deb32b-7c61-4ac3-b870-b4397b4bdbdd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:21.440128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-37deb32b-7c61-4ac3-b870-b4397b4bdbdd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:21.446645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37deb32b-7c61-4ac3-b870-b4397b4bdbdd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.447092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37deb32b-7c61-4ac3-b870-b4397b4bdbdd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.447911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37deb32b-7c61-4ac3-b870-b4397b4bdbdd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.448872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37deb32b-7c61-4ac3-b870-b4397b4bdbdd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.509702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37deb32b-7c61-4ac3-b870-b4397b4bdbdd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:21.518049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-37deb32b-7c61-4ac3-b870-b4397b4bdbdd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082440 Jul 14 16:00:21.518614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 689/1276] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:21 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:21.531826 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6c6b44a6-2f63-475d-8160-9e82051d8af2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:21.532767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6c6b44a6-2f63-475d-8160-9e82051d8af2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:21.538880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c6b44a6-2f63-475d-8160-9e82051d8af2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.539317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c6b44a6-2f63-475d-8160-9e82051d8af2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.540096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c6b44a6-2f63-475d-8160-9e82051d8af2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.540528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c6b44a6-2f63-475d-8160-9e82051d8af2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.565287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:21.570453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6c6b44a6-2f63-475d-8160-9e82051d8af2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043227 Jul 14 16:00:21.571008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 588/1277] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:21 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:21.670116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-90290ecf-1160-4bc2-a82a-dd89f5661733 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:21.671159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-90290ecf-1160-4bc2-a82a-dd89f5661733 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:21.677144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90290ecf-1160-4bc2-a82a-dd89f5661733 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.677590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90290ecf-1160-4bc2-a82a-dd89f5661733 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.678343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90290ecf-1160-4bc2-a82a-dd89f5661733 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:21.678787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90290ecf-1160-4bc2-a82a-dd89f5661733 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:21.708116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-90290ecf-1160-4bc2-a82a-dd89f5661733 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042262 Jul 14 16:00:21.708592 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 690/1278] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:21 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:22.536601 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-28893a32-6229-49a3-8b65-7b9dea2d3069 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:22.537220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-28893a32-6229-49a3-8b65-7b9dea2d3069 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:22.544923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-28893a32-6229-49a3-8b65-7b9dea2d3069 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.545377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-28893a32-6229-49a3-8b65-7b9dea2d3069 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.546149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-28893a32-6229-49a3-8b65-7b9dea2d3069 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.546591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-28893a32-6229-49a3-8b65-7b9dea2d3069 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.582390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ad34a523-c491-4249-bcc4-cb583c7be56e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:22.583424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ad34a523-c491-4249-bcc4-cb583c7be56e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:22.591427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad34a523-c491-4249-bcc4-cb583c7be56e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.591991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad34a523-c491-4249-bcc4-cb583c7be56e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.592835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad34a523-c491-4249-bcc4-cb583c7be56e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.593342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad34a523-c491-4249-bcc4-cb583c7be56e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.607496 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-28893a32-6229-49a3-8b65-7b9dea2d3069 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:22.615121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-28893a32-6229-49a3-8b65-7b9dea2d3069 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082608 Jul 14 16:00:22.615922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 589/1279] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:22 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:22.624686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ad34a523-c491-4249-bcc4-cb583c7be56e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046149 Jul 14 16:00:22.625245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 691/1280] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:22 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:22.724353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-aaa055ed-c0c4-46dc-b683-e1356eb96a41 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:22.725984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-aaa055ed-c0c4-46dc-b683-e1356eb96a41 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:22.733942 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aaa055ed-c0c4-46dc-b683-e1356eb96a41 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.734388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aaa055ed-c0c4-46dc-b683-e1356eb96a41 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.735158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aaa055ed-c0c4-46dc-b683-e1356eb96a41 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:22.735650 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aaa055ed-c0c4-46dc-b683-e1356eb96a41 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:22.766693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-aaa055ed-c0c4-46dc-b683-e1356eb96a41 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049735 Jul 14 16:00:22.767281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 590/1281] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:22 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:23.632333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a0ab8cf7-6a21-455f-9648-31bafdd0998a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:23.632964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a0ab8cf7-6a21-455f-9648-31bafdd0998a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:23.637031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6a95481a-005f-4c60-8819-708ef4a76230 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:23.637832 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6a95481a-005f-4c60-8819-708ef4a76230 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:23.639775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0ab8cf7-6a21-455f-9648-31bafdd0998a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.640278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0ab8cf7-6a21-455f-9648-31bafdd0998a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.641412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0ab8cf7-6a21-455f-9648-31bafdd0998a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.641531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0ab8cf7-6a21-455f-9648-31bafdd0998a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.644466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a95481a-005f-4c60-8819-708ef4a76230 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.644923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a95481a-005f-4c60-8819-708ef4a76230 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.646505 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a95481a-005f-4c60-8819-708ef4a76230 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.646505 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a95481a-005f-4c60-8819-708ef4a76230 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.683371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6a95481a-005f-4c60-8819-708ef4a76230 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051321 Jul 14 16:00:23.684239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 591/1282] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:23 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:23.709538 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a0ab8cf7-6a21-455f-9648-31bafdd0998a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:23.717920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a0ab8cf7-6a21-455f-9648-31bafdd0998a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.089514 Jul 14 16:00:23.718482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 692/1283] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:23 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:23.781738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-853d06ea-4f30-4d37-8fed-f09393033861 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:23.782665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-853d06ea-4f30-4d37-8fed-f09393033861 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:23.789088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-853d06ea-4f30-4d37-8fed-f09393033861 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.789612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-853d06ea-4f30-4d37-8fed-f09393033861 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.790288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-853d06ea-4f30-4d37-8fed-f09393033861 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:23.790774 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-853d06ea-4f30-4d37-8fed-f09393033861 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:23.820548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-853d06ea-4f30-4d37-8fed-f09393033861 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043006 Jul 14 16:00:23.821028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 592/1284] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:23 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:24.695456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c25f2a6e-7e5c-45e8-8b64-b08e5afadb7b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:24.696422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c25f2a6e-7e5c-45e8-8b64-b08e5afadb7b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:24.698822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=95 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:24.704390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c25f2a6e-7e5c-45e8-8b64-b08e5afadb7b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.704834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c25f2a6e-7e5c-45e8-8b64-b08e5afadb7b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.705600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c25f2a6e-7e5c-45e8-8b64-b08e5afadb7b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.706037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c25f2a6e-7e5c-45e8-8b64-b08e5afadb7b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.735446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ca887cc9-5239-473c-8644-b46d7a2ce69d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:24.736244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ca887cc9-5239-473c-8644-b46d7a2ce69d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:24.738174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c25f2a6e-7e5c-45e8-8b64-b08e5afadb7b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046728 Jul 14 16:00:24.738739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 693/1285] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:24 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:24.742691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca887cc9-5239-473c-8644-b46d7a2ce69d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.743147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca887cc9-5239-473c-8644-b46d7a2ce69d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.743973 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca887cc9-5239-473c-8644-b46d7a2ce69d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.744414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca887cc9-5239-473c-8644-b46d7a2ce69d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.816756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ca887cc9-5239-473c-8644-b46d7a2ce69d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:24.826445 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ca887cc9-5239-473c-8644-b46d7a2ce69d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.094795 Jul 14 16:00:24.827097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 593/1286] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:24 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:24.837293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a8be609e-06ad-4efd-b2d3-bc872c6cf536 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:24.839495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a8be609e-06ad-4efd-b2d3-bc872c6cf536 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:24.846331 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8be609e-06ad-4efd-b2d3-bc872c6cf536 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.846781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8be609e-06ad-4efd-b2d3-bc872c6cf536 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.847551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8be609e-06ad-4efd-b2d3-bc872c6cf536 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:24.848387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8be609e-06ad-4efd-b2d3-bc872c6cf536 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:24.866587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:24.880608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a8be609e-06ad-4efd-b2d3-bc872c6cf536 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050644 Jul 14 16:00:24.881171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 694/1287] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:24 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:25.749958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0459cea2-49e3-46da-a38c-2064a9f4311e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:25.750875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0459cea2-49e3-46da-a38c-2064a9f4311e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:25.757560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0459cea2-49e3-46da-a38c-2064a9f4311e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.758015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0459cea2-49e3-46da-a38c-2064a9f4311e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.758786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0459cea2-49e3-46da-a38c-2064a9f4311e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.759228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0459cea2-49e3-46da-a38c-2064a9f4311e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.789528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0459cea2-49e3-46da-a38c-2064a9f4311e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043494 Jul 14 16:00:25.790081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 594/1288] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:25 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:25.844372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d746f84e-32cd-48a5-993b-6eb885d6559f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:25.844994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d746f84e-32cd-48a5-993b-6eb885d6559f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:25.851461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d746f84e-32cd-48a5-993b-6eb885d6559f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.851948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d746f84e-32cd-48a5-993b-6eb885d6559f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.852712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d746f84e-32cd-48a5-993b-6eb885d6559f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.853153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d746f84e-32cd-48a5-993b-6eb885d6559f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.893429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1a508b4c-c252-45e0-8053-487488989c33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:25.894362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1a508b4c-c252-45e0-8053-487488989c33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:25.901035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1a508b4c-c252-45e0-8053-487488989c33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.902634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1a508b4c-c252-45e0-8053-487488989c33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.903504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1a508b4c-c252-45e0-8053-487488989c33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:25.903974 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1a508b4c-c252-45e0-8053-487488989c33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:25.916880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d746f84e-32cd-48a5-993b-6eb885d6559f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:25.924645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d746f84e-32cd-48a5-993b-6eb885d6559f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084127 Jul 14 16:00:25.925218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 695/1289] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:25 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:25.936027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1a508b4c-c252-45e0-8053-487488989c33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046539 Jul 14 16:00:25.936601 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 595/1290] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:25 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:26.801622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-280c9ae1-b8f0-428c-a549-23b7a8a1dccf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:26.802537 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-280c9ae1-b8f0-428c-a549-23b7a8a1dccf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:26.809244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-280c9ae1-b8f0-428c-a549-23b7a8a1dccf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.809695 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-280c9ae1-b8f0-428c-a549-23b7a8a1dccf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.810452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-280c9ae1-b8f0-428c-a549-23b7a8a1dccf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.810887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-280c9ae1-b8f0-428c-a549-23b7a8a1dccf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.840389 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-280c9ae1-b8f0-428c-a549-23b7a8a1dccf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042700 Jul 14 16:00:26.840965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 696/1291] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:26 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:26.941720 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3ac1750b-6423-46a1-8155-5781c3b9ba7e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:26.942326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3ac1750b-6423-46a1-8155-5781c3b9ba7e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:26.947689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-06c8e3a8-2d68-4476-a86a-a5e99507f154 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:26.948814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3ac1750b-6423-46a1-8155-5781c3b9ba7e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.949001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-06c8e3a8-2d68-4476-a86a-a5e99507f154 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:26.949261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3ac1750b-6423-46a1-8155-5781c3b9ba7e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.950035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3ac1750b-6423-46a1-8155-5781c3b9ba7e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.950469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3ac1750b-6423-46a1-8155-5781c3b9ba7e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.956138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06c8e3a8-2d68-4476-a86a-a5e99507f154 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.956594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06c8e3a8-2d68-4476-a86a-a5e99507f154 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.957378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06c8e3a8-2d68-4476-a86a-a5e99507f154 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:26.957819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06c8e3a8-2d68-4476-a86a-a5e99507f154 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:26.991178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-06c8e3a8-2d68-4476-a86a-a5e99507f154 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046856 Jul 14 16:00:26.991415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 697/1292] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:26 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:27.017770 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3ac1750b-6423-46a1-8155-5781c3b9ba7e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:27.025517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3ac1750b-6423-46a1-8155-5781c3b9ba7e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088327 Jul 14 16:00:27.026741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 596/1293] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:26 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:27.852232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3f48528c-6ea7-4d63-b7aa-72fb8395d7a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:27.853160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3f48528c-6ea7-4d63-b7aa-72fb8395d7a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:27.859361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f48528c-6ea7-4d63-b7aa-72fb8395d7a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.859849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f48528c-6ea7-4d63-b7aa-72fb8395d7a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.860608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f48528c-6ea7-4d63-b7aa-72fb8395d7a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:27.861037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f48528c-6ea7-4d63-b7aa-72fb8395d7a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:27.890439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3f48528c-6ea7-4d63-b7aa-72fb8395d7a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042154 Jul 14 16:00:27.890996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 698/1294] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:27 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:28.004441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-769612be-9862-4012-8556-68ac9fd89b98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:28.005790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-769612be-9862-4012-8556-68ac9fd89b98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:28.015103 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-769612be-9862-4012-8556-68ac9fd89b98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.015950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-769612be-9862-4012-8556-68ac9fd89b98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.017105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-769612be-9862-4012-8556-68ac9fd89b98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.017766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-769612be-9862-4012-8556-68ac9fd89b98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.044080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e8e3209a-5551-4b9d-91a4-4c3ba3566bbb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:28.044754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e8e3209a-5551-4b9d-91a4-4c3ba3566bbb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:28.051177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e8e3209a-5551-4b9d-91a4-4c3ba3566bbb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.051699 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e8e3209a-5551-4b9d-91a4-4c3ba3566bbb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.052487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e8e3209a-5551-4b9d-91a4-4c3ba3566bbb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.052925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e8e3209a-5551-4b9d-91a4-4c3ba3566bbb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.056067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-769612be-9862-4012-8556-68ac9fd89b98 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057070 Jul 14 16:00:28.056798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 597/1295] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:27 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:28.118158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e8e3209a-5551-4b9d-91a4-4c3ba3566bbb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:28.125760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e8e3209a-5551-4b9d-91a4-4c3ba3566bbb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086251 Jul 14 16:00:28.126328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 699/1296] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:28 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:28.902277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a52a7106-1e23-4e35-8133-9cae96e7b129 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:28.903384 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a52a7106-1e23-4e35-8133-9cae96e7b129 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:28.914671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a52a7106-1e23-4e35-8133-9cae96e7b129 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.915129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a52a7106-1e23-4e35-8133-9cae96e7b129 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.916194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a52a7106-1e23-4e35-8133-9cae96e7b129 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:28.917126 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a52a7106-1e23-4e35-8133-9cae96e7b129 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:28.947798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a52a7106-1e23-4e35-8133-9cae96e7b129 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049824 Jul 14 16:00:28.948683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 598/1297] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:28 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:29.068512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b5da37f8-4012-47d7-b63c-96d18624bf27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:29.069463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b5da37f8-4012-47d7-b63c-96d18624bf27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:29.081300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b5da37f8-4012-47d7-b63c-96d18624bf27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.081756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b5da37f8-4012-47d7-b63c-96d18624bf27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.082535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b5da37f8-4012-47d7-b63c-96d18624bf27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.082977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b5da37f8-4012-47d7-b63c-96d18624bf27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.113381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b5da37f8-4012-47d7-b63c-96d18624bf27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048861 Jul 14 16:00:29.113947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 700/1298] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:29 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:29.142694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d50539b5-bd1a-4599-a963-499472defdd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:29.143313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d50539b5-bd1a-4599-a963-499472defdd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:29.149901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d50539b5-bd1a-4599-a963-499472defdd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.150353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d50539b5-bd1a-4599-a963-499472defdd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.151661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d50539b5-bd1a-4599-a963-499472defdd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.152084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d50539b5-bd1a-4599-a963-499472defdd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.217750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d50539b5-bd1a-4599-a963-499472defdd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:29.230613 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d50539b5-bd1a-4599-a963-499472defdd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.091579 Jul 14 16:00:29.231198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 599/1299] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:29 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:29.959846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-05faa145-d6e1-4447-8efc-feba8c2f3ece tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:29.960766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-05faa145-d6e1-4447-8efc-feba8c2f3ece tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:29.967818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05faa145-d6e1-4447-8efc-feba8c2f3ece tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.968280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05faa145-d6e1-4447-8efc-feba8c2f3ece tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:29.969056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05faa145-d6e1-4447-8efc-feba8c2f3ece tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:29.969499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05faa145-d6e1-4447-8efc-feba8c2f3ece tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.000542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-05faa145-d6e1-4447-8efc-feba8c2f3ece tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044618 Jul 14 16:00:30.001043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 701/1300] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:29 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:30.125051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8f60e543-6cc0-4a3d-8316-130cfef57492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:30.126148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8f60e543-6cc0-4a3d-8316-130cfef57492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:30.128050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:30.133437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f60e543-6cc0-4a3d-8316-130cfef57492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.133889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f60e543-6cc0-4a3d-8316-130cfef57492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.134664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f60e543-6cc0-4a3d-8316-130cfef57492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.135099 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f60e543-6cc0-4a3d-8316-130cfef57492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.168323 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8f60e543-6cc0-4a3d-8316-130cfef57492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045926 Jul 14 16:00:30.169033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 600/1301] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:30 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:30.247634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-30bac13e-9340-4a67-9b64-3ab933b3157c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:30.248268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-30bac13e-9340-4a67-9b64-3ab933b3157c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:30.254867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30bac13e-9340-4a67-9b64-3ab933b3157c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.255331 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30bac13e-9340-4a67-9b64-3ab933b3157c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.256136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30bac13e-9340-4a67-9b64-3ab933b3157c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:30.256579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30bac13e-9340-4a67-9b64-3ab933b3157c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:30.327495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-30bac13e-9340-4a67-9b64-3ab933b3157c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:30.335309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-30bac13e-9340-4a67-9b64-3ab933b3157c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.091636 Jul 14 16:00:30.335912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 702/1302] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:30 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:31.015975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-394f8d6a-8097-48bf-949a-f71c08fdcf56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:31.016918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-394f8d6a-8097-48bf-949a-f71c08fdcf56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:31.024969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-394f8d6a-8097-48bf-949a-f71c08fdcf56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.025461 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-394f8d6a-8097-48bf-949a-f71c08fdcf56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.026408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-394f8d6a-8097-48bf-949a-f71c08fdcf56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.026408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-394f8d6a-8097-48bf-949a-f71c08fdcf56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.058492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-394f8d6a-8097-48bf-949a-f71c08fdcf56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050044 Jul 14 16:00:31.059092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 601/1303] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:31 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:31.180433 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-39cd2956-79ca-4be5-8534-a279e5bab098 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:31.181368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-39cd2956-79ca-4be5-8534-a279e5bab098 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:31.188668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-39cd2956-79ca-4be5-8534-a279e5bab098 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.189120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-39cd2956-79ca-4be5-8534-a279e5bab098 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.189898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-39cd2956-79ca-4be5-8534-a279e5bab098 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.190390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-39cd2956-79ca-4be5-8534-a279e5bab098 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.223259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-39cd2956-79ca-4be5-8534-a279e5bab098 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046938 Jul 14 16:00:31.223892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 703/1304] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:31 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:31.354291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-00f07d69-efa6-412b-aeba-8f84446065a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:31.355558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-00f07d69-efa6-412b-aeba-8f84446065a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:31.362077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-00f07d69-efa6-412b-aeba-8f84446065a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.362538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-00f07d69-efa6-412b-aeba-8f84446065a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.363295 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-00f07d69-efa6-412b-aeba-8f84446065a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:31.363783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-00f07d69-efa6-412b-aeba-8f84446065a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:31.427794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-00f07d69-efa6-412b-aeba-8f84446065a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:31.435300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-00f07d69-efa6-412b-aeba-8f84446065a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085521 Jul 14 16:00:31.435894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 602/1305] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:31 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:32.069451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d23cd37d-3d23-4a47-af44-c6dca98696af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:32.070380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d23cd37d-3d23-4a47-af44-c6dca98696af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:32.077256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d23cd37d-3d23-4a47-af44-c6dca98696af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.078177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d23cd37d-3d23-4a47-af44-c6dca98696af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.078479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d23cd37d-3d23-4a47-af44-c6dca98696af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.078914 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d23cd37d-3d23-4a47-af44-c6dca98696af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.110724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d23cd37d-3d23-4a47-af44-c6dca98696af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045089 Jul 14 16:00:32.111519 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 704/1306] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:32 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:32.235712 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ed691fcd-83a7-4243-9337-73551371bca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:32.236642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ed691fcd-83a7-4243-9337-73551371bca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:32.242733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed691fcd-83a7-4243-9337-73551371bca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.243189 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed691fcd-83a7-4243-9337-73551371bca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.243990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed691fcd-83a7-4243-9337-73551371bca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.244439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ed691fcd-83a7-4243-9337-73551371bca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.273292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ed691fcd-83a7-4243-9337-73551371bca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041508 Jul 14 16:00:32.273780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 603/1307] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:32 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:32.452917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-93917f64-a517-4888-8e52-7de9a6b54cb8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:32.453533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-93917f64-a517-4888-8e52-7de9a6b54cb8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:32.459633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93917f64-a517-4888-8e52-7de9a6b54cb8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.460082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93917f64-a517-4888-8e52-7de9a6b54cb8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.460846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93917f64-a517-4888-8e52-7de9a6b54cb8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:32.461284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93917f64-a517-4888-8e52-7de9a6b54cb8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:32.525258 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-93917f64-a517-4888-8e52-7de9a6b54cb8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:32.533452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-93917f64-a517-4888-8e52-7de9a6b54cb8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084662 Jul 14 16:00:32.534008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 705/1308] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:32 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:33.122557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-74433982-c951-4843-9d65-5cc59086140a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:33.123481 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-74433982-c951-4843-9d65-5cc59086140a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:33.130136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-74433982-c951-4843-9d65-5cc59086140a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.130584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-74433982-c951-4843-9d65-5cc59086140a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.131345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-74433982-c951-4843-9d65-5cc59086140a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.131808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-74433982-c951-4843-9d65-5cc59086140a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.164258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-74433982-c951-4843-9d65-5cc59086140a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045687 Jul 14 16:00:33.164820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 604/1309] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:33 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:33.286289 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0fe01eb3-2ab5-462f-851a-ecb9fcdfb18b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:33.287129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0fe01eb3-2ab5-462f-851a-ecb9fcdfb18b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:33.296475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0fe01eb3-2ab5-462f-851a-ecb9fcdfb18b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.297301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0fe01eb3-2ab5-462f-851a-ecb9fcdfb18b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.299308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0fe01eb3-2ab5-462f-851a-ecb9fcdfb18b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.299795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0fe01eb3-2ab5-462f-851a-ecb9fcdfb18b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.330615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0fe01eb3-2ab5-462f-851a-ecb9fcdfb18b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048686 Jul 14 16:00:33.331190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 706/1310] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:33 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:33.550670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fce77926-0d8f-429e-8a96-860e82ac8127 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:33.551213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fce77926-0d8f-429e-8a96-860e82ac8127 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:33.557905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fce77926-0d8f-429e-8a96-860e82ac8127 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.558369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fce77926-0d8f-429e-8a96-860e82ac8127 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.559374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fce77926-0d8f-429e-8a96-860e82ac8127 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:33.559724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fce77926-0d8f-429e-8a96-860e82ac8127 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:33.578615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:33.624631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fce77926-0d8f-429e-8a96-860e82ac8127 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:33.632139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fce77926-0d8f-429e-8a96-860e82ac8127 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085557 Jul 14 16:00:33.632699 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 605/1311] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:33 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:34.177138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e31bfabd-46b7-4158-8ea5-0e31c2ed8dff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:34.178053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e31bfabd-46b7-4158-8ea5-0e31c2ed8dff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:34.184090 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e31bfabd-46b7-4158-8ea5-0e31c2ed8dff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:34.184538 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e31bfabd-46b7-4158-8ea5-0e31c2ed8dff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.185290 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e31bfabd-46b7-4158-8ea5-0e31c2ed8dff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:34.185722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e31bfabd-46b7-4158-8ea5-0e31c2ed8dff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.215983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e31bfabd-46b7-4158-8ea5-0e31c2ed8dff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 Jul 14 16:00:34.216625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 707/1312] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:34 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:34.343167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f92a146e-f3dc-4096-a2b5-9896e82627ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:34.344034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f92a146e-f3dc-4096-a2b5-9896e82627ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:34.350596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f92a146e-f3dc-4096-a2b5-9896e82627ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:34.351045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f92a146e-f3dc-4096-a2b5-9896e82627ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.351843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f92a146e-f3dc-4096-a2b5-9896e82627ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:34.352280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f92a146e-f3dc-4096-a2b5-9896e82627ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.383654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f92a146e-f3dc-4096-a2b5-9896e82627ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045140 Jul 14 16:00:34.384213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 606/1313] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:34 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:34.650372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-aea804ea-3a01-4418-bed4-2707eac43f80 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:34.651564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-aea804ea-3a01-4418-bed4-2707eac43f80 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:34.658379 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aea804ea-3a01-4418-bed4-2707eac43f80 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:34.658827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aea804ea-3a01-4418-bed4-2707eac43f80 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.659886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aea804ea-3a01-4418-bed4-2707eac43f80 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:34.660325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aea804ea-3a01-4418-bed4-2707eac43f80 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:34.725098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-aea804ea-3a01-4418-bed4-2707eac43f80 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:34.733021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-aea804ea-3a01-4418-bed4-2707eac43f80 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086592 Jul 14 16:00:34.733603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 708/1314] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:34 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:35.228083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b10a36f1-11d7-44a8-a8a3-5e1280f03945 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:35.229027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b10a36f1-11d7-44a8-a8a3-5e1280f03945 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:35.235158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b10a36f1-11d7-44a8-a8a3-5e1280f03945 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.235640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b10a36f1-11d7-44a8-a8a3-5e1280f03945 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.236426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b10a36f1-11d7-44a8-a8a3-5e1280f03945 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.236870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b10a36f1-11d7-44a8-a8a3-5e1280f03945 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.268495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b10a36f1-11d7-44a8-a8a3-5e1280f03945 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044252 Jul 14 16:00:35.268997 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 607/1315] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:35 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:35.399556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4c8da626-75d8-440c-8661-7f380ffef0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:35.401640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4c8da626-75d8-440c-8661-7f380ffef0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:35.412517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4c8da626-75d8-440c-8661-7f380ffef0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.412969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4c8da626-75d8-440c-8661-7f380ffef0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.413978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4c8da626-75d8-440c-8661-7f380ffef0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.414422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4c8da626-75d8-440c-8661-7f380ffef0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.444789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4c8da626-75d8-440c-8661-7f380ffef0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051409 Jul 14 16:00:35.445406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 709/1316] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:35 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:35.750334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6f9cfc28-061e-4f19-a184-488f7372ce59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:35.750965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6f9cfc28-061e-4f19-a184-488f7372ce59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:35.757660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f9cfc28-061e-4f19-a184-488f7372ce59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.758115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f9cfc28-061e-4f19-a184-488f7372ce59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.758885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f9cfc28-061e-4f19-a184-488f7372ce59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:35.759359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f9cfc28-061e-4f19-a184-488f7372ce59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:35.825595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6f9cfc28-061e-4f19-a184-488f7372ce59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:35.833204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6f9cfc28-061e-4f19-a184-488f7372ce59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086790 Jul 14 16:00:35.833772 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 608/1317] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:35 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:36.281173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a533ed82-5e1f-4fe0-9b85-c0b32bef5e5b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:36.282096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a533ed82-5e1f-4fe0-9b85-c0b32bef5e5b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:36.289033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a533ed82-5e1f-4fe0-9b85-c0b32bef5e5b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.289478 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a533ed82-5e1f-4fe0-9b85-c0b32bef5e5b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.290276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a533ed82-5e1f-4fe0-9b85-c0b32bef5e5b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.290712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a533ed82-5e1f-4fe0-9b85-c0b32bef5e5b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.322250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a533ed82-5e1f-4fe0-9b85-c0b32bef5e5b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045617 Jul 14 16:00:36.323351 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 710/1318] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:36 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:36.458479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ea71e446-9143-4c00-9f01-9288cfbc90f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:36.459394 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ea71e446-9143-4c00-9f01-9288cfbc90f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:36.466278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea71e446-9143-4c00-9f01-9288cfbc90f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.466726 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea71e446-9143-4c00-9f01-9288cfbc90f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.467480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea71e446-9143-4c00-9f01-9288cfbc90f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.467941 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea71e446-9143-4c00-9f01-9288cfbc90f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.498982 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ea71e446-9143-4c00-9f01-9288cfbc90f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044433 Jul 14 16:00:36.499556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 609/1319] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:36 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:36.851086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-064da850-e68e-4f54-920e-118eb93f514c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:36.851629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-064da850-e68e-4f54-920e-118eb93f514c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:36.858415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-064da850-e68e-4f54-920e-118eb93f514c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.858864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-064da850-e68e-4f54-920e-118eb93f514c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.859650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-064da850-e68e-4f54-920e-118eb93f514c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:36.860091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-064da850-e68e-4f54-920e-118eb93f514c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:36.864113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:36.929188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-064da850-e68e-4f54-920e-118eb93f514c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:36.937208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-064da850-e68e-4f54-920e-118eb93f514c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090033 Jul 14 16:00:36.937916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 711/1320] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:36 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:37.334576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-286e96b9-2cce-4e0c-836c-8ecd3e2f7b07 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:37.335533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-286e96b9-2cce-4e0c-836c-8ecd3e2f7b07 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:37.346232 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-286e96b9-2cce-4e0c-836c-8ecd3e2f7b07 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:37.346714 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-286e96b9-2cce-4e0c-836c-8ecd3e2f7b07 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:37.347617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-286e96b9-2cce-4e0c-836c-8ecd3e2f7b07 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:37.348023 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-286e96b9-2cce-4e0c-836c-8ecd3e2f7b07 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:37.379379 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-286e96b9-2cce-4e0c-836c-8ecd3e2f7b07 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048774 Jul 14 16:00:37.379969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 610/1321] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:37 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:37.510649 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dfc54d86-95ab-4d1f-90c8-4a776fd65117 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:37.511811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dfc54d86-95ab-4d1f-90c8-4a776fd65117 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:37.518340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dfc54d86-95ab-4d1f-90c8-4a776fd65117 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:37.518786 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dfc54d86-95ab-4d1f-90c8-4a776fd65117 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:37.519541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dfc54d86-95ab-4d1f-90c8-4a776fd65117 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:37.520070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dfc54d86-95ab-4d1f-90c8-4a776fd65117 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:37.552043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dfc54d86-95ab-4d1f-90c8-4a776fd65117 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045342 Jul 14 16:00:37.552625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 712/1322] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:37 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:37.959360 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-35a57efd-e75a-4b9a-aef1-397fa1eff2ee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:37.959999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-35a57efd-e75a-4b9a-aef1-397fa1eff2ee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:37.967366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35a57efd-e75a-4b9a-aef1-397fa1eff2ee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:37.967853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35a57efd-e75a-4b9a-aef1-397fa1eff2ee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:37.968628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35a57efd-e75a-4b9a-aef1-397fa1eff2ee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:37.969067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35a57efd-e75a-4b9a-aef1-397fa1eff2ee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:38.042038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-35a57efd-e75a-4b9a-aef1-397fa1eff2ee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:38.049856 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-35a57efd-e75a-4b9a-aef1-397fa1eff2ee tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.094482 Jul 14 16:00:38.050473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 611/1323] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:37 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:38.391434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e5297c36-ccb0-4ece-8921-7961bc3b3f92 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:38.392442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e5297c36-ccb0-4ece-8921-7961bc3b3f92 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:38.399944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e5297c36-ccb0-4ece-8921-7961bc3b3f92 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:38.400892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e5297c36-ccb0-4ece-8921-7961bc3b3f92 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:38.401924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e5297c36-ccb0-4ece-8921-7961bc3b3f92 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:38.402731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e5297c36-ccb0-4ece-8921-7961bc3b3f92 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:38.436469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e5297c36-ccb0-4ece-8921-7961bc3b3f92 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049001 Jul 14 16:00:38.437052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 713/1324] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:38 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:38.564466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0dc45ce8-8241-4b86-84e8-0d38ee53013f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:38.565326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0dc45ce8-8241-4b86-84e8-0d38ee53013f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:38.571926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0dc45ce8-8241-4b86-84e8-0d38ee53013f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:38.572381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0dc45ce8-8241-4b86-84e8-0d38ee53013f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:38.573933 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0dc45ce8-8241-4b86-84e8-0d38ee53013f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:38.574383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0dc45ce8-8241-4b86-84e8-0d38ee53013f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:38.604259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0dc45ce8-8241-4b86-84e8-0d38ee53013f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043662 Jul 14 16:00:38.604885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 612/1325] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:38 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:39.066400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e4a2a52b-bfff-45d7-aa41-6c74a8bdf674 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:39.067013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e4a2a52b-bfff-45d7-aa41-6c74a8bdf674 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:39.074484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4a2a52b-bfff-45d7-aa41-6c74a8bdf674 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:39.074940 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4a2a52b-bfff-45d7-aa41-6c74a8bdf674 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:39.078839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4a2a52b-bfff-45d7-aa41-6c74a8bdf674 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:39.078839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4a2a52b-bfff-45d7-aa41-6c74a8bdf674 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:39.146419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e4a2a52b-bfff-45d7-aa41-6c74a8bdf674 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:39.155399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e4a2a52b-bfff-45d7-aa41-6c74a8bdf674 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.092861 Jul 14 16:00:39.156009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 714/1326] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:39 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:39.448913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b701bb7a-d988-4376-9aac-777d46a97a98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:39.449961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b701bb7a-d988-4376-9aac-777d46a97a98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:39.456480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b701bb7a-d988-4376-9aac-777d46a97a98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:39.456964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b701bb7a-d988-4376-9aac-777d46a97a98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:39.457789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b701bb7a-d988-4376-9aac-777d46a97a98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:39.458361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b701bb7a-d988-4376-9aac-777d46a97a98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:39.493762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b701bb7a-d988-4376-9aac-777d46a97a98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049296 Jul 14 16:00:39.494335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 613/1327] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:39 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:39.616391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c5662ccb-b756-43e6-8b24-42b5d287551d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:39.617312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c5662ccb-b756-43e6-8b24-42b5d287551d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:39.624753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5662ccb-b756-43e6-8b24-42b5d287551d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:39.625228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5662ccb-b756-43e6-8b24-42b5d287551d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:39.626104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5662ccb-b756-43e6-8b24-42b5d287551d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:39.626435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5662ccb-b756-43e6-8b24-42b5d287551d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:39.658129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c5662ccb-b756-43e6-8b24-42b5d287551d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045649 Jul 14 16:00:39.658691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 715/1328] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:39 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:40.174524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8cb7a99a-5c54-4775-860d-8fe884d6eaaa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:40.175130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8cb7a99a-5c54-4775-860d-8fe884d6eaaa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:40.181696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8cb7a99a-5c54-4775-860d-8fe884d6eaaa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:40.182139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8cb7a99a-5c54-4775-860d-8fe884d6eaaa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:40.182913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8cb7a99a-5c54-4775-860d-8fe884d6eaaa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:40.183340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8cb7a99a-5c54-4775-860d-8fe884d6eaaa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:40.250736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8cb7a99a-5c54-4775-860d-8fe884d6eaaa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:40.259123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8cb7a99a-5c54-4775-860d-8fe884d6eaaa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088566 Jul 14 16:00:40.259705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 614/1329] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:40 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:40.507277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-de051a7b-4799-4106-a50a-44e400c04592 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:40.508131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-de051a7b-4799-4106-a50a-44e400c04592 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:40.516511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de051a7b-4799-4106-a50a-44e400c04592 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:40.517180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de051a7b-4799-4106-a50a-44e400c04592 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:40.518016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de051a7b-4799-4106-a50a-44e400c04592 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:40.518512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de051a7b-4799-4106-a50a-44e400c04592 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:40.550894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-de051a7b-4799-4106-a50a-44e400c04592 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048311 Jul 14 16:00:40.551473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 716/1330] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:40 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:40.670049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8a9eab69-b3cb-4b21-ad59-c962f4efc60d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:40.671044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8a9eab69-b3cb-4b21-ad59-c962f4efc60d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:40.677357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a9eab69-b3cb-4b21-ad59-c962f4efc60d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:40.677800 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a9eab69-b3cb-4b21-ad59-c962f4efc60d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:40.678562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a9eab69-b3cb-4b21-ad59-c962f4efc60d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:40.679104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a9eab69-b3cb-4b21-ad59-c962f4efc60d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:40.711207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8a9eab69-b3cb-4b21-ad59-c962f4efc60d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045217 Jul 14 16:00:40.711773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 615/1331] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:40 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:41.277783 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2955bca3-005b-4ec3-8dbd-491720bdc133 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:41.278297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2955bca3-005b-4ec3-8dbd-491720bdc133 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:41.284866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2955bca3-005b-4ec3-8dbd-491720bdc133 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.285312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2955bca3-005b-4ec3-8dbd-491720bdc133 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.286079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2955bca3-005b-4ec3-8dbd-491720bdc133 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.286513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2955bca3-005b-4ec3-8dbd-491720bdc133 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.350078 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2955bca3-005b-4ec3-8dbd-491720bdc133 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:41.358950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2955bca3-005b-4ec3-8dbd-491720bdc133 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085770 Jul 14 16:00:41.359521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 717/1332] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:41 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:41.562928 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e3ac8c91-6147-4405-9ff1-ef27250adb4b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:41.563796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e3ac8c91-6147-4405-9ff1-ef27250adb4b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:41.570260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e3ac8c91-6147-4405-9ff1-ef27250adb4b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.570792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e3ac8c91-6147-4405-9ff1-ef27250adb4b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.571652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e3ac8c91-6147-4405-9ff1-ef27250adb4b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.572025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e3ac8c91-6147-4405-9ff1-ef27250adb4b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.602688 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e3ac8c91-6147-4405-9ff1-ef27250adb4b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044012 Jul 14 16:00:41.603254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 616/1333] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:41 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:41.723193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c66cb93d-4475-4cec-94ab-fb1dc9b0ce58 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:41.724174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c66cb93d-4475-4cec-94ab-fb1dc9b0ce58 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:41.731563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c66cb93d-4475-4cec-94ab-fb1dc9b0ce58 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.732040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c66cb93d-4475-4cec-94ab-fb1dc9b0ce58 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.732805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c66cb93d-4475-4cec-94ab-fb1dc9b0ce58 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:41.733236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c66cb93d-4475-4cec-94ab-fb1dc9b0ce58 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:41.762457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c66cb93d-4475-4cec-94ab-fb1dc9b0ce58 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Jul 14 16:00:41.763027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 718/1334] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:41 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:42.376576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ad5a8721-8c71-4205-b471-f297ea1a38b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:42.377101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ad5a8721-8c71-4205-b471-f297ea1a38b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:42.383627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ad5a8721-8c71-4205-b471-f297ea1a38b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.384069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ad5a8721-8c71-4205-b471-f297ea1a38b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.384828 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ad5a8721-8c71-4205-b471-f297ea1a38b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.385912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ad5a8721-8c71-4205-b471-f297ea1a38b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.449601 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ad5a8721-8c71-4205-b471-f297ea1a38b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:42.457442 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ad5a8721-8c71-4205-b471-f297ea1a38b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085064 Jul 14 16:00:42.458019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 617/1335] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:42 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:42.615453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f9def6ee-ebe6-42a5-bdc6-413c6185444e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:42.616390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f9def6ee-ebe6-42a5-bdc6-413c6185444e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:42.623307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9def6ee-ebe6-42a5-bdc6-413c6185444e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.623795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9def6ee-ebe6-42a5-bdc6-413c6185444e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.624554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9def6ee-ebe6-42a5-bdc6-413c6185444e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.624982 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f9def6ee-ebe6-42a5-bdc6-413c6185444e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.653563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f9def6ee-ebe6-42a5-bdc6-413c6185444e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042179 Jul 14 16:00:42.654116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 719/1336] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:42 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:42.774217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a896783d-6b24-4bae-9409-1586b4f04d47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:42.775162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a896783d-6b24-4bae-9409-1586b4f04d47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:42.781530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a896783d-6b24-4bae-9409-1586b4f04d47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.781983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a896783d-6b24-4bae-9409-1586b4f04d47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.782745 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a896783d-6b24-4bae-9409-1586b4f04d47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:42.783182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a896783d-6b24-4bae-9409-1586b4f04d47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:42.813251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a896783d-6b24-4bae-9409-1586b4f04d47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043056 Jul 14 16:00:42.814021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 618/1337] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:42 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:43.474725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f2d67a83-3bea-40d6-8e34-fb173f5d8efb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:43.475343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f2d67a83-3bea-40d6-8e34-fb173f5d8efb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:43.482096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f2d67a83-3bea-40d6-8e34-fb173f5d8efb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:43.482541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f2d67a83-3bea-40d6-8e34-fb173f5d8efb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:43.483301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f2d67a83-3bea-40d6-8e34-fb173f5d8efb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:43.483771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f2d67a83-3bea-40d6-8e34-fb173f5d8efb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:43.571582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f2d67a83-3bea-40d6-8e34-fb173f5d8efb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:43.581074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f2d67a83-3bea-40d6-8e34-fb173f5d8efb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.110120 Jul 14 16:00:43.581665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 720/1338] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:43 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:43.666989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b6d342df-694e-400d-9ef4-9b9839933336 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:43.668272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b6d342df-694e-400d-9ef4-9b9839933336 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:43.676019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b6d342df-694e-400d-9ef4-9b9839933336 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:43.676019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b6d342df-694e-400d-9ef4-9b9839933336 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:43.676792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b6d342df-694e-400d-9ef4-9b9839933336 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:43.677226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b6d342df-694e-400d-9ef4-9b9839933336 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:43.708873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b6d342df-694e-400d-9ef4-9b9839933336 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047122 Jul 14 16:00:43.709580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 619/1339] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:43 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:43.825690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-62b57ae2-8361-4fc6-801c-90088604db9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:43.826774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-62b57ae2-8361-4fc6-801c-90088604db9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:43.832992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62b57ae2-8361-4fc6-801c-90088604db9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:43.833446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62b57ae2-8361-4fc6-801c-90088604db9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:43.834218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62b57ae2-8361-4fc6-801c-90088604db9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:43.834656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62b57ae2-8361-4fc6-801c-90088604db9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:43.865002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-62b57ae2-8361-4fc6-801c-90088604db9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043839 Jul 14 16:00:43.865494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 721/1340] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:43 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:44.599412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-96787ca7-c6e0-46f1-9c06-9f02547ee97c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:44.600014 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-96787ca7-c6e0-46f1-9c06-9f02547ee97c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:44.607227 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96787ca7-c6e0-46f1-9c06-9f02547ee97c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:44.607706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96787ca7-c6e0-46f1-9c06-9f02547ee97c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:44.608482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96787ca7-c6e0-46f1-9c06-9f02547ee97c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:44.608920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96787ca7-c6e0-46f1-9c06-9f02547ee97c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:44.675820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-96787ca7-c6e0-46f1-9c06-9f02547ee97c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:44.684004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-96787ca7-c6e0-46f1-9c06-9f02547ee97c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088444 Jul 14 16:00:44.684785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 620/1341] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:44 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:44.724879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-73b85370-6a56-4e5c-8765-3f35ea125d6f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:44.726668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-73b85370-6a56-4e5c-8765-3f35ea125d6f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:44.738310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73b85370-6a56-4e5c-8765-3f35ea125d6f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:44.739036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73b85370-6a56-4e5c-8765-3f35ea125d6f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:44.740304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73b85370-6a56-4e5c-8765-3f35ea125d6f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:44.741013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73b85370-6a56-4e5c-8765-3f35ea125d6f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:44.786067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-73b85370-6a56-4e5c-8765-3f35ea125d6f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.068919 Jul 14 16:00:44.786643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 722/1342] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:44 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:44.878546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-32f40bd4-146b-48e1-b530-bf9f36a7158e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:44.879687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-32f40bd4-146b-48e1-b530-bf9f36a7158e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:44.886485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32f40bd4-146b-48e1-b530-bf9f36a7158e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:44.886941 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32f40bd4-146b-48e1-b530-bf9f36a7158e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:44.887760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32f40bd4-146b-48e1-b530-bf9f36a7158e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:44.888203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32f40bd4-146b-48e1-b530-bf9f36a7158e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:44.919169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-32f40bd4-146b-48e1-b530-bf9f36a7158e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Jul 14 16:00:44.919777 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 621/1343] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:44 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:45.700975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-895a8c7d-21d2-4432-b1a7-a4dcc576eb9e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:45.701589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-895a8c7d-21d2-4432-b1a7-a4dcc576eb9e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:45.707794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-895a8c7d-21d2-4432-b1a7-a4dcc576eb9e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:45.708244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-895a8c7d-21d2-4432-b1a7-a4dcc576eb9e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:45.709004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-895a8c7d-21d2-4432-b1a7-a4dcc576eb9e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:45.709439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-895a8c7d-21d2-4432-b1a7-a4dcc576eb9e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:45.772276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-895a8c7d-21d2-4432-b1a7-a4dcc576eb9e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:45.780427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-895a8c7d-21d2-4432-b1a7-a4dcc576eb9e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083586 Jul 14 16:00:45.781010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 723/1344] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:45 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:45.802647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a0a18dcd-5bfc-4777-ba6b-cf78c5098b55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:45.804228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a0a18dcd-5bfc-4777-ba6b-cf78c5098b55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:45.815251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a0a18dcd-5bfc-4777-ba6b-cf78c5098b55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:45.816012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a0a18dcd-5bfc-4777-ba6b-cf78c5098b55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:45.817180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a0a18dcd-5bfc-4777-ba6b-cf78c5098b55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:45.817805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a0a18dcd-5bfc-4777-ba6b-cf78c5098b55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:45.823081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:45.858599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a0a18dcd-5bfc-4777-ba6b-cf78c5098b55 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062833 Jul 14 16:00:45.859169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 622/1345] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:45 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:45.930576 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8bfe5eeb-a7b2-4794-a28c-20764d40d078 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:45.931493 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8bfe5eeb-a7b2-4794-a28c-20764d40d078 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:45.938219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8bfe5eeb-a7b2-4794-a28c-20764d40d078 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:45.938697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8bfe5eeb-a7b2-4794-a28c-20764d40d078 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:45.939455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8bfe5eeb-a7b2-4794-a28c-20764d40d078 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:45.939909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8bfe5eeb-a7b2-4794-a28c-20764d40d078 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:45.970028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8bfe5eeb-a7b2-4794-a28c-20764d40d078 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043307 Jul 14 16:00:45.970640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 724/1346] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:45 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:46.798273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-beb2e0c4-f20f-4404-a655-c48efbe6988a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:46.798882 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-beb2e0c4-f20f-4404-a655-c48efbe6988a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:46.804968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-beb2e0c4-f20f-4404-a655-c48efbe6988a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:46.805567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-beb2e0c4-f20f-4404-a655-c48efbe6988a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:46.806163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-beb2e0c4-f20f-4404-a655-c48efbe6988a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:46.806599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-beb2e0c4-f20f-4404-a655-c48efbe6988a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:46.870508 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-beb2e0c4-f20f-4404-a655-c48efbe6988a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:46.870676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b0e6a8ab-86bb-4709-8dd2-e58987e17961 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:46.871530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b0e6a8ab-86bb-4709-8dd2-e58987e17961 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:46.878274 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-beb2e0c4-f20f-4404-a655-c48efbe6988a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083841 Jul 14 16:00:46.878462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0e6a8ab-86bb-4709-8dd2-e58987e17961 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:46.878735 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0e6a8ab-86bb-4709-8dd2-e58987e17961 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:46.879024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 623/1347] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:46 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:46.879498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0e6a8ab-86bb-4709-8dd2-e58987e17961 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:46.879962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0e6a8ab-86bb-4709-8dd2-e58987e17961 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:46.911207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b0e6a8ab-86bb-4709-8dd2-e58987e17961 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044791 Jul 14 16:00:46.911986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 725/1348] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:46 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:46.983461 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7c29f56d-919e-45a3-b1f4-5d5a9bcd378f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:46.984456 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7c29f56d-919e-45a3-b1f4-5d5a9bcd378f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:46.992631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c29f56d-919e-45a3-b1f4-5d5a9bcd378f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:46.993084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c29f56d-919e-45a3-b1f4-5d5a9bcd378f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:46.993858 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c29f56d-919e-45a3-b1f4-5d5a9bcd378f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:46.994373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c29f56d-919e-45a3-b1f4-5d5a9bcd378f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:47.024037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7c29f56d-919e-45a3-b1f4-5d5a9bcd378f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045083 Jul 14 16:00:47.024580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 624/1349] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:46 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:47.895229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-972b1dd8-db7c-4f97-86f2-582423a3d86d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:47.895954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-972b1dd8-db7c-4f97-86f2-582423a3d86d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:47.902704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-972b1dd8-db7c-4f97-86f2-582423a3d86d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:47.903148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-972b1dd8-db7c-4f97-86f2-582423a3d86d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:47.903956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-972b1dd8-db7c-4f97-86f2-582423a3d86d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:47.904401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-972b1dd8-db7c-4f97-86f2-582423a3d86d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:47.923771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b7743766-d70a-412e-b6f9-1d8bd277c564 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:47.925306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b7743766-d70a-412e-b6f9-1d8bd277c564 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:47.931509 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7743766-d70a-412e-b6f9-1d8bd277c564 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:47.933196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7743766-d70a-412e-b6f9-1d8bd277c564 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:47.934006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7743766-d70a-412e-b6f9-1d8bd277c564 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:47.934449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7743766-d70a-412e-b6f9-1d8bd277c564 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:47.965721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b7743766-d70a-412e-b6f9-1d8bd277c564 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045828 Jul 14 16:00:47.966509 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 625/1350] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:47 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:47.970271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-972b1dd8-db7c-4f97-86f2-582423a3d86d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:47.977724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-972b1dd8-db7c-4f97-86f2-582423a3d86d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086597 Jul 14 16:00:47.978280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 726/1351] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:47 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:48.036784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3d3da9de-f7a6-47cd-8080-a06f06e549c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:48.037700 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3d3da9de-f7a6-47cd-8080-a06f06e549c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:48.044633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3d3da9de-f7a6-47cd-8080-a06f06e549c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:48.045069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3d3da9de-f7a6-47cd-8080-a06f06e549c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:48.045834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3d3da9de-f7a6-47cd-8080-a06f06e549c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:48.046295 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3d3da9de-f7a6-47cd-8080-a06f06e549c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:48.075877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3d3da9de-f7a6-47cd-8080-a06f06e549c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043374 Jul 14 16:00:48.076437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 626/1352] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:48 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:48.977692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-39a3ab86-6b16-4dda-8bf2-92f98d7244a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:48.978618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-39a3ab86-6b16-4dda-8bf2-92f98d7244a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:48.985198 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-39a3ab86-6b16-4dda-8bf2-92f98d7244a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:48.985678 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-39a3ab86-6b16-4dda-8bf2-92f98d7244a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:48.986455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-39a3ab86-6b16-4dda-8bf2-92f98d7244a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:48.986904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-39a3ab86-6b16-4dda-8bf2-92f98d7244a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:48.998768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7b282e07-3b7f-44ed-8b3e-5e5e915eed46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:48.999233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7b282e07-3b7f-44ed-8b3e-5e5e915eed46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:49.005672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b282e07-3b7f-44ed-8b3e-5e5e915eed46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.006210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b282e07-3b7f-44ed-8b3e-5e5e915eed46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.006999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b282e07-3b7f-44ed-8b3e-5e5e915eed46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.007561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b282e07-3b7f-44ed-8b3e-5e5e915eed46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.015793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:49.021222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-39a3ab86-6b16-4dda-8bf2-92f98d7244a4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047620 Jul 14 16:00:49.021821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 727/1353] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:48 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:49.075935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7b282e07-3b7f-44ed-8b3e-5e5e915eed46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:49.086185 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7b282e07-3b7f-44ed-8b3e-5e5e915eed46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.092774 Jul 14 16:00:49.086767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 627/1354] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:48 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:49.098037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a156fc1a-e6c9-4521-bd60-ef1979f1538f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:49.098993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a156fc1a-e6c9-4521-bd60-ef1979f1538f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:49.106079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a156fc1a-e6c9-4521-bd60-ef1979f1538f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.106521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a156fc1a-e6c9-4521-bd60-ef1979f1538f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.107285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a156fc1a-e6c9-4521-bd60-ef1979f1538f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:49.107763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a156fc1a-e6c9-4521-bd60-ef1979f1538f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:49.139907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a156fc1a-e6c9-4521-bd60-ef1979f1538f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046463 Jul 14 16:00:49.140479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 728/1355] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:49 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:50.033994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-06684917-cd0a-4573-ae7d-69305a169457 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:50.035169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-06684917-cd0a-4573-ae7d-69305a169457 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:50.044271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06684917-cd0a-4573-ae7d-69305a169457 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:50.044725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06684917-cd0a-4573-ae7d-69305a169457 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:50.046035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06684917-cd0a-4573-ae7d-69305a169457 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:50.046765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06684917-cd0a-4573-ae7d-69305a169457 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:50.082049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-06684917-cd0a-4573-ae7d-69305a169457 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052621 Jul 14 16:00:50.082640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 628/1356] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:50 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:50.103742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-331095a6-4132-42d1-a7cc-81503933fdbc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:50.104414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-331095a6-4132-42d1-a7cc-81503933fdbc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:50.112819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-331095a6-4132-42d1-a7cc-81503933fdbc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:50.113276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-331095a6-4132-42d1-a7cc-81503933fdbc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:50.114188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-331095a6-4132-42d1-a7cc-81503933fdbc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:50.114676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-331095a6-4132-42d1-a7cc-81503933fdbc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:50.153725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6233003f-ce47-40e1-b6f2-4e98e99e1463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:50.154770 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6233003f-ce47-40e1-b6f2-4e98e99e1463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:50.172556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6233003f-ce47-40e1-b6f2-4e98e99e1463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:50.172556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6233003f-ce47-40e1-b6f2-4e98e99e1463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:50.172556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6233003f-ce47-40e1-b6f2-4e98e99e1463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:50.172556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6233003f-ce47-40e1-b6f2-4e98e99e1463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:50.187521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-331095a6-4132-42d1-a7cc-81503933fdbc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:50.196730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-331095a6-4132-42d1-a7cc-81503933fdbc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.096925 Jul 14 16:00:50.197812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 729/1357] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:50 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:50.207571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6233003f-ce47-40e1-b6f2-4e98e99e1463 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059322 Jul 14 16:00:50.208167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 629/1358] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:50 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:51.094510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2a718dfe-fd95-4831-94c5-20102f041805 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:51.095428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2a718dfe-fd95-4831-94c5-20102f041805 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:51.101665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a718dfe-fd95-4831-94c5-20102f041805 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:51.102117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a718dfe-fd95-4831-94c5-20102f041805 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:51.102910 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a718dfe-fd95-4831-94c5-20102f041805 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:51.103339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a718dfe-fd95-4831-94c5-20102f041805 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:51.136137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2a718dfe-fd95-4831-94c5-20102f041805 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045449 Jul 14 16:00:51.136853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 730/1359] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:51 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:51.214936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3bf05c9e-b6f2-48a6-ab73-84bd14f98256 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:51.216016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3bf05c9e-b6f2-48a6-ab73-84bd14f98256 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:51.220049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2472f7db-c5f4-4b67-a7e0-25939945c64d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:51.220893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2472f7db-c5f4-4b67-a7e0-25939945c64d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:51.223236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bf05c9e-b6f2-48a6-ab73-84bd14f98256 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:51.223722 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bf05c9e-b6f2-48a6-ab73-84bd14f98256 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:51.224533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bf05c9e-b6f2-48a6-ab73-84bd14f98256 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:51.225004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bf05c9e-b6f2-48a6-ab73-84bd14f98256 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:51.227106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2472f7db-c5f4-4b67-a7e0-25939945c64d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:51.227868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2472f7db-c5f4-4b67-a7e0-25939945c64d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:51.229264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2472f7db-c5f4-4b67-a7e0-25939945c64d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:51.229716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2472f7db-c5f4-4b67-a7e0-25939945c64d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:51.260764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2472f7db-c5f4-4b67-a7e0-25939945c64d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045651 Jul 14 16:00:51.261416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 731/1360] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:51 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:00:51.292880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3bf05c9e-b6f2-48a6-ab73-84bd14f98256 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:51.300547 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3bf05c9e-b6f2-48a6-ab73-84bd14f98256 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090002 Jul 14 16:00:51.301116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 630/1361] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:51 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:51.591412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:00:51.591681 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:00:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:00:52.147721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3f6ae2f8-96ec-4e03-84a6-8d352902d9b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:52.148642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3f6ae2f8-96ec-4e03-84a6-8d352902d9b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:52.156038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f6ae2f8-96ec-4e03-84a6-8d352902d9b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:52.156493 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f6ae2f8-96ec-4e03-84a6-8d352902d9b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:52.157255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f6ae2f8-96ec-4e03-84a6-8d352902d9b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:52.157703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f6ae2f8-96ec-4e03-84a6-8d352902d9b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:52.194076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3f6ae2f8-96ec-4e03-84a6-8d352902d9b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050176 Jul 14 16:00:52.194714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 732/1362] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:52 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:52.272771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b008ab6f-c05b-4e62-8433-9c8634a7d3a8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:52.273607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b008ab6f-c05b-4e62-8433-9c8634a7d3a8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:52.281688 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b008ab6f-c05b-4e62-8433-9c8634a7d3a8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:52.282143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b008ab6f-c05b-4e62-8433-9c8634a7d3a8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:52.282932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b008ab6f-c05b-4e62-8433-9c8634a7d3a8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:52.283370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b008ab6f-c05b-4e62-8433-9c8634a7d3a8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:52.317589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fe53e2f4-4c4c-4477-8f59-f452b8ceb3d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:52.318232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fe53e2f4-4c4c-4477-8f59-f452b8ceb3d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:52.319069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b008ab6f-c05b-4e62-8433-9c8634a7d3a8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050310 Jul 14 16:00:52.321767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 631/1363] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:52 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:52.325361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe53e2f4-4c4c-4477-8f59-f452b8ceb3d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:52.325810 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe53e2f4-4c4c-4477-8f59-f452b8ceb3d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:52.326580 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe53e2f4-4c4c-4477-8f59-f452b8ceb3d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:52.327011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe53e2f4-4c4c-4477-8f59-f452b8ceb3d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:52.392805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fe53e2f4-4c4c-4477-8f59-f452b8ceb3d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:52.400342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fe53e2f4-4c4c-4477-8f59-f452b8ceb3d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086553 Jul 14 16:00:52.401802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 733/1364] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:52 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:00:53.206557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ca9daf1c-43be-4ad1-a2c9-97c536dabea7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:53.207504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ca9daf1c-43be-4ad1-a2c9-97c536dabea7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:53.214634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca9daf1c-43be-4ad1-a2c9-97c536dabea7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:53.215092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca9daf1c-43be-4ad1-a2c9-97c536dabea7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:53.215902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca9daf1c-43be-4ad1-a2c9-97c536dabea7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:53.216344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca9daf1c-43be-4ad1-a2c9-97c536dabea7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:53.248048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ca9daf1c-43be-4ad1-a2c9-97c536dabea7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045341 Jul 14 16:00:53.248529 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 632/1365] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:53 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:53.332418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0e4ec6e1-4565-4c4c-9ec2-2fa62866b729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:53.333331 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0e4ec6e1-4565-4c4c-9ec2-2fa62866b729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:53.340641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e4ec6e1-4565-4c4c-9ec2-2fa62866b729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:53.341087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e4ec6e1-4565-4c4c-9ec2-2fa62866b729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:53.341962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e4ec6e1-4565-4c4c-9ec2-2fa62866b729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:53.342402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e4ec6e1-4565-4c4c-9ec2-2fa62866b729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:53.373097 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0e4ec6e1-4565-4c4c-9ec2-2fa62866b729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045205 Jul 14 16:00:53.373665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 734/1366] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:53 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:53.418221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-20d8270a-5515-4d0d-9f0c-1f5df882f245 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:53.418927 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-20d8270a-5515-4d0d-9f0c-1f5df882f245 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:53.425634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-20d8270a-5515-4d0d-9f0c-1f5df882f245 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:53.426082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-20d8270a-5515-4d0d-9f0c-1f5df882f245 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:53.426846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-20d8270a-5515-4d0d-9f0c-1f5df882f245 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:53.427280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-20d8270a-5515-4d0d-9f0c-1f5df882f245 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:53.492735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-20d8270a-5515-4d0d-9f0c-1f5df882f245 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:53.504751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-20d8270a-5515-4d0d-9f0c-1f5df882f245 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090261 Jul 14 16:00:53.505258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 633/1367] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:53 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:54.260683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-479baff9-15b4-4774-af1d-52f991cef1a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:54.261524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-479baff9-15b4-4774-af1d-52f991cef1a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:54.267896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-479baff9-15b4-4774-af1d-52f991cef1a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:54.268342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-479baff9-15b4-4774-af1d-52f991cef1a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:54.269100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-479baff9-15b4-4774-af1d-52f991cef1a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:54.269528 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-479baff9-15b4-4774-af1d-52f991cef1a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:54.300042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-479baff9-15b4-4774-af1d-52f991cef1a1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043981 Jul 14 16:00:54.300603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 735/1368] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:54 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:54.384916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b38551c7-2002-40cf-b2d0-58ebba9413ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:54.386285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b38551c7-2002-40cf-b2d0-58ebba9413ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:54.392500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b38551c7-2002-40cf-b2d0-58ebba9413ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:54.392952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b38551c7-2002-40cf-b2d0-58ebba9413ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:54.393728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b38551c7-2002-40cf-b2d0-58ebba9413ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:54.394174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b38551c7-2002-40cf-b2d0-58ebba9413ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:54.425869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b38551c7-2002-40cf-b2d0-58ebba9413ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044882 Jul 14 16:00:54.426541 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 634/1369] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:54 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:54.522380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-506770d3-a069-46a9-b719-ee8818eceb4a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:54.522950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-506770d3-a069-46a9-b719-ee8818eceb4a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:54.530261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-506770d3-a069-46a9-b719-ee8818eceb4a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:54.530709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-506770d3-a069-46a9-b719-ee8818eceb4a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:54.531501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-506770d3-a069-46a9-b719-ee8818eceb4a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:54.531963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-506770d3-a069-46a9-b719-ee8818eceb4a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:54.594777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-506770d3-a069-46a9-b719-ee8818eceb4a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:54.602364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-506770d3-a069-46a9-b719-ee8818eceb4a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083960 Jul 14 16:00:54.603069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 736/1370] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:54 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:55.312403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-99d1ac83-5fec-4a61-9d97-d13c100feb9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:55.313897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-99d1ac83-5fec-4a61-9d97-d13c100feb9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:55.321348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-99d1ac83-5fec-4a61-9d97-d13c100feb9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:55.321804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-99d1ac83-5fec-4a61-9d97-d13c100feb9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:55.323205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-99d1ac83-5fec-4a61-9d97-d13c100feb9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:55.323795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-99d1ac83-5fec-4a61-9d97-d13c100feb9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:55.353299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-99d1ac83-5fec-4a61-9d97-d13c100feb9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045346 Jul 14 16:00:55.354047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 635/1371] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:55 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:55.437110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5a63676f-61b5-4d86-a8f4-89b63bca7be2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:55.438025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5a63676f-61b5-4d86-a8f4-89b63bca7be2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:55.440046 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=88 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:55.445208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a63676f-61b5-4d86-a8f4-89b63bca7be2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:55.445651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a63676f-61b5-4d86-a8f4-89b63bca7be2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:55.446473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a63676f-61b5-4d86-a8f4-89b63bca7be2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:55.446901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a63676f-61b5-4d86-a8f4-89b63bca7be2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:55.476578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5a63676f-61b5-4d86-a8f4-89b63bca7be2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043305 Jul 14 16:00:55.477045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 737/1372] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:55 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:55.618859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1fde79d5-8ad6-4322-97fa-fccaa30aef87 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:55.619511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1fde79d5-8ad6-4322-97fa-fccaa30aef87 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:55.625938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fde79d5-8ad6-4322-97fa-fccaa30aef87 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:55.626393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fde79d5-8ad6-4322-97fa-fccaa30aef87 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:55.627159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fde79d5-8ad6-4322-97fa-fccaa30aef87 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:55.627615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fde79d5-8ad6-4322-97fa-fccaa30aef87 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:55.689673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1fde79d5-8ad6-4322-97fa-fccaa30aef87 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:55.697162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1fde79d5-8ad6-4322-97fa-fccaa30aef87 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082211 Jul 14 16:00:55.698453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 636/1373] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:55 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:56.364877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3f46db94-70e3-4d63-ad03-e078c8ea73b8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:56.365704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3f46db94-70e3-4d63-ad03-e078c8ea73b8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:56.373847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f46db94-70e3-4d63-ad03-e078c8ea73b8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:56.374296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f46db94-70e3-4d63-ad03-e078c8ea73b8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:56.375073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f46db94-70e3-4d63-ad03-e078c8ea73b8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:56.375501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f46db94-70e3-4d63-ad03-e078c8ea73b8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:56.411325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3f46db94-70e3-4d63-ad03-e078c8ea73b8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050441 Jul 14 16:00:56.411933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 738/1374] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:56 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:56.488298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b217e531-c541-465c-b64c-00a0e93c361f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:56.489212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b217e531-c541-465c-b64c-00a0e93c361f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:56.495314 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b217e531-c541-465c-b64c-00a0e93c361f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:56.496175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b217e531-c541-465c-b64c-00a0e93c361f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:56.496582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b217e531-c541-465c-b64c-00a0e93c361f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:56.497023 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b217e531-c541-465c-b64c-00a0e93c361f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:56.526691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b217e531-c541-465c-b64c-00a0e93c361f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042299 Jul 14 16:00:56.527258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 637/1375] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:56 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:56.715716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e2362da5-036e-4639-88c4-fef7ae685ff2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:56.716337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e2362da5-036e-4639-88c4-fef7ae685ff2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:56.722330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e2362da5-036e-4639-88c4-fef7ae685ff2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:56.722777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e2362da5-036e-4639-88c4-fef7ae685ff2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:56.723537 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e2362da5-036e-4639-88c4-fef7ae685ff2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:56.724011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e2362da5-036e-4639-88c4-fef7ae685ff2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:56.787011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e2362da5-036e-4639-88c4-fef7ae685ff2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:56.796474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e2362da5-036e-4639-88c4-fef7ae685ff2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085207 Jul 14 16:00:56.797059 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 739/1376] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:56 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:57.423440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2ba83ffc-cd9a-4626-a1ca-ce27ef3d8edd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:57.424399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2ba83ffc-cd9a-4626-a1ca-ce27ef3d8edd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:57.431064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2ba83ffc-cd9a-4626-a1ca-ce27ef3d8edd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:57.432024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2ba83ffc-cd9a-4626-a1ca-ce27ef3d8edd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:57.433122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2ba83ffc-cd9a-4626-a1ca-ce27ef3d8edd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:57.433560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2ba83ffc-cd9a-4626-a1ca-ce27ef3d8edd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:57.459143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:00:57.464960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2ba83ffc-cd9a-4626-a1ca-ce27ef3d8edd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045677 Jul 14 16:00:57.465534 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 638/1377] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:57 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:57.538657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1409dc6a-99df-4604-a2bb-f30c0918ada4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:57.539574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1409dc6a-99df-4604-a2bb-f30c0918ada4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:57.546392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1409dc6a-99df-4604-a2bb-f30c0918ada4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:57.547566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1409dc6a-99df-4604-a2bb-f30c0918ada4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:57.547566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1409dc6a-99df-4604-a2bb-f30c0918ada4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:57.548041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1409dc6a-99df-4604-a2bb-f30c0918ada4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:57.578273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1409dc6a-99df-4604-a2bb-f30c0918ada4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Jul 14 16:00:57.578827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 740/1378] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:57 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:57.815300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-606e1caa-a385-4f3c-bff4-0a3e0ec805a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:57.815867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-606e1caa-a385-4f3c-bff4-0a3e0ec805a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:57.823869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-606e1caa-a385-4f3c-bff4-0a3e0ec805a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:57.824318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-606e1caa-a385-4f3c-bff4-0a3e0ec805a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:57.825086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-606e1caa-a385-4f3c-bff4-0a3e0ec805a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:57.825530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-606e1caa-a385-4f3c-bff4-0a3e0ec805a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:57.890461 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-606e1caa-a385-4f3c-bff4-0a3e0ec805a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:57.898749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-606e1caa-a385-4f3c-bff4-0a3e0ec805a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087581 Jul 14 16:00:57.899389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 639/1379] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:57 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:58.476429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f313970f-3e12-4d8d-932c-718cf7f5f51e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:58.477357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f313970f-3e12-4d8d-932c-718cf7f5f51e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:58.487255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f313970f-3e12-4d8d-932c-718cf7f5f51e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.487736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f313970f-3e12-4d8d-932c-718cf7f5f51e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.488489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f313970f-3e12-4d8d-932c-718cf7f5f51e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.488918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f313970f-3e12-4d8d-932c-718cf7f5f51e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.519680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f313970f-3e12-4d8d-932c-718cf7f5f51e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047118 Jul 14 16:00:58.520261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 741/1380] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:58 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:58.591012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6b82bcf8-a920-4b5f-9f4c-169af2208b48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:58.591983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6b82bcf8-a920-4b5f-9f4c-169af2208b48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:58.598664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b82bcf8-a920-4b5f-9f4c-169af2208b48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.599119 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b82bcf8-a920-4b5f-9f4c-169af2208b48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.599950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b82bcf8-a920-4b5f-9f4c-169af2208b48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.600402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b82bcf8-a920-4b5f-9f4c-169af2208b48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.629975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6b82bcf8-a920-4b5f-9f4c-169af2208b48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043731 Jul 14 16:00:58.630539 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 640/1381] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:58 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:58.917251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-35c62265-be61-4611-901d-b01bb7cca7fb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:58.917873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-35c62265-be61-4611-901d-b01bb7cca7fb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:58.924373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-35c62265-be61-4611-901d-b01bb7cca7fb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.924827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-35c62265-be61-4611-901d-b01bb7cca7fb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.925584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-35c62265-be61-4611-901d-b01bb7cca7fb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:58.926018 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-35c62265-be61-4611-901d-b01bb7cca7fb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:58.987128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-35c62265-be61-4611-901d-b01bb7cca7fb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:00:58.995069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-35c62265-be61-4611-901d-b01bb7cca7fb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082130 Jul 14 16:00:58.995646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 742/1382] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:00:58 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:00:59.531268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f8996e43-39f2-42d3-8f2b-6b95d719f73a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:59.532259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f8996e43-39f2-42d3-8f2b-6b95d719f73a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:59.538604 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8996e43-39f2-42d3-8f2b-6b95d719f73a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:59.539054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8996e43-39f2-42d3-8f2b-6b95d719f73a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:59.539836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8996e43-39f2-42d3-8f2b-6b95d719f73a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:59.540275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8996e43-39f2-42d3-8f2b-6b95d719f73a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:59.570392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f8996e43-39f2-42d3-8f2b-6b95d719f73a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043086 Jul 14 16:00:59.570994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 641/1383] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:59 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:00:59.642381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2d4de673-a0ee-4e6e-800a-ac3ef0a711ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:00:59.643224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2d4de673-a0ee-4e6e-800a-ac3ef0a711ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:00:59.649280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2d4de673-a0ee-4e6e-800a-ac3ef0a711ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:59.649730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2d4de673-a0ee-4e6e-800a-ac3ef0a711ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:59.650634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2d4de673-a0ee-4e6e-800a-ac3ef0a711ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:00:59.651339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2d4de673-a0ee-4e6e-800a-ac3ef0a711ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:00:59.680380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2d4de673-a0ee-4e6e-800a-ac3ef0a711ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042064 Jul 14 16:00:59.681083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 743/1384] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:00:59 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:00.011739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1a9e13f8-c2d6-415f-baed-e91ca0bc009c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:00.012346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1a9e13f8-c2d6-415f-baed-e91ca0bc009c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:00.018712 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1a9e13f8-c2d6-415f-baed-e91ca0bc009c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:00.019157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1a9e13f8-c2d6-415f-baed-e91ca0bc009c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:00.019946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1a9e13f8-c2d6-415f-baed-e91ca0bc009c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:00.020389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1a9e13f8-c2d6-415f-baed-e91ca0bc009c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:00.084147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1a9e13f8-c2d6-415f-baed-e91ca0bc009c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:00.091974 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1a9e13f8-c2d6-415f-baed-e91ca0bc009c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084278 Jul 14 16:01:00.092550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 642/1385] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:00 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:00.582629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-71c6a953-c764-4dbb-b237-ef1dc11baaeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:00.583546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-71c6a953-c764-4dbb-b237-ef1dc11baaeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:00.590788 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-71c6a953-c764-4dbb-b237-ef1dc11baaeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:00.591234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-71c6a953-c764-4dbb-b237-ef1dc11baaeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:00.592103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-71c6a953-c764-4dbb-b237-ef1dc11baaeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:00.592533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-71c6a953-c764-4dbb-b237-ef1dc11baaeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:00.612004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:00.626486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-71c6a953-c764-4dbb-b237-ef1dc11baaeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047834 Jul 14 16:01:00.627059 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 744/1386] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:00 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:00.692995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a93b0637-e740-4e33-babb-59c7baf07dd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:00.693962 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a93b0637-e740-4e33-babb-59c7baf07dd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:00.695844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=86 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:00.702622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a93b0637-e740-4e33-babb-59c7baf07dd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:00.703081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a93b0637-e740-4e33-babb-59c7baf07dd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:00.703919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a93b0637-e740-4e33-babb-59c7baf07dd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:00.704358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a93b0637-e740-4e33-babb-59c7baf07dd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:00.736678 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a93b0637-e740-4e33-babb-59c7baf07dd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047523 Jul 14 16:01:00.737228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 643/1387] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:00 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:01.108873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4b66a724-a0cd-4da5-950a-f5c595185c90 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:01.109498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4b66a724-a0cd-4da5-950a-f5c595185c90 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:01.115526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b66a724-a0cd-4da5-950a-f5c595185c90 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:01.115999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b66a724-a0cd-4da5-950a-f5c595185c90 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:01.116755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b66a724-a0cd-4da5-950a-f5c595185c90 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:01.117191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b66a724-a0cd-4da5-950a-f5c595185c90 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:01.185918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4b66a724-a0cd-4da5-950a-f5c595185c90 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:01.193412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4b66a724-a0cd-4da5-950a-f5c595185c90 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088479 Jul 14 16:01:01.193976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 745/1388] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:01 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:01.638595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bbdb06f7-a937-45a8-82a9-1724bc5912de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:01.639511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bbdb06f7-a937-45a8-82a9-1724bc5912de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:01.645936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbdb06f7-a937-45a8-82a9-1724bc5912de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:01.646381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbdb06f7-a937-45a8-82a9-1724bc5912de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:01.647134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbdb06f7-a937-45a8-82a9-1724bc5912de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:01.647570 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbdb06f7-a937-45a8-82a9-1724bc5912de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:01.676543 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bbdb06f7-a937-45a8-82a9-1724bc5912de tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042759 Jul 14 16:01:01.677097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 644/1389] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:01 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:01.750451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fa8ffbfd-74cd-478c-b12c-3ea72e3c9dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:01.751383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fa8ffbfd-74cd-478c-b12c-3ea72e3c9dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:01.757976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa8ffbfd-74cd-478c-b12c-3ea72e3c9dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:01.758427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa8ffbfd-74cd-478c-b12c-3ea72e3c9dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:01.759187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa8ffbfd-74cd-478c-b12c-3ea72e3c9dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:01.760311 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fa8ffbfd-74cd-478c-b12c-3ea72e3c9dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:01.789850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fa8ffbfd-74cd-478c-b12c-3ea72e3c9dfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043351 Jul 14 16:01:01.790407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 746/1390] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:01 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:02.210774 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bbaca0a7-a60d-4ab4-a420-c26637b3e0a1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:02.211391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bbaca0a7-a60d-4ab4-a420-c26637b3e0a1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:02.217545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbaca0a7-a60d-4ab4-a420-c26637b3e0a1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:02.218133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbaca0a7-a60d-4ab4-a420-c26637b3e0a1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:02.219037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbaca0a7-a60d-4ab4-a420-c26637b3e0a1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:02.219534 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbaca0a7-a60d-4ab4-a420-c26637b3e0a1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:02.288426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bbaca0a7-a60d-4ab4-a420-c26637b3e0a1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:02.296780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bbaca0a7-a60d-4ab4-a420-c26637b3e0a1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090022 Jul 14 16:01:02.297353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 645/1391] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:02 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:02.689218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-45008a8e-c669-48e7-9a37-94a7abc1e845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:02.690188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-45008a8e-c669-48e7-9a37-94a7abc1e845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:02.696253 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45008a8e-c669-48e7-9a37-94a7abc1e845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:02.696764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45008a8e-c669-48e7-9a37-94a7abc1e845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:02.698236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45008a8e-c669-48e7-9a37-94a7abc1e845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:02.698704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45008a8e-c669-48e7-9a37-94a7abc1e845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:02.728268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-45008a8e-c669-48e7-9a37-94a7abc1e845 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043242 Jul 14 16:01:02.728821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 747/1392] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:02 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:02.801814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-71be5691-f085-496b-8fa9-e074b41668d8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:02.802774 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-71be5691-f085-496b-8fa9-e074b41668d8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:02.810436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71be5691-f085-496b-8fa9-e074b41668d8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:02.810885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71be5691-f085-496b-8fa9-e074b41668d8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:02.811671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71be5691-f085-496b-8fa9-e074b41668d8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:02.812114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71be5691-f085-496b-8fa9-e074b41668d8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:02.841859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-71be5691-f085-496b-8fa9-e074b41668d8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044005 Jul 14 16:01:02.842417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 646/1393] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:02 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:03.313907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d6e6ff25-0ea6-4576-9242-cd4b98d62095 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:03.314462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d6e6ff25-0ea6-4576-9242-cd4b98d62095 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:03.320557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6e6ff25-0ea6-4576-9242-cd4b98d62095 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:03.320993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6e6ff25-0ea6-4576-9242-cd4b98d62095 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:03.321741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6e6ff25-0ea6-4576-9242-cd4b98d62095 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:03.322173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6e6ff25-0ea6-4576-9242-cd4b98d62095 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:03.383124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d6e6ff25-0ea6-4576-9242-cd4b98d62095 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:03.391026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d6e6ff25-0ea6-4576-9242-cd4b98d62095 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081045 Jul 14 16:01:03.391932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 748/1394] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:03 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:03.740012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e06d96a2-29b2-4f9b-8683-4a779a05956e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:03.740936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e06d96a2-29b2-4f9b-8683-4a779a05956e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:03.747766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e06d96a2-29b2-4f9b-8683-4a779a05956e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:03.748222 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e06d96a2-29b2-4f9b-8683-4a779a05956e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:03.749016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e06d96a2-29b2-4f9b-8683-4a779a05956e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:03.749458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e06d96a2-29b2-4f9b-8683-4a779a05956e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:03.780090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e06d96a2-29b2-4f9b-8683-4a779a05956e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044092 Jul 14 16:01:03.780654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 647/1395] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:03 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:03.853686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5e09c616-5169-4c0c-b69c-eba4e874c889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:03.854594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5e09c616-5169-4c0c-b69c-eba4e874c889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:03.860614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5e09c616-5169-4c0c-b69c-eba4e874c889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:03.861059 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5e09c616-5169-4c0c-b69c-eba4e874c889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:03.861808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5e09c616-5169-4c0c-b69c-eba4e874c889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:03.862241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5e09c616-5169-4c0c-b69c-eba4e874c889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:03.891471 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5e09c616-5169-4c0c-b69c-eba4e874c889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042006 Jul 14 16:01:03.892041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 749/1396] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:03 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:04.408499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-acf953a2-445c-4662-b398-9f9b1d5d8ce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:04.409134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-acf953a2-445c-4662-b398-9f9b1d5d8ce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:04.416487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-acf953a2-445c-4662-b398-9f9b1d5d8ce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:04.416943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-acf953a2-445c-4662-b398-9f9b1d5d8ce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:04.417706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-acf953a2-445c-4662-b398-9f9b1d5d8ce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:04.418148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-acf953a2-445c-4662-b398-9f9b1d5d8ce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:04.713396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-acf953a2-445c-4662-b398-9f9b1d5d8ce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:04.720916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-acf953a2-445c-4662-b398-9f9b1d5d8ce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.316282 Jul 14 16:01:04.721496 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 648/1397] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:04 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 317 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:04.792600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6a4f58da-c146-4df6-88d7-7eb73ce555cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:04.793550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6a4f58da-c146-4df6-88d7-7eb73ce555cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:04.800106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a4f58da-c146-4df6-88d7-7eb73ce555cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:04.800555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a4f58da-c146-4df6-88d7-7eb73ce555cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:04.801313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a4f58da-c146-4df6-88d7-7eb73ce555cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:04.801747 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a4f58da-c146-4df6-88d7-7eb73ce555cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:04.830530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6a4f58da-c146-4df6-88d7-7eb73ce555cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042704 Jul 14 16:01:04.831093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 750/1398] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:04 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:04.902843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-73e5e3aa-3d8f-4965-9e55-a449d436807f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:04.903792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-73e5e3aa-3d8f-4965-9e55-a449d436807f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:04.909980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-73e5e3aa-3d8f-4965-9e55-a449d436807f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:04.910434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-73e5e3aa-3d8f-4965-9e55-a449d436807f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:04.911203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-73e5e3aa-3d8f-4965-9e55-a449d436807f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:04.911660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-73e5e3aa-3d8f-4965-9e55-a449d436807f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:04.940500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-73e5e3aa-3d8f-4965-9e55-a449d436807f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042098 Jul 14 16:01:04.941050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 649/1399] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:04 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:05.738258 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-49290083-8ad1-4ec7-92f4-b4397904372c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:05.738868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-49290083-8ad1-4ec7-92f4-b4397904372c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:05.746227 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-49290083-8ad1-4ec7-92f4-b4397904372c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:05.746675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-49290083-8ad1-4ec7-92f4-b4397904372c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:05.747443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-49290083-8ad1-4ec7-92f4-b4397904372c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:05.747899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-49290083-8ad1-4ec7-92f4-b4397904372c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:05.809060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-49290083-8ad1-4ec7-92f4-b4397904372c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:05.816547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-49290083-8ad1-4ec7-92f4-b4397904372c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082213 Jul 14 16:01:05.817105 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 751/1400] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:05 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:05.842116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d49ce85c-c822-4fe3-aca0-69508963666c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:05.843027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d49ce85c-c822-4fe3-aca0-69508963666c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:05.849533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d49ce85c-c822-4fe3-aca0-69508963666c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:05.849979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d49ce85c-c822-4fe3-aca0-69508963666c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:05.850740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d49ce85c-c822-4fe3-aca0-69508963666c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:05.851180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d49ce85c-c822-4fe3-aca0-69508963666c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:05.880334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d49ce85c-c822-4fe3-aca0-69508963666c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042275 Jul 14 16:01:05.880886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 650/1401] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:05 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:05.952185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-53074187-3f88-492a-992d-3e2f193cbf17 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:05.953120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-53074187-3f88-492a-992d-3e2f193cbf17 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:05.959084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-53074187-3f88-492a-992d-3e2f193cbf17 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:05.959533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-53074187-3f88-492a-992d-3e2f193cbf17 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:05.960329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-53074187-3f88-492a-992d-3e2f193cbf17 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:05.960766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-53074187-3f88-492a-992d-3e2f193cbf17 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:05.990766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-53074187-3f88-492a-992d-3e2f193cbf17 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042603 Jul 14 16:01:05.991260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 752/1402] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:05 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:06.834168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8592bee3-996b-4428-8328-8e8fd668cd21 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:06.834787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8592bee3-996b-4428-8328-8e8fd668cd21 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:06.841193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8592bee3-996b-4428-8328-8e8fd668cd21 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:06.841651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8592bee3-996b-4428-8328-8e8fd668cd21 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:06.842420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8592bee3-996b-4428-8328-8e8fd668cd21 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:06.842965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8592bee3-996b-4428-8328-8e8fd668cd21 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:06.892393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d23a278f-f764-46e6-848f-4e0a6b421ebc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:06.893426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d23a278f-f764-46e6-848f-4e0a6b421ebc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:06.904590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d23a278f-f764-46e6-848f-4e0a6b421ebc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:06.905129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d23a278f-f764-46e6-848f-4e0a6b421ebc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:06.905974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d23a278f-f764-46e6-848f-4e0a6b421ebc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:06.906752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d23a278f-f764-46e6-848f-4e0a6b421ebc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:06.909204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8592bee3-996b-4428-8328-8e8fd668cd21 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:06.917842 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8592bee3-996b-4428-8328-8e8fd668cd21 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087568 Jul 14 16:01:06.926928 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 651/1403] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:06 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:06.938303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d23a278f-f764-46e6-848f-4e0a6b421ebc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049956 Jul 14 16:01:06.938868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 753/1404] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:06 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:07.003282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d9c0030e-2875-4115-9492-c0fc38963f0e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:07.004259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d9c0030e-2875-4115-9492-c0fc38963f0e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:07.010502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9c0030e-2875-4115-9492-c0fc38963f0e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:07.010958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9c0030e-2875-4115-9492-c0fc38963f0e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:07.011763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9c0030e-2875-4115-9492-c0fc38963f0e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:07.012204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9c0030e-2875-4115-9492-c0fc38963f0e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:07.042988 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d9c0030e-2875-4115-9492-c0fc38963f0e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043674 Jul 14 16:01:07.043545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 652/1405] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:06 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:07.934817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6b118a86-7a1b-4713-9215-e20c86781610 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:07.935429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6b118a86-7a1b-4713-9215-e20c86781610 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:07.941988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b118a86-7a1b-4713-9215-e20c86781610 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:07.942438 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b118a86-7a1b-4713-9215-e20c86781610 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:07.943196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b118a86-7a1b-4713-9215-e20c86781610 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:07.943654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b118a86-7a1b-4713-9215-e20c86781610 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:07.950749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-22e428ca-6a50-4275-b727-d94e8a8ad25a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:07.952092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-22e428ca-6a50-4275-b727-d94e8a8ad25a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:07.958531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-22e428ca-6a50-4275-b727-d94e8a8ad25a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:07.958977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-22e428ca-6a50-4275-b727-d94e8a8ad25a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:07.959786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-22e428ca-6a50-4275-b727-d94e8a8ad25a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:07.960225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-22e428ca-6a50-4275-b727-d94e8a8ad25a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:07.991978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-22e428ca-6a50-4275-b727-d94e8a8ad25a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045892 Jul 14 16:01:07.992926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 653/1406] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:07 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:08.006480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6b118a86-7a1b-4713-9215-e20c86781610 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:08.014976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6b118a86-7a1b-4713-9215-e20c86781610 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084828 Jul 14 16:01:08.015544 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 754/1407] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:07 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:08.054421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5f699965-5d0c-47ed-88b7-6c9b0699bea1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:08.055331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5f699965-5d0c-47ed-88b7-6c9b0699bea1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:08.061977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5f699965-5d0c-47ed-88b7-6c9b0699bea1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:08.062421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5f699965-5d0c-47ed-88b7-6c9b0699bea1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:08.063174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5f699965-5d0c-47ed-88b7-6c9b0699bea1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:08.063627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5f699965-5d0c-47ed-88b7-6c9b0699bea1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:08.092471 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5f699965-5d0c-47ed-88b7-6c9b0699bea1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041949 Jul 14 16:01:08.093026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 654/1408] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:08 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:09.004953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dfd64d4d-7038-4e73-8144-8439c942e501 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:09.005881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dfd64d4d-7038-4e73-8144-8439c942e501 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:09.016041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dfd64d4d-7038-4e73-8144-8439c942e501 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.016409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dfd64d4d-7038-4e73-8144-8439c942e501 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.017986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dfd64d4d-7038-4e73-8144-8439c942e501 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.018703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dfd64d4d-7038-4e73-8144-8439c942e501 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.031546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-956d416e-67a5-4c5f-9e67-af72372a0cfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:09.032189 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-956d416e-67a5-4c5f-9e67-af72372a0cfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:09.038773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-956d416e-67a5-4c5f-9e67-af72372a0cfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.039233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-956d416e-67a5-4c5f-9e67-af72372a0cfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.040075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-956d416e-67a5-4c5f-9e67-af72372a0cfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.040515 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-956d416e-67a5-4c5f-9e67-af72372a0cfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.050339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dfd64d4d-7038-4e73-8144-8439c942e501 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049426 Jul 14 16:01:09.050903 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 755/1409] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:08 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:09.061020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:09.104883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-347d1dbc-d4fa-452c-871e-a2a36ae9f8e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:09.105825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-347d1dbc-d4fa-452c-871e-a2a36ae9f8e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:09.106462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-956d416e-67a5-4c5f-9e67-af72372a0cfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:09.114322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-956d416e-67a5-4c5f-9e67-af72372a0cfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086548 Jul 14 16:01:09.115097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 655/1410] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:09 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:09.120585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-347d1dbc-d4fa-452c-871e-a2a36ae9f8e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.121034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-347d1dbc-d4fa-452c-871e-a2a36ae9f8e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.122347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-347d1dbc-d4fa-452c-871e-a2a36ae9f8e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:09.122780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-347d1dbc-d4fa-452c-871e-a2a36ae9f8e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:09.151825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-347d1dbc-d4fa-452c-871e-a2a36ae9f8e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052211 Jul 14 16:01:09.152387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 756/1411] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:09 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:10.062123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-65a1b1a2-3abc-4f24-834f-20291c96f6ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:10.063044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-65a1b1a2-3abc-4f24-834f-20291c96f6ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:10.069894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65a1b1a2-3abc-4f24-834f-20291c96f6ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:10.070361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65a1b1a2-3abc-4f24-834f-20291c96f6ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:10.071130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65a1b1a2-3abc-4f24-834f-20291c96f6ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:10.071574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65a1b1a2-3abc-4f24-834f-20291c96f6ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:10.101944 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-65a1b1a2-3abc-4f24-834f-20291c96f6ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043813 Jul 14 16:01:10.102513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 656/1412] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:10 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:10.132264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b6a8bbac-4ff8-492d-a165-8056e1923af6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:10.132843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b6a8bbac-4ff8-492d-a165-8056e1923af6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:10.140709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6a8bbac-4ff8-492d-a165-8056e1923af6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:10.141155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6a8bbac-4ff8-492d-a165-8056e1923af6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:10.141936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6a8bbac-4ff8-492d-a165-8056e1923af6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:10.142368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6a8bbac-4ff8-492d-a165-8056e1923af6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:10.162566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4fb6e415-d0a2-4a9f-86e5-3c35ef8003c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:10.163482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4fb6e415-d0a2-4a9f-86e5-3c35ef8003c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:10.170457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4fb6e415-d0a2-4a9f-86e5-3c35ef8003c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:10.170905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4fb6e415-d0a2-4a9f-86e5-3c35ef8003c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:10.171796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4fb6e415-d0a2-4a9f-86e5-3c35ef8003c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:10.172139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4fb6e415-d0a2-4a9f-86e5-3c35ef8003c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:10.202097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4fb6e415-d0a2-4a9f-86e5-3c35ef8003c4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043627 Jul 14 16:01:10.205878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 657/1413] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:10 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:10.207523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b6a8bbac-4ff8-492d-a165-8056e1923af6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:10.215562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b6a8bbac-4ff8-492d-a165-8056e1923af6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087161 Jul 14 16:01:10.216139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 757/1414] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:10 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:11.115895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-04e1e2df-abc8-4452-bc16-a02b9efdde21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:11.116726 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-04e1e2df-abc8-4452-bc16-a02b9efdde21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:11.123637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04e1e2df-abc8-4452-bc16-a02b9efdde21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:11.124091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04e1e2df-abc8-4452-bc16-a02b9efdde21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:11.124852 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04e1e2df-abc8-4452-bc16-a02b9efdde21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:11.125285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04e1e2df-abc8-4452-bc16-a02b9efdde21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:11.155037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-04e1e2df-abc8-4452-bc16-a02b9efdde21 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043327 Jul 14 16:01:11.155629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 658/1415] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:11 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:11.213519 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-343e3dd4-99ee-4bc5-9b0c-49884b3a4a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:11.214434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-343e3dd4-99ee-4bc5-9b0c-49884b3a4a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:11.220979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-343e3dd4-99ee-4bc5-9b0c-49884b3a4a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:11.221421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-343e3dd4-99ee-4bc5-9b0c-49884b3a4a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:11.222175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-343e3dd4-99ee-4bc5-9b0c-49884b3a4a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:11.222610 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-343e3dd4-99ee-4bc5-9b0c-49884b3a4a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:11.233830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c9e33be9-aae0-486e-839e-3bec98c546cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:11.234873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c9e33be9-aae0-486e-839e-3bec98c546cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:11.240693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c9e33be9-aae0-486e-839e-3bec98c546cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:11.241136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c9e33be9-aae0-486e-839e-3bec98c546cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:11.241898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c9e33be9-aae0-486e-839e-3bec98c546cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:11.242332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c9e33be9-aae0-486e-839e-3bec98c546cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:11.254626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-343e3dd4-99ee-4bc5-9b0c-49884b3a4a9c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045041 Jul 14 16:01:11.255202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 758/1416] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:11 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:11.307929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c9e33be9-aae0-486e-839e-3bec98c546cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:11.315477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c9e33be9-aae0-486e-839e-3bec98c546cd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085862 Jul 14 16:01:11.316413 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 659/1417] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:11 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:12.167077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9c613649-d237-4fa6-a37c-0baab1e9be4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:12.167966 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9c613649-d237-4fa6-a37c-0baab1e9be4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:12.173993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c613649-d237-4fa6-a37c-0baab1e9be4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:12.174446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c613649-d237-4fa6-a37c-0baab1e9be4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:12.175216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c613649-d237-4fa6-a37c-0baab1e9be4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:12.175758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c613649-d237-4fa6-a37c-0baab1e9be4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:12.205564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9c613649-d237-4fa6-a37c-0baab1e9be4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042819 Jul 14 16:01:12.206119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 759/1418] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:12 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:12.266799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d41e7eb8-8aa3-4ce4-92b9-d7dd1413c0f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:12.267760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d41e7eb8-8aa3-4ce4-92b9-d7dd1413c0f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:12.274395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d41e7eb8-8aa3-4ce4-92b9-d7dd1413c0f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:12.274851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d41e7eb8-8aa3-4ce4-92b9-d7dd1413c0f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:12.276169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d41e7eb8-8aa3-4ce4-92b9-d7dd1413c0f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:12.276614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d41e7eb8-8aa3-4ce4-92b9-d7dd1413c0f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:12.305635 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d41e7eb8-8aa3-4ce4-92b9-d7dd1413c0f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042762 Jul 14 16:01:12.306716 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 660/1419] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:12 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:12.332370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-843faaf3-6c49-40f7-af06-162c34375bab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:12.332985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-843faaf3-6c49-40f7-af06-162c34375bab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:12.340058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-843faaf3-6c49-40f7-af06-162c34375bab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:12.340507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-843faaf3-6c49-40f7-af06-162c34375bab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:12.341277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-843faaf3-6c49-40f7-af06-162c34375bab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:12.341716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-843faaf3-6c49-40f7-af06-162c34375bab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:12.406491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-843faaf3-6c49-40f7-af06-162c34375bab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:12.414244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-843faaf3-6c49-40f7-af06-162c34375bab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085756 Jul 14 16:01:12.414815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 760/1420] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:12 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:13.218087 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0a4fbb51-d188-49ef-bc8c-4617a612f2e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:13.219157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0a4fbb51-d188-49ef-bc8c-4617a612f2e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:13.225660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a4fbb51-d188-49ef-bc8c-4617a612f2e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:13.226105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a4fbb51-d188-49ef-bc8c-4617a612f2e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:13.226874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a4fbb51-d188-49ef-bc8c-4617a612f2e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:13.227307 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a4fbb51-d188-49ef-bc8c-4617a612f2e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:13.259999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0a4fbb51-d188-49ef-bc8c-4617a612f2e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045449 Jul 14 16:01:13.260629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 661/1421] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:13 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:13.318158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-de60d9e9-3ca8-42b5-91bf-148a889bdecf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:13.319083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-de60d9e9-3ca8-42b5-91bf-148a889bdecf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:13.326567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de60d9e9-3ca8-42b5-91bf-148a889bdecf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:13.327018 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de60d9e9-3ca8-42b5-91bf-148a889bdecf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:13.327907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de60d9e9-3ca8-42b5-91bf-148a889bdecf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:13.328345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de60d9e9-3ca8-42b5-91bf-148a889bdecf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:13.333825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:13.369636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-de60d9e9-3ca8-42b5-91bf-148a889bdecf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054782 Jul 14 16:01:13.370509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 761/1422] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:13 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:13.434883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-576ad458-dc2f-4e8a-86c3-bdeaa1b4f13e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:13.435547 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-576ad458-dc2f-4e8a-86c3-bdeaa1b4f13e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:13.444227 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-576ad458-dc2f-4e8a-86c3-bdeaa1b4f13e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:13.445039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-576ad458-dc2f-4e8a-86c3-bdeaa1b4f13e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:13.446213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-576ad458-dc2f-4e8a-86c3-bdeaa1b4f13e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:13.446993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-576ad458-dc2f-4e8a-86c3-bdeaa1b4f13e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:13.516144 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-576ad458-dc2f-4e8a-86c3-bdeaa1b4f13e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:13.524020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-576ad458-dc2f-4e8a-86c3-bdeaa1b4f13e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.096586 Jul 14 16:01:13.524583 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 662/1423] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:13 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:14.272029 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4086c128-21fb-4bd4-933f-9d1868e09154 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:14.272868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4086c128-21fb-4bd4-933f-9d1868e09154 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:14.279507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4086c128-21fb-4bd4-933f-9d1868e09154 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.279988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4086c128-21fb-4bd4-933f-9d1868e09154 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:14.280752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4086c128-21fb-4bd4-933f-9d1868e09154 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.281188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4086c128-21fb-4bd4-933f-9d1868e09154 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:14.313743 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4086c128-21fb-4bd4-933f-9d1868e09154 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045832 Jul 14 16:01:14.314308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 762/1424] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:14 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:14.381376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dc8011e5-200b-409d-8c2a-380995c0a3c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:14.382291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dc8011e5-200b-409d-8c2a-380995c0a3c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:14.388680 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc8011e5-200b-409d-8c2a-380995c0a3c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.389129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc8011e5-200b-409d-8c2a-380995c0a3c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:14.389894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc8011e5-200b-409d-8c2a-380995c0a3c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.390326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc8011e5-200b-409d-8c2a-380995c0a3c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:14.421316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dc8011e5-200b-409d-8c2a-380995c0a3c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043925 Jul 14 16:01:14.421871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 663/1425] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:14 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:14.541993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7f7e1adc-708c-4d48-8d19-1256b7d66c7d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:14.542539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7f7e1adc-708c-4d48-8d19-1256b7d66c7d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:14.549128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f7e1adc-708c-4d48-8d19-1256b7d66c7d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.549583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f7e1adc-708c-4d48-8d19-1256b7d66c7d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:14.550342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f7e1adc-708c-4d48-8d19-1256b7d66c7d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:14.550782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f7e1adc-708c-4d48-8d19-1256b7d66c7d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:14.619636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7f7e1adc-708c-4d48-8d19-1256b7d66c7d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:14.627151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7f7e1adc-708c-4d48-8d19-1256b7d66c7d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.089754 Jul 14 16:01:14.627738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 763/1426] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:14 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:15.325816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4b55ce98-5b32-4a91-b944-ce6f5a65ba95 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:15.326679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4b55ce98-5b32-4a91-b944-ce6f5a65ba95 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:15.333296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4b55ce98-5b32-4a91-b944-ce6f5a65ba95 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:15.333605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4b55ce98-5b32-4a91-b944-ce6f5a65ba95 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:15.334365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4b55ce98-5b32-4a91-b944-ce6f5a65ba95 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:15.334798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4b55ce98-5b32-4a91-b944-ce6f5a65ba95 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:15.365215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4b55ce98-5b32-4a91-b944-ce6f5a65ba95 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043624 Jul 14 16:01:15.365768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 664/1427] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:15 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:15.433143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-07b2eafd-1bcc-4db8-805b-b86beeaaa159 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:15.434068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-07b2eafd-1bcc-4db8-805b-b86beeaaa159 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:15.440327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-07b2eafd-1bcc-4db8-805b-b86beeaaa159 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:15.440779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-07b2eafd-1bcc-4db8-805b-b86beeaaa159 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:15.441576 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-07b2eafd-1bcc-4db8-805b-b86beeaaa159 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:15.442019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-07b2eafd-1bcc-4db8-805b-b86beeaaa159 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:15.476944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-07b2eafd-1bcc-4db8-805b-b86beeaaa159 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047768 Jul 14 16:01:15.477550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 764/1428] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:15 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:15.644019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bdc1b64c-3011-498b-b315-8aaf71048780 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:15.644629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bdc1b64c-3011-498b-b315-8aaf71048780 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:15.651313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bdc1b64c-3011-498b-b315-8aaf71048780 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:15.651784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bdc1b64c-3011-498b-b315-8aaf71048780 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:15.652537 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bdc1b64c-3011-498b-b315-8aaf71048780 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:15.652969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bdc1b64c-3011-498b-b315-8aaf71048780 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:15.713448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bdc1b64c-3011-498b-b315-8aaf71048780 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:15.720958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bdc1b64c-3011-498b-b315-8aaf71048780 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.080814 Jul 14 16:01:15.721519 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 665/1429] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:15 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:16.376690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-efa56eb0-de5d-48e1-aaa2-227f738b9917 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:16.377552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-efa56eb0-de5d-48e1-aaa2-227f738b9917 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:16.384174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-efa56eb0-de5d-48e1-aaa2-227f738b9917 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:16.384818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-efa56eb0-de5d-48e1-aaa2-227f738b9917 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:16.385787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-efa56eb0-de5d-48e1-aaa2-227f738b9917 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:16.386226 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-efa56eb0-de5d-48e1-aaa2-227f738b9917 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:16.416233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-efa56eb0-de5d-48e1-aaa2-227f738b9917 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042926 Jul 14 16:01:16.416927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 765/1430] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:16 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:16.489285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0086aa24-f20d-4c45-9ed7-0d7f3941027c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:16.490239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0086aa24-f20d-4c45-9ed7-0d7f3941027c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:16.497563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0086aa24-f20d-4c45-9ed7-0d7f3941027c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:16.498014 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0086aa24-f20d-4c45-9ed7-0d7f3941027c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:16.498775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0086aa24-f20d-4c45-9ed7-0d7f3941027c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:16.499209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0086aa24-f20d-4c45-9ed7-0d7f3941027c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:16.528152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0086aa24-f20d-4c45-9ed7-0d7f3941027c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042672 Jul 14 16:01:16.528719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 666/1431] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:16 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:16.738308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9252939c-8e94-4323-b3cd-bd801ddab0c8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:16.738920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9252939c-8e94-4323-b3cd-bd801ddab0c8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:16.745248 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9252939c-8e94-4323-b3cd-bd801ddab0c8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:16.745702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9252939c-8e94-4323-b3cd-bd801ddab0c8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:16.746478 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9252939c-8e94-4323-b3cd-bd801ddab0c8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:16.746916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9252939c-8e94-4323-b3cd-bd801ddab0c8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:16.810052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9252939c-8e94-4323-b3cd-bd801ddab0c8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:16.817604 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9252939c-8e94-4323-b3cd-bd801ddab0c8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083169 Jul 14 16:01:16.818177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 766/1432] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:16 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:17.429155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4a711825-fc59-4617-af21-18029e86198e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:17.430117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4a711825-fc59-4617-af21-18029e86198e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:17.437020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4a711825-fc59-4617-af21-18029e86198e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:17.437474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4a711825-fc59-4617-af21-18029e86198e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:17.438247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4a711825-fc59-4617-af21-18029e86198e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:17.438690 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4a711825-fc59-4617-af21-18029e86198e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:17.468854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4a711825-fc59-4617-af21-18029e86198e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043810 Jul 14 16:01:17.469443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 667/1433] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:17 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:17.540049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-206dfb93-941e-411a-8000-c361c9c4b713 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:17.541574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-206dfb93-941e-411a-8000-c361c9c4b713 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:17.548075 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-206dfb93-941e-411a-8000-c361c9c4b713 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:17.548524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-206dfb93-941e-411a-8000-c361c9c4b713 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:17.549286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-206dfb93-941e-411a-8000-c361c9c4b713 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:17.549724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-206dfb93-941e-411a-8000-c361c9c4b713 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:17.582553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-206dfb93-941e-411a-8000-c361c9c4b713 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046426 Jul 14 16:01:17.583127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 767/1434] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:17 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:17.834288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-51a12158-b096-410b-81a7-16a90cb0cc4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:17.834878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-51a12158-b096-410b-81a7-16a90cb0cc4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:17.842331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-51a12158-b096-410b-81a7-16a90cb0cc4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:17.842833 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-51a12158-b096-410b-81a7-16a90cb0cc4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:17.843621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-51a12158-b096-410b-81a7-16a90cb0cc4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:17.844075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-51a12158-b096-410b-81a7-16a90cb0cc4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:17.915786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-51a12158-b096-410b-81a7-16a90cb0cc4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:17.927078 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-51a12158-b096-410b-81a7-16a90cb0cc4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.096771 Jul 14 16:01:17.927684 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 668/1435] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:17 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:18.481416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e09f1db1-214b-456f-8abc-b90db189a0a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:18.482339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e09f1db1-214b-456f-8abc-b90db189a0a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:18.488428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e09f1db1-214b-456f-8abc-b90db189a0a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:18.488883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e09f1db1-214b-456f-8abc-b90db189a0a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:18.490079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e09f1db1-214b-456f-8abc-b90db189a0a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:18.490240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e09f1db1-214b-456f-8abc-b90db189a0a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:18.519185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e09f1db1-214b-456f-8abc-b90db189a0a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042513 Jul 14 16:01:18.519785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 768/1436] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:18 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:18.594561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-329aa9bc-a7f2-41e5-8d2e-d7bd916e5559 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:18.595474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-329aa9bc-a7f2-41e5-8d2e-d7bd916e5559 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:18.601518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-329aa9bc-a7f2-41e5-8d2e-d7bd916e5559 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:18.601961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-329aa9bc-a7f2-41e5-8d2e-d7bd916e5559 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:18.602709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-329aa9bc-a7f2-41e5-8d2e-d7bd916e5559 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:18.603152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-329aa9bc-a7f2-41e5-8d2e-d7bd916e5559 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:18.631629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-329aa9bc-a7f2-41e5-8d2e-d7bd916e5559 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040920 Jul 14 16:01:18.632170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 669/1437] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:18 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:18.945031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-561416d2-afb9-4485-9889-41b5b3c5c982 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:18.945644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-561416d2-afb9-4485-9889-41b5b3c5c982 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:18.953122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-561416d2-afb9-4485-9889-41b5b3c5c982 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:18.953563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-561416d2-afb9-4485-9889-41b5b3c5c982 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:18.954324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-561416d2-afb9-4485-9889-41b5b3c5c982 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:18.954758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-561416d2-afb9-4485-9889-41b5b3c5c982 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:19.021018 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-561416d2-afb9-4485-9889-41b5b3c5c982 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:19.028725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-561416d2-afb9-4485-9889-41b5b3c5c982 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087575 Jul 14 16:01:19.029362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 769/1438] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:18 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:19.530767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b8e9fc08-e32f-49df-bc40-ccc258841a69 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:19.531747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b8e9fc08-e32f-49df-bc40-ccc258841a69 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:19.538485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8e9fc08-e32f-49df-bc40-ccc258841a69 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:19.538935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8e9fc08-e32f-49df-bc40-ccc258841a69 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:19.539853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8e9fc08-e32f-49df-bc40-ccc258841a69 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:19.540794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8e9fc08-e32f-49df-bc40-ccc258841a69 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:19.570941 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b8e9fc08-e32f-49df-bc40-ccc258841a69 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044166 Jul 14 16:01:19.571562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 670/1439] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:19 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:19.644401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cc8a565f-4073-4c5d-a614-411aaa106815 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:19.645339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cc8a565f-4073-4c5d-a614-411aaa106815 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:19.651646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc8a565f-4073-4c5d-a614-411aaa106815 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:19.652114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc8a565f-4073-4c5d-a614-411aaa106815 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:19.652880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc8a565f-4073-4c5d-a614-411aaa106815 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:19.653317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc8a565f-4073-4c5d-a614-411aaa106815 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:19.683566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cc8a565f-4073-4c5d-a614-411aaa106815 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043221 Jul 14 16:01:19.684152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 770/1440] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:19 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:20.046500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-173f2d2e-59b9-4d7e-bb8f-0bf012bbb301 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:20.047091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-173f2d2e-59b9-4d7e-bb8f-0bf012bbb301 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:20.055376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-173f2d2e-59b9-4d7e-bb8f-0bf012bbb301 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:20.055865 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-173f2d2e-59b9-4d7e-bb8f-0bf012bbb301 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:20.057231 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-173f2d2e-59b9-4d7e-bb8f-0bf012bbb301 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:20.057674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-173f2d2e-59b9-4d7e-bb8f-0bf012bbb301 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:20.120382 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-173f2d2e-59b9-4d7e-bb8f-0bf012bbb301 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:20.127897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-173f2d2e-59b9-4d7e-bb8f-0bf012bbb301 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085232 Jul 14 16:01:20.128454 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 671/1441] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:20 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:20.582932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-006b4560-435a-47cf-b0c1-d08a1c237572 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:20.583882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-006b4560-435a-47cf-b0c1-d08a1c237572 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:20.590674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-006b4560-435a-47cf-b0c1-d08a1c237572 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:20.591130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-006b4560-435a-47cf-b0c1-d08a1c237572 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:20.591922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-006b4560-435a-47cf-b0c1-d08a1c237572 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:20.592364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-006b4560-435a-47cf-b0c1-d08a1c237572 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:20.622321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-006b4560-435a-47cf-b0c1-d08a1c237572 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043332 Jul 14 16:01:20.622886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 771/1442] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:20 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:20.695732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5874b01b-8da3-4d54-8757-139d539b4a9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:20.696668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5874b01b-8da3-4d54-8757-139d539b4a9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:20.704283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5874b01b-8da3-4d54-8757-139d539b4a9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:20.704746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5874b01b-8da3-4d54-8757-139d539b4a9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:20.705518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5874b01b-8da3-4d54-8757-139d539b4a9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:20.705952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5874b01b-8da3-4d54-8757-139d539b4a9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:20.709651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:20.737574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5874b01b-8da3-4d54-8757-139d539b4a9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045864 Jul 14 16:01:20.738131 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 672/1443] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:20 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:21.145489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0a351cd5-cea1-4049-bee7-9474888212f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:21.146115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0a351cd5-cea1-4049-bee7-9474888212f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:21.156624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a351cd5-cea1-4049-bee7-9474888212f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:21.157077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a351cd5-cea1-4049-bee7-9474888212f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:21.157841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a351cd5-cea1-4049-bee7-9474888212f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:21.158287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a351cd5-cea1-4049-bee7-9474888212f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:21.224463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0a351cd5-cea1-4049-bee7-9474888212f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:21.233172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0a351cd5-cea1-4049-bee7-9474888212f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.091317 Jul 14 16:01:21.233769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 772/1444] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:21 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:21.634682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bff1291b-967b-4e6c-93ff-f8cc5830b9ae tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:21.635044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bff1291b-967b-4e6c-93ff-f8cc5830b9ae tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:21.641429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bff1291b-967b-4e6c-93ff-f8cc5830b9ae tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:21.641889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bff1291b-967b-4e6c-93ff-f8cc5830b9ae tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:21.642672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bff1291b-967b-4e6c-93ff-f8cc5830b9ae tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:21.643111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bff1291b-967b-4e6c-93ff-f8cc5830b9ae tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:21.674485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bff1291b-967b-4e6c-93ff-f8cc5830b9ae tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044370 Jul 14 16:01:21.675057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 673/1445] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:21 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:21.750061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3a302a77-970a-4ea9-9af4-d2401e65b32a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:21.750997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3a302a77-970a-4ea9-9af4-d2401e65b32a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:21.757733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3a302a77-970a-4ea9-9af4-d2401e65b32a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:21.758176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3a302a77-970a-4ea9-9af4-d2401e65b32a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:21.758937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3a302a77-970a-4ea9-9af4-d2401e65b32a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:21.759429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3a302a77-970a-4ea9-9af4-d2401e65b32a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:21.788984 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3a302a77-970a-4ea9-9af4-d2401e65b32a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042890 Jul 14 16:01:21.789550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 773/1446] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:21 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:22.252296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ef00546f-6f02-45a6-bd72-cae767d8b6a4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:22.252840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ef00546f-6f02-45a6-bd72-cae767d8b6a4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:22.259766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ef00546f-6f02-45a6-bd72-cae767d8b6a4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:22.259995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ef00546f-6f02-45a6-bd72-cae767d8b6a4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:22.260768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ef00546f-6f02-45a6-bd72-cae767d8b6a4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:22.261208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ef00546f-6f02-45a6-bd72-cae767d8b6a4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:22.329173 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ef00546f-6f02-45a6-bd72-cae767d8b6a4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:22.336821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ef00546f-6f02-45a6-bd72-cae767d8b6a4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088587 Jul 14 16:01:22.338305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 674/1447] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:22 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:22.686272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-add9b8fd-4448-4443-a074-fc1c945f63d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:22.687264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-add9b8fd-4448-4443-a074-fc1c945f63d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:22.693473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-add9b8fd-4448-4443-a074-fc1c945f63d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:22.693924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-add9b8fd-4448-4443-a074-fc1c945f63d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:22.694718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-add9b8fd-4448-4443-a074-fc1c945f63d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:22.695174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-add9b8fd-4448-4443-a074-fc1c945f63d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:22.726762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-add9b8fd-4448-4443-a074-fc1c945f63d3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044504 Jul 14 16:01:22.727335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 774/1448] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:22 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:22.801277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-46f2a113-3f27-4303-9450-f09182792e52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:22.802201 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-46f2a113-3f27-4303-9450-f09182792e52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:22.809141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-46f2a113-3f27-4303-9450-f09182792e52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:22.809593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-46f2a113-3f27-4303-9450-f09182792e52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:22.810359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-46f2a113-3f27-4303-9450-f09182792e52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:22.810804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-46f2a113-3f27-4303-9450-f09182792e52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:22.842481 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-46f2a113-3f27-4303-9450-f09182792e52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045130 Jul 14 16:01:22.843049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 675/1449] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:22 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:23.355658 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d5af2279-a32d-4cb5-b353-526e0d2ab73b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:23.356207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d5af2279-a32d-4cb5-b353-526e0d2ab73b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:23.363224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d5af2279-a32d-4cb5-b353-526e0d2ab73b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.363721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d5af2279-a32d-4cb5-b353-526e0d2ab73b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.364609 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d5af2279-a32d-4cb5-b353-526e0d2ab73b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.365066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d5af2279-a32d-4cb5-b353-526e0d2ab73b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.429963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d5af2279-a32d-4cb5-b353-526e0d2ab73b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:23.439696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d5af2279-a32d-4cb5-b353-526e0d2ab73b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088548 Jul 14 16:01:23.440272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 775/1450] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:23 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:23.738737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-01e5a677-2e23-494a-a297-dd14f7fa5f6a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:23.739697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-01e5a677-2e23-494a-a297-dd14f7fa5f6a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:23.746811 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01e5a677-2e23-494a-a297-dd14f7fa5f6a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.747260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01e5a677-2e23-494a-a297-dd14f7fa5f6a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.748064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01e5a677-2e23-494a-a297-dd14f7fa5f6a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.748512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-01e5a677-2e23-494a-a297-dd14f7fa5f6a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.777583 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-01e5a677-2e23-494a-a297-dd14f7fa5f6a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042856 Jul 14 16:01:23.778150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 676/1451] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:23 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:23.857768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-575f185a-30ab-4a45-bdbf-35a0e81de493 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:23.859898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-575f185a-30ab-4a45-bdbf-35a0e81de493 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:23.866665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-575f185a-30ab-4a45-bdbf-35a0e81de493 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.867146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-575f185a-30ab-4a45-bdbf-35a0e81de493 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.868131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-575f185a-30ab-4a45-bdbf-35a0e81de493 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:23.869243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-575f185a-30ab-4a45-bdbf-35a0e81de493 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:23.908443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-575f185a-30ab-4a45-bdbf-35a0e81de493 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.057991 Jul 14 16:01:23.909131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 776/1452] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:23 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:24.457440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-05b7ac48-91ac-4bce-9d9f-d3a145b21bf9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:24.458061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-05b7ac48-91ac-4bce-9d9f-d3a145b21bf9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:24.465069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-05b7ac48-91ac-4bce-9d9f-d3a145b21bf9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:24.465523 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-05b7ac48-91ac-4bce-9d9f-d3a145b21bf9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:24.466291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-05b7ac48-91ac-4bce-9d9f-d3a145b21bf9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:24.466733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-05b7ac48-91ac-4bce-9d9f-d3a145b21bf9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:24.530448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-05b7ac48-91ac-4bce-9d9f-d3a145b21bf9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:24.546024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-05b7ac48-91ac-4bce-9d9f-d3a145b21bf9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.092393 Jul 14 16:01:24.546631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 677/1453] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:24 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:24.789575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b2918b34-6e82-454d-a19e-1fe26400a92e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:24.790590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b2918b34-6e82-454d-a19e-1fe26400a92e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:24.797607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2918b34-6e82-454d-a19e-1fe26400a92e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:24.798050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2918b34-6e82-454d-a19e-1fe26400a92e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:24.798812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2918b34-6e82-454d-a19e-1fe26400a92e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:24.799245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2918b34-6e82-454d-a19e-1fe26400a92e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:24.824859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:24.830392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b2918b34-6e82-454d-a19e-1fe26400a92e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044831 Jul 14 16:01:24.830957 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 777/1454] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:24 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:24.920834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a15c458a-f65d-4d1b-9387-fe301bfd71fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:24.921861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a15c458a-f65d-4d1b-9387-fe301bfd71fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:24.928440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a15c458a-f65d-4d1b-9387-fe301bfd71fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:24.928896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a15c458a-f65d-4d1b-9387-fe301bfd71fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:24.929668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a15c458a-f65d-4d1b-9387-fe301bfd71fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:24.930112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a15c458a-f65d-4d1b-9387-fe301bfd71fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:24.960421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a15c458a-f65d-4d1b-9387-fe301bfd71fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043654 Jul 14 16:01:24.960987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 678/1455] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:24 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:25.564653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-98042974-c12c-4d92-9259-747b014afaef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:25.565272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-98042974-c12c-4d92-9259-747b014afaef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:25.567288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=82 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:25.573731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-98042974-c12c-4d92-9259-747b014afaef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:25.574348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-98042974-c12c-4d92-9259-747b014afaef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:25.575340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-98042974-c12c-4d92-9259-747b014afaef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:25.575826 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-98042974-c12c-4d92-9259-747b014afaef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:25.641337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-98042974-c12c-4d92-9259-747b014afaef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:25.648934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-98042974-c12c-4d92-9259-747b014afaef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.089287 Jul 14 16:01:25.649541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 778/1456] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:25 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:25.843053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c1d6d7c6-2a88-44ee-9246-e241fa3086cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:25.843949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c1d6d7c6-2a88-44ee-9246-e241fa3086cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:25.850127 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1d6d7c6-2a88-44ee-9246-e241fa3086cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:25.850584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1d6d7c6-2a88-44ee-9246-e241fa3086cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:25.851351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1d6d7c6-2a88-44ee-9246-e241fa3086cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:25.852254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1d6d7c6-2a88-44ee-9246-e241fa3086cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:25.890540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c1d6d7c6-2a88-44ee-9246-e241fa3086cb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051507 Jul 14 16:01:25.891114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 679/1457] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:25 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:25.972547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-acebd74c-b549-4ab7-bdaf-045b35294a4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:25.973468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-acebd74c-b549-4ab7-bdaf-045b35294a4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:25.981742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acebd74c-b549-4ab7-bdaf-045b35294a4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:25.982194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acebd74c-b549-4ab7-bdaf-045b35294a4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:25.982967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acebd74c-b549-4ab7-bdaf-045b35294a4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:25.983408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acebd74c-b549-4ab7-bdaf-045b35294a4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.014291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-acebd74c-b549-4ab7-bdaf-045b35294a4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045642 Jul 14 16:01:26.014860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 779/1458] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:25 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:26.667110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c7666ba4-ed98-4e1d-953d-a872ef819499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:26.667743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c7666ba4-ed98-4e1d-953d-a872ef819499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:26.674273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7666ba4-ed98-4e1d-953d-a872ef819499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.674715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7666ba4-ed98-4e1d-953d-a872ef819499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.675483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7666ba4-ed98-4e1d-953d-a872ef819499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.675948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7666ba4-ed98-4e1d-953d-a872ef819499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.738224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c7666ba4-ed98-4e1d-953d-a872ef819499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:26.746625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c7666ba4-ed98-4e1d-953d-a872ef819499 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084087 Jul 14 16:01:26.747268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 680/1459] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:26 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:26.903468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5a1e0691-8eb2-4fd8-8a30-4044d7aba86f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:26.904428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5a1e0691-8eb2-4fd8-8a30-4044d7aba86f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:26.911028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a1e0691-8eb2-4fd8-8a30-4044d7aba86f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.911483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a1e0691-8eb2-4fd8-8a30-4044d7aba86f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.912419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a1e0691-8eb2-4fd8-8a30-4044d7aba86f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:26.912859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a1e0691-8eb2-4fd8-8a30-4044d7aba86f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:26.943506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5a1e0691-8eb2-4fd8-8a30-4044d7aba86f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044745 Jul 14 16:01:26.944020 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 780/1460] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:26 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:27.026062 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3e0dcf70-df81-4eb2-9cb1-04b300a6b5e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:27.027019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3e0dcf70-df81-4eb2-9cb1-04b300a6b5e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:27.033821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e0dcf70-df81-4eb2-9cb1-04b300a6b5e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.034282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e0dcf70-df81-4eb2-9cb1-04b300a6b5e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.035324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e0dcf70-df81-4eb2-9cb1-04b300a6b5e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.035888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e0dcf70-df81-4eb2-9cb1-04b300a6b5e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.065395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3e0dcf70-df81-4eb2-9cb1-04b300a6b5e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043928 Jul 14 16:01:27.065956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 681/1461] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:27 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:27.763715 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-193a4e1d-09b4-42e5-9e18-a6fd917ea647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:27.764323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-193a4e1d-09b4-42e5-9e18-a6fd917ea647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:27.770920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-193a4e1d-09b4-42e5-9e18-a6fd917ea647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.771370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-193a4e1d-09b4-42e5-9e18-a6fd917ea647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.772172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-193a4e1d-09b4-42e5-9e18-a6fd917ea647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.772606 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-193a4e1d-09b4-42e5-9e18-a6fd917ea647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.839376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-193a4e1d-09b4-42e5-9e18-a6fd917ea647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:27.847258 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-193a4e1d-09b4-42e5-9e18-a6fd917ea647 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087589 Jul 14 16:01:27.847868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 781/1462] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:27 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:27.956064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bb46eda6-ba84-4f64-ad99-ba09f1a67dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:27.956992 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bb46eda6-ba84-4f64-ad99-ba09f1a67dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:27.964860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb46eda6-ba84-4f64-ad99-ba09f1a67dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.965317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb46eda6-ba84-4f64-ad99-ba09f1a67dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.966093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb46eda6-ba84-4f64-ad99-ba09f1a67dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:27.966538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb46eda6-ba84-4f64-ad99-ba09f1a67dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:27.999913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bb46eda6-ba84-4f64-ad99-ba09f1a67dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047728 Jul 14 16:01:28.000507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 682/1463] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:27 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:28.077382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8aac3cb7-983b-4d28-bd82-eefddf5a5264 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:28.078211 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8aac3cb7-983b-4d28-bd82-eefddf5a5264 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:28.084505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8aac3cb7-983b-4d28-bd82-eefddf5a5264 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:28.084962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8aac3cb7-983b-4d28-bd82-eefddf5a5264 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:28.085766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8aac3cb7-983b-4d28-bd82-eefddf5a5264 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:28.086209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8aac3cb7-983b-4d28-bd82-eefddf5a5264 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:28.116797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8aac3cb7-983b-4d28-bd82-eefddf5a5264 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043424 Jul 14 16:01:28.117365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 782/1464] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:28 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:28.865585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cbb35cf3-19b1-4edd-99b2-3396d1b8aca7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:28.866143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cbb35cf3-19b1-4edd-99b2-3396d1b8aca7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:28.872759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cbb35cf3-19b1-4edd-99b2-3396d1b8aca7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:28.873212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cbb35cf3-19b1-4edd-99b2-3396d1b8aca7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:28.873985 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cbb35cf3-19b1-4edd-99b2-3396d1b8aca7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:28.874425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cbb35cf3-19b1-4edd-99b2-3396d1b8aca7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:28.935073 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cbb35cf3-19b1-4edd-99b2-3396d1b8aca7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:28.943453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cbb35cf3-19b1-4edd-99b2-3396d1b8aca7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081838 Jul 14 16:01:28.944172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 683/1465] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:28 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:29.014360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ddef26d7-13ec-4c46-b6b8-c922297a5597 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:29.015296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ddef26d7-13ec-4c46-b6b8-c922297a5597 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:29.022485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddef26d7-13ec-4c46-b6b8-c922297a5597 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.022939 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddef26d7-13ec-4c46-b6b8-c922297a5597 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.023818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddef26d7-13ec-4c46-b6b8-c922297a5597 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.024390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddef26d7-13ec-4c46-b6b8-c922297a5597 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.059895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ddef26d7-13ec-4c46-b6b8-c922297a5597 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051548 Jul 14 16:01:29.060441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 783/1466] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:29 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:29.128699 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ab134dc7-1bb1-4633-830f-c48a4fcef523 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:29.133582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ab134dc7-1bb1-4633-830f-c48a4fcef523 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:29.136788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab134dc7-1bb1-4633-830f-c48a4fcef523 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.137240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab134dc7-1bb1-4633-830f-c48a4fcef523 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.138008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab134dc7-1bb1-4633-830f-c48a4fcef523 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.138451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab134dc7-1bb1-4633-830f-c48a4fcef523 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.168663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ab134dc7-1bb1-4633-830f-c48a4fcef523 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043944 Jul 14 16:01:29.169217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 684/1467] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:29 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:29.961705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-22e01405-5ed7-4d2c-8436-8f33a28c912b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:29.963668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-22e01405-5ed7-4d2c-8436-8f33a28c912b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:29.969801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22e01405-5ed7-4d2c-8436-8f33a28c912b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.970246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22e01405-5ed7-4d2c-8436-8f33a28c912b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:29.971007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22e01405-5ed7-4d2c-8436-8f33a28c912b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:29.971442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22e01405-5ed7-4d2c-8436-8f33a28c912b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.037901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-22e01405-5ed7-4d2c-8436-8f33a28c912b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:30.048979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-22e01405-5ed7-4d2c-8436-8f33a28c912b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.091110 Jul 14 16:01:30.051743 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 784/1468] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:29 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:30.074460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d597d6e1-457e-49a1-af5d-80d4f8a96d73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:30.075855 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d597d6e1-457e-49a1-af5d-80d4f8a96d73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:30.085202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d597d6e1-457e-49a1-af5d-80d4f8a96d73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.085202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d597d6e1-457e-49a1-af5d-80d4f8a96d73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.086140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d597d6e1-457e-49a1-af5d-80d4f8a96d73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.086791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d597d6e1-457e-49a1-af5d-80d4f8a96d73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.127913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d597d6e1-457e-49a1-af5d-80d4f8a96d73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059834 Jul 14 16:01:30.128491 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 685/1469] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:30 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:30.180151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5785cc75-f3ce-4d28-b01c-6071e5e9f48e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:30.182309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5785cc75-f3ce-4d28-b01c-6071e5e9f48e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:30.188419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5785cc75-f3ce-4d28-b01c-6071e5e9f48e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.188872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5785cc75-f3ce-4d28-b01c-6071e5e9f48e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.189646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5785cc75-f3ce-4d28-b01c-6071e5e9f48e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:30.190082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5785cc75-f3ce-4d28-b01c-6071e5e9f48e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:30.222359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5785cc75-f3ce-4d28-b01c-6071e5e9f48e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046152 Jul 14 16:01:30.222841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 785/1470] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:30 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:31.070141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ec37551e-1fed-46ef-9096-67ddab6f0a04 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:31.070747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ec37551e-1fed-46ef-9096-67ddab6f0a04 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:31.073235 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=86 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:31.078565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec37551e-1fed-46ef-9096-67ddab6f0a04 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.079009 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec37551e-1fed-46ef-9096-67ddab6f0a04 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.079804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec37551e-1fed-46ef-9096-67ddab6f0a04 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.080238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec37551e-1fed-46ef-9096-67ddab6f0a04 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.139945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ae19d212-6774-4f2c-8619-103f99a9391f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:31.141019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ae19d212-6774-4f2c-8619-103f99a9391f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:31.147746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ae19d212-6774-4f2c-8619-103f99a9391f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.147931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ec37551e-1fed-46ef-9096-67ddab6f0a04 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:31.148209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ae19d212-6774-4f2c-8619-103f99a9391f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.148983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ae19d212-6774-4f2c-8619-103f99a9391f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.149912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ae19d212-6774-4f2c-8619-103f99a9391f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.162460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ec37551e-1fed-46ef-9096-67ddab6f0a04 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.095882 Jul 14 16:01:31.163288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 686/1471] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:31 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:31.181511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ae19d212-6774-4f2c-8619-103f99a9391f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Jul 14 16:01:31.182085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 786/1472] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:31 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:31.236599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7d2fa6d5-c405-4f8e-92ac-af64685c8600 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:31.237908 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7d2fa6d5-c405-4f8e-92ac-af64685c8600 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:31.247977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d2fa6d5-c405-4f8e-92ac-af64685c8600 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.248685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d2fa6d5-c405-4f8e-92ac-af64685c8600 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.250104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d2fa6d5-c405-4f8e-92ac-af64685c8600 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:31.250882 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d2fa6d5-c405-4f8e-92ac-af64685c8600 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:31.282928 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7d2fa6d5-c405-4f8e-92ac-af64685c8600 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052111 Jul 14 16:01:31.283493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 687/1473] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:31 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:32.181704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ae80945c-0b0e-40a8-b0c7-da23d32ed2d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:32.182427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ae80945c-0b0e-40a8-b0c7-da23d32ed2d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:32.189059 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ae80945c-0b0e-40a8-b0c7-da23d32ed2d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:32.189519 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ae80945c-0b0e-40a8-b0c7-da23d32ed2d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:32.190283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ae80945c-0b0e-40a8-b0c7-da23d32ed2d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:32.190724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ae80945c-0b0e-40a8-b0c7-da23d32ed2d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:32.192350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-900c70d8-c913-495e-9827-faf79879012d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:32.193279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-900c70d8-c913-495e-9827-faf79879012d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:32.199759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-900c70d8-c913-495e-9827-faf79879012d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:32.200220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-900c70d8-c913-495e-9827-faf79879012d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:32.200989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-900c70d8-c913-495e-9827-faf79879012d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:32.201432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-900c70d8-c913-495e-9827-faf79879012d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:32.226060 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:32.232096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-900c70d8-c913-495e-9827-faf79879012d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043576 Jul 14 16:01:32.232919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 688/1474] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:32 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:32.253261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ae80945c-0b0e-40a8-b0c7-da23d32ed2d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:32.260881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ae80945c-0b0e-40a8-b0c7-da23d32ed2d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083921 Jul 14 16:01:32.261445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 787/1475] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:32 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:32.294706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-85901111-21eb-42ae-a9e3-b6da6f8b0f31 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:32.295657 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-85901111-21eb-42ae-a9e3-b6da6f8b0f31 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:32.301845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85901111-21eb-42ae-a9e3-b6da6f8b0f31 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:32.302300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85901111-21eb-42ae-a9e3-b6da6f8b0f31 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:32.303069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85901111-21eb-42ae-a9e3-b6da6f8b0f31 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:32.303514 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85901111-21eb-42ae-a9e3-b6da6f8b0f31 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:32.332629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-85901111-21eb-42ae-a9e3-b6da6f8b0f31 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042470 Jul 14 16:01:32.333190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 689/1476] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:32 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:33.244488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d3c15ccf-7537-4537-a870-f3e2ab87d41b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:33.245408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d3c15ccf-7537-4537-a870-f3e2ab87d41b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:33.251563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d3c15ccf-7537-4537-a870-f3e2ab87d41b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.251986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d3c15ccf-7537-4537-a870-f3e2ab87d41b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.252750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d3c15ccf-7537-4537-a870-f3e2ab87d41b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.253189 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d3c15ccf-7537-4537-a870-f3e2ab87d41b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.277994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-27d985d8-d1e5-406d-9a1f-5f954b7156f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:33.278604 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-27d985d8-d1e5-406d-9a1f-5f954b7156f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:33.283803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d3c15ccf-7537-4537-a870-f3e2ab87d41b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043971 Jul 14 16:01:33.284384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 788/1477] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:33 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:33.285309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-27d985d8-d1e5-406d-9a1f-5f954b7156f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.285884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-27d985d8-d1e5-406d-9a1f-5f954b7156f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.286681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-27d985d8-d1e5-406d-9a1f-5f954b7156f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.287125 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-27d985d8-d1e5-406d-9a1f-5f954b7156f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.344037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-de531e78-618a-4496-8cea-eac2b8adbbb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:33.344963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-de531e78-618a-4496-8cea-eac2b8adbbb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:33.351186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de531e78-618a-4496-8cea-eac2b8adbbb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.351666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de531e78-618a-4496-8cea-eac2b8adbbb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.352048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-27d985d8-d1e5-406d-9a1f-5f954b7156f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:33.352477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de531e78-618a-4496-8cea-eac2b8adbbb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:33.353186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-de531e78-618a-4496-8cea-eac2b8adbbb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:33.360734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-27d985d8-d1e5-406d-9a1f-5f954b7156f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086817 Jul 14 16:01:33.361317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 690/1478] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:33 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:33.385214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-de531e78-618a-4496-8cea-eac2b8adbbb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044048 Jul 14 16:01:33.385810 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 789/1479] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:33 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:34.296478 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-81db60e5-b75c-4c52-a6d4-7051ecde832d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:34.297301 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-81db60e5-b75c-4c52-a6d4-7051ecde832d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:34.304106 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81db60e5-b75c-4c52-a6d4-7051ecde832d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.304552 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81db60e5-b75c-4c52-a6d4-7051ecde832d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.305325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81db60e5-b75c-4c52-a6d4-7051ecde832d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.305909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81db60e5-b75c-4c52-a6d4-7051ecde832d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.335907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-81db60e5-b75c-4c52-a6d4-7051ecde832d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043290 Jul 14 16:01:34.336468 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 691/1480] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:34 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:34.377806 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f8c9ad71-9557-4571-bdda-5830fabf51e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:34.378537 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f8c9ad71-9557-4571-bdda-5830fabf51e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:34.386213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8c9ad71-9557-4571-bdda-5830fabf51e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.386913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8c9ad71-9557-4571-bdda-5830fabf51e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.387690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8c9ad71-9557-4571-bdda-5830fabf51e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.388121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8c9ad71-9557-4571-bdda-5830fabf51e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.396880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f68c5ae3-20e4-416d-a8e8-c8d4155c10c9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:34.397799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f68c5ae3-20e4-416d-a8e8-c8d4155c10c9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:34.404609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f68c5ae3-20e4-416d-a8e8-c8d4155c10c9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.405037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f68c5ae3-20e4-416d-a8e8-c8d4155c10c9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.405816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f68c5ae3-20e4-416d-a8e8-c8d4155c10c9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:34.406255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f68c5ae3-20e4-416d-a8e8-c8d4155c10c9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:34.437248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f68c5ae3-20e4-416d-a8e8-c8d4155c10c9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044199 Jul 14 16:01:34.437829 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 692/1481] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:34 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:34.452157 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f8c9ad71-9557-4571-bdda-5830fabf51e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:34.459469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f8c9ad71-9557-4571-bdda-5830fabf51e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085500 Jul 14 16:01:34.460076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 790/1482] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:34 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:35.349826 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ba3f1c44-b4de-4833-8e34-93a9df5b6cb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:35.351339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ba3f1c44-b4de-4833-8e34-93a9df5b6cb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:35.362691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba3f1c44-b4de-4833-8e34-93a9df5b6cb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.363320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba3f1c44-b4de-4833-8e34-93a9df5b6cb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.364441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba3f1c44-b4de-4833-8e34-93a9df5b6cb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.365105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba3f1c44-b4de-4833-8e34-93a9df5b6cb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.403130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ba3f1c44-b4de-4833-8e34-93a9df5b6cb8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.058439 Jul 14 16:01:35.403693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 693/1483] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:35 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:35.448949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c285e555-d495-4472-961f-960df2fdeb48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:35.449899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c285e555-d495-4472-961f-960df2fdeb48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:35.456532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c285e555-d495-4472-961f-960df2fdeb48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.456997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c285e555-d495-4472-961f-960df2fdeb48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.457756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c285e555-d495-4472-961f-960df2fdeb48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.458194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c285e555-d495-4472-961f-960df2fdeb48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.476951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7893acfb-0a78-4ce9-beb2-8c2b62e8f55b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:35.478269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7893acfb-0a78-4ce9-beb2-8c2b62e8f55b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:35.484964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7893acfb-0a78-4ce9-beb2-8c2b62e8f55b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.485424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7893acfb-0a78-4ce9-beb2-8c2b62e8f55b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.486166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7893acfb-0a78-4ce9-beb2-8c2b62e8f55b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:35.486597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7893acfb-0a78-4ce9-beb2-8c2b62e8f55b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:35.488383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c285e555-d495-4472-961f-960df2fdeb48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043467 Jul 14 16:01:35.488956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 791/1484] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:35 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:35.548758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7893acfb-0a78-4ce9-beb2-8c2b62e8f55b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:35.556313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7893acfb-0a78-4ce9-beb2-8c2b62e8f55b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083294 Jul 14 16:01:35.556886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 694/1485] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:35 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:36.415417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-44b673fa-1ccc-4bb3-90a8-69b3b6cd37b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:36.416369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-44b673fa-1ccc-4bb3-90a8-69b3b6cd37b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:36.422461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-44b673fa-1ccc-4bb3-90a8-69b3b6cd37b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.422916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-44b673fa-1ccc-4bb3-90a8-69b3b6cd37b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.423717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-44b673fa-1ccc-4bb3-90a8-69b3b6cd37b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.424159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-44b673fa-1ccc-4bb3-90a8-69b3b6cd37b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.455127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-44b673fa-1ccc-4bb3-90a8-69b3b6cd37b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043889 Jul 14 16:01:36.456130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 792/1486] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:36 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:36.500709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8602c81d-21cf-4746-b446-e379fe43b97f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:36.501679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8602c81d-21cf-4746-b446-e379fe43b97f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:36.508190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8602c81d-21cf-4746-b446-e379fe43b97f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.509350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8602c81d-21cf-4746-b446-e379fe43b97f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.510139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8602c81d-21cf-4746-b446-e379fe43b97f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.510572 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8602c81d-21cf-4746-b446-e379fe43b97f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.541348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8602c81d-21cf-4746-b446-e379fe43b97f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044454 Jul 14 16:01:36.542110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 695/1487] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:36 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:36.574305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1b409daf-c56c-45eb-bcd8-64179a53f1f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:36.574840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1b409daf-c56c-45eb-bcd8-64179a53f1f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:36.580954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b409daf-c56c-45eb-bcd8-64179a53f1f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.581406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b409daf-c56c-45eb-bcd8-64179a53f1f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.582166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b409daf-c56c-45eb-bcd8-64179a53f1f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:36.582605 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1b409daf-c56c-45eb-bcd8-64179a53f1f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:36.647298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1b409daf-c56c-45eb-bcd8-64179a53f1f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:36.654923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1b409daf-c56c-45eb-bcd8-64179a53f1f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085251 Jul 14 16:01:36.655492 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 793/1488] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:36 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:37.467308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-45e463ba-4573-4b70-9ccd-f41e681af3ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:37.468303 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-45e463ba-4573-4b70-9ccd-f41e681af3ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:37.474282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45e463ba-4573-4b70-9ccd-f41e681af3ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.474728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45e463ba-4573-4b70-9ccd-f41e681af3ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.475483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45e463ba-4573-4b70-9ccd-f41e681af3ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.475957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45e463ba-4573-4b70-9ccd-f41e681af3ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.518897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-45e463ba-4573-4b70-9ccd-f41e681af3ad tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055517 Jul 14 16:01:37.519618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 696/1489] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:37 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:37.554077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4f9850bd-b9e9-426b-b22e-5a93307e2ac5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:37.554997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4f9850bd-b9e9-426b-b22e-5a93307e2ac5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:37.561875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f9850bd-b9e9-426b-b22e-5a93307e2ac5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.562318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f9850bd-b9e9-426b-b22e-5a93307e2ac5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.563076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f9850bd-b9e9-426b-b22e-5a93307e2ac5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.563505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f9850bd-b9e9-426b-b22e-5a93307e2ac5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.581170 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:37.595641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4f9850bd-b9e9-426b-b22e-5a93307e2ac5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045442 Jul 14 16:01:37.596206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 794/1490] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:37 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:37.672585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-94f70f0b-500a-4631-af98-09126bb88e70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:37.673232 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-94f70f0b-500a-4631-af98-09126bb88e70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:37.679460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-94f70f0b-500a-4631-af98-09126bb88e70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.680221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-94f70f0b-500a-4631-af98-09126bb88e70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.681276 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-94f70f0b-500a-4631-af98-09126bb88e70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:37.681729 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-94f70f0b-500a-4631-af98-09126bb88e70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:37.742604 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-94f70f0b-500a-4631-af98-09126bb88e70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:37.750781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-94f70f0b-500a-4631-af98-09126bb88e70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082408 Jul 14 16:01:37.751348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 697/1491] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:37 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:38.531172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-69e36997-6ab3-4a03-bc45-3ff0e39813bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:38.532113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-69e36997-6ab3-4a03-bc45-3ff0e39813bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:38.538404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69e36997-6ab3-4a03-bc45-3ff0e39813bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.538851 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69e36997-6ab3-4a03-bc45-3ff0e39813bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.539621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69e36997-6ab3-4a03-bc45-3ff0e39813bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.540797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69e36997-6ab3-4a03-bc45-3ff0e39813bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.571218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-69e36997-6ab3-4a03-bc45-3ff0e39813bb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043920 Jul 14 16:01:38.571939 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 795/1492] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:38 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:38.607938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-437235f1-9f0b-4fed-9243-61421e8c6163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:38.608871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-437235f1-9f0b-4fed-9243-61421e8c6163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:38.615524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-437235f1-9f0b-4fed-9243-61421e8c6163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.616013 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-437235f1-9f0b-4fed-9243-61421e8c6163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.616786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-437235f1-9f0b-4fed-9243-61421e8c6163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.617229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-437235f1-9f0b-4fed-9243-61421e8c6163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.646420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-437235f1-9f0b-4fed-9243-61421e8c6163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042504 Jul 14 16:01:38.646989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 698/1493] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:38 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:38.768457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5d9aa7fa-a51d-4ea3-a513-d4a8bcf27b66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:38.769075 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5d9aa7fa-a51d-4ea3-a513-d4a8bcf27b66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:38.775892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5d9aa7fa-a51d-4ea3-a513-d4a8bcf27b66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.776267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5d9aa7fa-a51d-4ea3-a513-d4a8bcf27b66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.777026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5d9aa7fa-a51d-4ea3-a513-d4a8bcf27b66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:38.777464 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5d9aa7fa-a51d-4ea3-a513-d4a8bcf27b66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:38.840682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5d9aa7fa-a51d-4ea3-a513-d4a8bcf27b66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:38.848172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5d9aa7fa-a51d-4ea3-a513-d4a8bcf27b66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083713 Jul 14 16:01:38.848741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 796/1494] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:38 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:39.582977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-26e09ae7-2c21-4882-aff3-4d9334c10ebb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:39.583955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-26e09ae7-2c21-4882-aff3-4d9334c10ebb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:39.590421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26e09ae7-2c21-4882-aff3-4d9334c10ebb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.590868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26e09ae7-2c21-4882-aff3-4d9334c10ebb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.591671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26e09ae7-2c21-4882-aff3-4d9334c10ebb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.592112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26e09ae7-2c21-4882-aff3-4d9334c10ebb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.622774 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-26e09ae7-2c21-4882-aff3-4d9334c10ebb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043705 Jul 14 16:01:39.623442 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 699/1495] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:39 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:39.659202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f15d12e1-ec19-4673-bc3c-01c57a4b344d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:39.660362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f15d12e1-ec19-4673-bc3c-01c57a4b344d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:39.667863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f15d12e1-ec19-4673-bc3c-01c57a4b344d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.668315 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f15d12e1-ec19-4673-bc3c-01c57a4b344d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.669072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f15d12e1-ec19-4673-bc3c-01c57a4b344d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.669507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f15d12e1-ec19-4673-bc3c-01c57a4b344d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.699930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f15d12e1-ec19-4673-bc3c-01c57a4b344d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044737 Jul 14 16:01:39.700487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 797/1496] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:39 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:39.865618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-929fa8dd-3170-4b18-a0df-8542973ba65a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:39.866239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-929fa8dd-3170-4b18-a0df-8542973ba65a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:39.872849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-929fa8dd-3170-4b18-a0df-8542973ba65a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.873301 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-929fa8dd-3170-4b18-a0df-8542973ba65a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.874095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-929fa8dd-3170-4b18-a0df-8542973ba65a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:39.874533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-929fa8dd-3170-4b18-a0df-8542973ba65a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:39.940035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-929fa8dd-3170-4b18-a0df-8542973ba65a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:39.948149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-929fa8dd-3170-4b18-a0df-8542973ba65a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086046 Jul 14 16:01:39.948721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 700/1497] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:39 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:40.635328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-eba4989f-63d1-4486-b821-fa2e10478be1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:40.636167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eba4989f-63d1-4486-b821-fa2e10478be1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:40.642242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eba4989f-63d1-4486-b821-fa2e10478be1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.642687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eba4989f-63d1-4486-b821-fa2e10478be1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.643440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eba4989f-63d1-4486-b821-fa2e10478be1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.643904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eba4989f-63d1-4486-b821-fa2e10478be1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.673999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-eba4989f-63d1-4486-b821-fa2e10478be1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043544 Jul 14 16:01:40.674731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 798/1498] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:40 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:40.711417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8f2cf3a0-0e22-47b6-91f6-cb505f3e3598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:40.712838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8f2cf3a0-0e22-47b6-91f6-cb505f3e3598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:40.719020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f2cf3a0-0e22-47b6-91f6-cb505f3e3598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.719472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f2cf3a0-0e22-47b6-91f6-cb505f3e3598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.720277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f2cf3a0-0e22-47b6-91f6-cb505f3e3598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.720716 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f2cf3a0-0e22-47b6-91f6-cb505f3e3598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.750835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8f2cf3a0-0e22-47b6-91f6-cb505f3e3598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043341 Jul 14 16:01:40.751419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 701/1499] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:40 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:40.966513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e701273-6511-459e-9753-1a117c460040 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:40.967135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e701273-6511-459e-9753-1a117c460040 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:40.973150 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e701273-6511-459e-9753-1a117c460040 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.973601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e701273-6511-459e-9753-1a117c460040 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:40.974355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e701273-6511-459e-9753-1a117c460040 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:40.974793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e701273-6511-459e-9753-1a117c460040 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.036740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e701273-6511-459e-9753-1a117c460040 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:41.044933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e701273-6511-459e-9753-1a117c460040 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082321 Jul 14 16:01:41.045497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 799/1500] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:40 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:41.686136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-40ad6273-72b4-4f91-87ff-073d4307aa9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:41.687075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-40ad6273-72b4-4f91-87ff-073d4307aa9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:41.693133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40ad6273-72b4-4f91-87ff-073d4307aa9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.693584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40ad6273-72b4-4f91-87ff-073d4307aa9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.694345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40ad6273-72b4-4f91-87ff-073d4307aa9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.694788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40ad6273-72b4-4f91-87ff-073d4307aa9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.724565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-40ad6273-72b4-4f91-87ff-073d4307aa9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042409 Jul 14 16:01:41.725168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 702/1501] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:41 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:41.763311 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-944a2163-afb8-45e4-b1af-9d62c1d1800b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:41.764294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-944a2163-afb8-45e4-b1af-9d62c1d1800b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:41.770902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-944a2163-afb8-45e4-b1af-9d62c1d1800b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.771374 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-944a2163-afb8-45e4-b1af-9d62c1d1800b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.772152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-944a2163-afb8-45e4-b1af-9d62c1d1800b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:41.772592 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-944a2163-afb8-45e4-b1af-9d62c1d1800b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:41.802877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-944a2163-afb8-45e4-b1af-9d62c1d1800b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044078 Jul 14 16:01:41.803442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 800/1502] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:41 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:42.062283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-772ce715-4262-44ba-b987-75f44201dbd4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:42.062897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-772ce715-4262-44ba-b987-75f44201dbd4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:42.068945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-772ce715-4262-44ba-b987-75f44201dbd4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.069402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-772ce715-4262-44ba-b987-75f44201dbd4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.070160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-772ce715-4262-44ba-b987-75f44201dbd4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.070599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-772ce715-4262-44ba-b987-75f44201dbd4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.135847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-772ce715-4262-44ba-b987-75f44201dbd4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:42.143371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-772ce715-4262-44ba-b987-75f44201dbd4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084927 Jul 14 16:01:42.143966 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 703/1503] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:42 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:42.737412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5b61d85d-3e63-4200-98c1-3258435daf23 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:42.738326 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5b61d85d-3e63-4200-98c1-3258435daf23 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:42.744394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5b61d85d-3e63-4200-98c1-3258435daf23 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.744834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5b61d85d-3e63-4200-98c1-3258435daf23 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.745584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5b61d85d-3e63-4200-98c1-3258435daf23 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.746010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5b61d85d-3e63-4200-98c1-3258435daf23 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.775698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5b61d85d-3e63-4200-98c1-3258435daf23 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042737 Jul 14 16:01:42.776374 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 801/1504] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:42 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:42.814775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0abfabb4-202b-40ec-b3d1-a5a1a7dc7122 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:42.815724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0abfabb4-202b-40ec-b3d1-a5a1a7dc7122 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:42.822747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0abfabb4-202b-40ec-b3d1-a5a1a7dc7122 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.823194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0abfabb4-202b-40ec-b3d1-a5a1a7dc7122 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.823996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0abfabb4-202b-40ec-b3d1-a5a1a7dc7122 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:42.824436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0abfabb4-202b-40ec-b3d1-a5a1a7dc7122 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:42.854431 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0abfabb4-202b-40ec-b3d1-a5a1a7dc7122 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043580 Jul 14 16:01:42.854990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 704/1505] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:42 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:43.160905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d8814653-8a03-4037-8ec7-fbd512da45ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:43.161509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d8814653-8a03-4037-8ec7-fbd512da45ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:43.168327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8814653-8a03-4037-8ec7-fbd512da45ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.168773 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8814653-8a03-4037-8ec7-fbd512da45ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.169703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8814653-8a03-4037-8ec7-fbd512da45ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.170362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8814653-8a03-4037-8ec7-fbd512da45ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.254703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d8814653-8a03-4037-8ec7-fbd512da45ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:43.262843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d8814653-8a03-4037-8ec7-fbd512da45ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.106084 Jul 14 16:01:43.263413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 802/1506] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:43 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:43.786796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9b7610b4-f471-47dd-b698-84f14c464800 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:43.787793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9b7610b4-f471-47dd-b698-84f14c464800 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:43.795298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b7610b4-f471-47dd-b698-84f14c464800 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.795794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b7610b4-f471-47dd-b698-84f14c464800 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.796560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b7610b4-f471-47dd-b698-84f14c464800 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.797000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b7610b4-f471-47dd-b698-84f14c464800 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.813631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:43.827564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9b7610b4-f471-47dd-b698-84f14c464800 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045071 Jul 14 16:01:43.828196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 705/1507] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:43 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:43.840874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:01:43.841038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:01:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:01:43.868185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c11fd3bc-5a8c-467e-aa1c-8ed7de799ae0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:43.869476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c11fd3bc-5a8c-467e-aa1c-8ed7de799ae0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:43.875992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c11fd3bc-5a8c-467e-aa1c-8ed7de799ae0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.876437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c11fd3bc-5a8c-467e-aa1c-8ed7de799ae0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.877191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c11fd3bc-5a8c-467e-aa1c-8ed7de799ae0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:43.877646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c11fd3bc-5a8c-467e-aa1c-8ed7de799ae0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:43.906026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c11fd3bc-5a8c-467e-aa1c-8ed7de799ae0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041880 Jul 14 16:01:43.906569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 803/1508] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:43 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:44.280116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cb6dc3c9-9a0b-4d2d-97c1-f69c5746a943 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.280721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cb6dc3c9-9a0b-4d2d-97c1-f69c5746a943 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.287212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb6dc3c9-9a0b-4d2d-97c1-f69c5746a943 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.287691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb6dc3c9-9a0b-4d2d-97c1-f69c5746a943 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.288451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb6dc3c9-9a0b-4d2d-97c1-f69c5746a943 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.288886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb6dc3c9-9a0b-4d2d-97c1-f69c5746a943 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.350178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cb6dc3c9-9a0b-4d2d-97c1-f69c5746a943 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:44.358071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cb6dc3c9-9a0b-4d2d-97c1-f69c5746a943 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081795 Jul 14 16:01:44.358628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 706/1509] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:44 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:44.838971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d5e96de6-0bc1-4fc4-b92d-6f7aea92c11b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.839920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d5e96de6-0bc1-4fc4-b92d-6f7aea92c11b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.846330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d5e96de6-0bc1-4fc4-b92d-6f7aea92c11b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.846913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d5e96de6-0bc1-4fc4-b92d-6f7aea92c11b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.847730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d5e96de6-0bc1-4fc4-b92d-6f7aea92c11b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.848406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d5e96de6-0bc1-4fc4-b92d-6f7aea92c11b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.880902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d5e96de6-0bc1-4fc4-b92d-6f7aea92c11b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046135 Jul 14 16:01:44.881598 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 804/1510] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:44 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:44.921068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a8db01e2-9aea-4a40-af0a-251b79340c56 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:44.922453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a8db01e2-9aea-4a40-af0a-251b79340c56 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:44.930489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8db01e2-9aea-4a40-af0a-251b79340c56 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.930945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8db01e2-9aea-4a40-af0a-251b79340c56 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.932283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8db01e2-9aea-4a40-af0a-251b79340c56 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:44.932728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8db01e2-9aea-4a40-af0a-251b79340c56 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:44.963359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a8db01e2-9aea-4a40-af0a-251b79340c56 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049729 Jul 14 16:01:44.963952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 707/1511] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:44 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:45.374640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-660c6a15-a905-4a6d-90dd-21b8ffe49bd3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:45.375329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-660c6a15-a905-4a6d-90dd-21b8ffe49bd3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:45.381601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-660c6a15-a905-4a6d-90dd-21b8ffe49bd3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.381939 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-660c6a15-a905-4a6d-90dd-21b8ffe49bd3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.382708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-660c6a15-a905-4a6d-90dd-21b8ffe49bd3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.383137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-660c6a15-a905-4a6d-90dd-21b8ffe49bd3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.462849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-660c6a15-a905-4a6d-90dd-21b8ffe49bd3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:45.470860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-660c6a15-a905-4a6d-90dd-21b8ffe49bd3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.100037 Jul 14 16:01:45.471466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 805/1512] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:45 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:45.892823 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b5bf2656-345a-4d43-a2e9-9bb0be54da43 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:45.893925 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b5bf2656-345a-4d43-a2e9-9bb0be54da43 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:45.900441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5bf2656-345a-4d43-a2e9-9bb0be54da43 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.900984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5bf2656-345a-4d43-a2e9-9bb0be54da43 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.901773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5bf2656-345a-4d43-a2e9-9bb0be54da43 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.902218 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5bf2656-345a-4d43-a2e9-9bb0be54da43 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.940534 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b5bf2656-345a-4d43-a2e9-9bb0be54da43 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051361 Jul 14 16:01:45.941853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 708/1513] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:45 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:45.975252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f2840aff-5352-4c42-b13e-bc2a965de481 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:45.976455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f2840aff-5352-4c42-b13e-bc2a965de481 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:45.985020 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f2840aff-5352-4c42-b13e-bc2a965de481 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.985570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f2840aff-5352-4c42-b13e-bc2a965de481 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:45.988390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f2840aff-5352-4c42-b13e-bc2a965de481 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:45.988857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f2840aff-5352-4c42-b13e-bc2a965de481 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.020214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f2840aff-5352-4c42-b13e-bc2a965de481 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048989 Jul 14 16:01:46.020820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 806/1514] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:45 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:46.491705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e7d13edf-f723-4799-9116-60711754e267 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:46.492324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e7d13edf-f723-4799-9116-60711754e267 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:46.499121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7d13edf-f723-4799-9116-60711754e267 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.499575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7d13edf-f723-4799-9116-60711754e267 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.500375 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7d13edf-f723-4799-9116-60711754e267 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.500820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7d13edf-f723-4799-9116-60711754e267 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.562062 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e7d13edf-f723-4799-9116-60711754e267 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:46.569996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e7d13edf-f723-4799-9116-60711754e267 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082674 Jul 14 16:01:46.570595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 709/1515] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:46 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:46.953421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9197a244-b0a9-4231-a8a8-c510fa778268 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:46.954366 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9197a244-b0a9-4231-a8a8-c510fa778268 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:46.960374 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9197a244-b0a9-4231-a8a8-c510fa778268 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.960815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9197a244-b0a9-4231-a8a8-c510fa778268 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.961622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9197a244-b0a9-4231-a8a8-c510fa778268 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:46.962052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9197a244-b0a9-4231-a8a8-c510fa778268 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:46.991393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9197a244-b0a9-4231-a8a8-c510fa778268 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041907 Jul 14 16:01:46.992086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 807/1516] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:46 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:47.031665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dfdef8f2-f4a5-46a1-9f03-ccf0163797e3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:47.032586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dfdef8f2-f4a5-46a1-9f03-ccf0163797e3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:47.039351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dfdef8f2-f4a5-46a1-9f03-ccf0163797e3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.040022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dfdef8f2-f4a5-46a1-9f03-ccf0163797e3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.040793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dfdef8f2-f4a5-46a1-9f03-ccf0163797e3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.041229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dfdef8f2-f4a5-46a1-9f03-ccf0163797e3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.070520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dfdef8f2-f4a5-46a1-9f03-ccf0163797e3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042789 Jul 14 16:01:47.071979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 710/1517] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:47 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:47.587214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e6b5812f-9868-4cff-9f7d-53fb6ba81716 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:47.587678 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e6b5812f-9868-4cff-9f7d-53fb6ba81716 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:47.594019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6b5812f-9868-4cff-9f7d-53fb6ba81716 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.594472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6b5812f-9868-4cff-9f7d-53fb6ba81716 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.595243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6b5812f-9868-4cff-9f7d-53fb6ba81716 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:47.595720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6b5812f-9868-4cff-9f7d-53fb6ba81716 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:47.660325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e6b5812f-9868-4cff-9f7d-53fb6ba81716 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:47.667757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e6b5812f-9868-4cff-9f7d-53fb6ba81716 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084754 Jul 14 16:01:47.668314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 808/1518] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:47 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:48.003649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-305ae4f1-a057-4a50-9f66-a7cbee723f9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.004575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-305ae4f1-a057-4a50-9f66-a7cbee723f9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:48.011432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-305ae4f1-a057-4a50-9f66-a7cbee723f9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.011923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-305ae4f1-a057-4a50-9f66-a7cbee723f9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.012689 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-305ae4f1-a057-4a50-9f66-a7cbee723f9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.013155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-305ae4f1-a057-4a50-9f66-a7cbee723f9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.042822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-305ae4f1-a057-4a50-9f66-a7cbee723f9f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043130 Jul 14 16:01:48.043459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 711/1519] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:47 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:48.082682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9de35314-193b-44da-a930-21c14b0fc948 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.083590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9de35314-193b-44da-a930-21c14b0fc948 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:48.090477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9de35314-193b-44da-a930-21c14b0fc948 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.090918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9de35314-193b-44da-a930-21c14b0fc948 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.091700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9de35314-193b-44da-a930-21c14b0fc948 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.092135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9de35314-193b-44da-a930-21c14b0fc948 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.121504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9de35314-193b-44da-a930-21c14b0fc948 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042735 Jul 14 16:01:48.122089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 809/1520] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:48 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:48.684984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a6d56349-98ff-489d-ad68-816c77eb9e42 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:48.685602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a6d56349-98ff-489d-ad68-816c77eb9e42 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:48.691819 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a6d56349-98ff-489d-ad68-816c77eb9e42 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.692276 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a6d56349-98ff-489d-ad68-816c77eb9e42 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.693037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a6d56349-98ff-489d-ad68-816c77eb9e42 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:48.693475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a6d56349-98ff-489d-ad68-816c77eb9e42 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:48.756653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a6d56349-98ff-489d-ad68-816c77eb9e42 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:48.765181 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a6d56349-98ff-489d-ad68-816c77eb9e42 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084503 Jul 14 16:01:48.765746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 712/1521] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:48 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:49.054462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-656543cc-8e38-4c5c-b69b-eaef95fb8e71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:49.056013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-656543cc-8e38-4c5c-b69b-eaef95fb8e71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:49.062134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-656543cc-8e38-4c5c-b69b-eaef95fb8e71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.062590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-656543cc-8e38-4c5c-b69b-eaef95fb8e71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.063358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-656543cc-8e38-4c5c-b69b-eaef95fb8e71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.063845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-656543cc-8e38-4c5c-b69b-eaef95fb8e71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.093193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-656543cc-8e38-4c5c-b69b-eaef95fb8e71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042670 Jul 14 16:01:49.093834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 810/1522] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:49 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:49.134053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2a2768a3-5604-45d3-b172-10b9a0d50f4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:49.134963 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2a2768a3-5604-45d3-b172-10b9a0d50f4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:49.142091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a2768a3-5604-45d3-b172-10b9a0d50f4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.142546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a2768a3-5604-45d3-b172-10b9a0d50f4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.143313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a2768a3-5604-45d3-b172-10b9a0d50f4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.143796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a2768a3-5604-45d3-b172-10b9a0d50f4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.172665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2a2768a3-5604-45d3-b172-10b9a0d50f4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043110 Jul 14 16:01:49.173220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 713/1523] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:49 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:49.783281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b8cdf202-7394-4991-ab29-1ec4680f4e3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:49.784206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b8cdf202-7394-4991-ab29-1ec4680f4e3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:49.792278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8cdf202-7394-4991-ab29-1ec4680f4e3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.792720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8cdf202-7394-4991-ab29-1ec4680f4e3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.793501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8cdf202-7394-4991-ab29-1ec4680f4e3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:49.793932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8cdf202-7394-4991-ab29-1ec4680f4e3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:49.800013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:49.864420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b8cdf202-7394-4991-ab29-1ec4680f4e3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:49.872568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b8cdf202-7394-4991-ab29-1ec4680f4e3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.093207 Jul 14 16:01:49.873134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 811/1524] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:49 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:50.106473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-51ce958f-e129-4a23-83d3-b3dc3f05f689 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:50.107754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-51ce958f-e129-4a23-83d3-b3dc3f05f689 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:50.114249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-51ce958f-e129-4a23-83d3-b3dc3f05f689 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.114706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-51ce958f-e129-4a23-83d3-b3dc3f05f689 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.115482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-51ce958f-e129-4a23-83d3-b3dc3f05f689 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.115953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-51ce958f-e129-4a23-83d3-b3dc3f05f689 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.154141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-51ce958f-e129-4a23-83d3-b3dc3f05f689 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053849 Jul 14 16:01:50.154813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 714/1525] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:50 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:50.185340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f3d0b16f-837c-44bc-823d-3c820e6cc11d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:50.186269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f3d0b16f-837c-44bc-823d-3c820e6cc11d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:50.192847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3d0b16f-837c-44bc-823d-3c820e6cc11d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.193291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3d0b16f-837c-44bc-823d-3c820e6cc11d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.194056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3d0b16f-837c-44bc-823d-3c820e6cc11d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.194488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3d0b16f-837c-44bc-823d-3c820e6cc11d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.227522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f3d0b16f-837c-44bc-823d-3c820e6cc11d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046499 Jul 14 16:01:50.228128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 812/1526] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:50 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:50.890336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fb1ff653-aee2-4347-aa3b-61bb0cec5f7f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:50.890938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fb1ff653-aee2-4347-aa3b-61bb0cec5f7f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:50.896970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb1ff653-aee2-4347-aa3b-61bb0cec5f7f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.897414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb1ff653-aee2-4347-aa3b-61bb0cec5f7f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.898182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb1ff653-aee2-4347-aa3b-61bb0cec5f7f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:50.898595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb1ff653-aee2-4347-aa3b-61bb0cec5f7f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:50.960629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fb1ff653-aee2-4347-aa3b-61bb0cec5f7f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:50.968917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fb1ff653-aee2-4347-aa3b-61bb0cec5f7f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082722 Jul 14 16:01:50.969472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 715/1527] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:50 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:51.166894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9d4f9483-2f65-4b7a-9eb9-f697c21905a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:51.167747 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9d4f9483-2f65-4b7a-9eb9-f697c21905a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:51.173832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d4f9483-2f65-4b7a-9eb9-f697c21905a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:51.174320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d4f9483-2f65-4b7a-9eb9-f697c21905a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:51.175084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d4f9483-2f65-4b7a-9eb9-f697c21905a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:51.175523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d4f9483-2f65-4b7a-9eb9-f697c21905a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:51.205619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9d4f9483-2f65-4b7a-9eb9-f697c21905a3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042883 Jul 14 16:01:51.206278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 813/1528] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:51 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:51.239412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fdaeb4e5-d098-48c7-b878-7bf1b002f64b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:51.240420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fdaeb4e5-d098-48c7-b878-7bf1b002f64b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:51.247689 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdaeb4e5-d098-48c7-b878-7bf1b002f64b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:51.248143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdaeb4e5-d098-48c7-b878-7bf1b002f64b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:51.248907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdaeb4e5-d098-48c7-b878-7bf1b002f64b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:51.249362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdaeb4e5-d098-48c7-b878-7bf1b002f64b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:51.278868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fdaeb4e5-d098-48c7-b878-7bf1b002f64b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043427 Jul 14 16:01:51.279425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 716/1529] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:51 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:51.986077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b0dbfc5a-cbf9-4235-95d9-f69400d9ee95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:51.986699 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b0dbfc5a-cbf9-4235-95d9-f69400d9ee95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:51.993324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0dbfc5a-cbf9-4235-95d9-f69400d9ee95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:51.993780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0dbfc5a-cbf9-4235-95d9-f69400d9ee95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:51.994554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0dbfc5a-cbf9-4235-95d9-f69400d9ee95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:51.994995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0dbfc5a-cbf9-4235-95d9-f69400d9ee95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.056163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0dbfc5a-cbf9-4235-95d9-f69400d9ee95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:52.063555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b0dbfc5a-cbf9-4235-95d9-f69400d9ee95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081336 Jul 14 16:01:52.064142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 814/1530] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:51 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:52.218004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4be0406a-1efe-4ac2-9a42-55cf969802c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:52.218948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4be0406a-1efe-4ac2-9a42-55cf969802c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:52.225215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4be0406a-1efe-4ac2-9a42-55cf969802c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.225701 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4be0406a-1efe-4ac2-9a42-55cf969802c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.226453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4be0406a-1efe-4ac2-9a42-55cf969802c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.226899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4be0406a-1efe-4ac2-9a42-55cf969802c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.258961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4be0406a-1efe-4ac2-9a42-55cf969802c4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044600 Jul 14 16:01:52.259687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 717/1531] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:52 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:52.291267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6a54cf56-4f15-47a3-af2d-32ba089aeb82 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:52.292305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6a54cf56-4f15-47a3-af2d-32ba089aeb82 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:52.298810 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a54cf56-4f15-47a3-af2d-32ba089aeb82 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.299260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a54cf56-4f15-47a3-af2d-32ba089aeb82 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.300050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a54cf56-4f15-47a3-af2d-32ba089aeb82 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:52.300497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a54cf56-4f15-47a3-af2d-32ba089aeb82 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:52.329465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6a54cf56-4f15-47a3-af2d-32ba089aeb82 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043072 Jul 14 16:01:52.330017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 815/1532] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:52 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:53.080261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-45da11d5-b421-4a2f-866b-91bb5c60f475 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:53.080904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-45da11d5-b421-4a2f-866b-91bb5c60f475 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:53.086880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45da11d5-b421-4a2f-866b-91bb5c60f475 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:53.087329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45da11d5-b421-4a2f-866b-91bb5c60f475 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:53.088127 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45da11d5-b421-4a2f-866b-91bb5c60f475 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:53.088568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45da11d5-b421-4a2f-866b-91bb5c60f475 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:53.148606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-45da11d5-b421-4a2f-866b-91bb5c60f475 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:53.156188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-45da11d5-b421-4a2f-866b-91bb5c60f475 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.079808 Jul 14 16:01:53.156748 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 718/1533] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:53 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:53.270308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-30b2c47a-7443-479d-aea2-0c9d236a8621 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:53.271154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-30b2c47a-7443-479d-aea2-0c9d236a8621 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:53.277501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30b2c47a-7443-479d-aea2-0c9d236a8621 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:53.277953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30b2c47a-7443-479d-aea2-0c9d236a8621 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:53.278717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30b2c47a-7443-479d-aea2-0c9d236a8621 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:53.279156 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30b2c47a-7443-479d-aea2-0c9d236a8621 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:53.309529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-30b2c47a-7443-479d-aea2-0c9d236a8621 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043196 Jul 14 16:01:53.310199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 816/1534] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:53 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:53.340206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-005b1d24-0a41-4c6f-8a74-e8bba9fdc9cf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:53.341158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-005b1d24-0a41-4c6f-8a74-e8bba9fdc9cf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:53.347507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-005b1d24-0a41-4c6f-8a74-e8bba9fdc9cf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:53.347984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-005b1d24-0a41-4c6f-8a74-e8bba9fdc9cf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:53.348737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-005b1d24-0a41-4c6f-8a74-e8bba9fdc9cf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:53.349170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-005b1d24-0a41-4c6f-8a74-e8bba9fdc9cf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:53.380285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-005b1d24-0a41-4c6f-8a74-e8bba9fdc9cf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044248 Jul 14 16:01:53.380841 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 719/1535] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:53 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:54.174075 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7293b3bb-d786-43ad-94f2-34fec1b8fa20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:54.174716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7293b3bb-d786-43ad-94f2-34fec1b8fa20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:54.181273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7293b3bb-d786-43ad-94f2-34fec1b8fa20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:54.181719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7293b3bb-d786-43ad-94f2-34fec1b8fa20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:54.182473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7293b3bb-d786-43ad-94f2-34fec1b8fa20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:54.182907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7293b3bb-d786-43ad-94f2-34fec1b8fa20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:54.246560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7293b3bb-d786-43ad-94f2-34fec1b8fa20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:54.254094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7293b3bb-d786-43ad-94f2-34fec1b8fa20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083787 Jul 14 16:01:54.254596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 817/1536] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:54 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:54.321987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5c70d08b-d7f1-4173-ac9e-28dd222780d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:54.323038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5c70d08b-d7f1-4173-ac9e-28dd222780d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:54.329150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5c70d08b-d7f1-4173-ac9e-28dd222780d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:54.329613 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5c70d08b-d7f1-4173-ac9e-28dd222780d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:54.330381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5c70d08b-d7f1-4173-ac9e-28dd222780d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:54.330827 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5c70d08b-d7f1-4173-ac9e-28dd222780d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:54.359238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5c70d08b-d7f1-4173-ac9e-28dd222780d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041864 Jul 14 16:01:54.359916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 720/1537] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:54 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:54.393388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3cf66386-2304-4912-b4b2-8a601438724c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:54.394336 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3cf66386-2304-4912-b4b2-8a601438724c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:54.401688 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3cf66386-2304-4912-b4b2-8a601438724c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:54.402142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3cf66386-2304-4912-b4b2-8a601438724c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:54.402914 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3cf66386-2304-4912-b4b2-8a601438724c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:54.403353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3cf66386-2304-4912-b4b2-8a601438724c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:54.432339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3cf66386-2304-4912-b4b2-8a601438724c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042860 Jul 14 16:01:54.432921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 818/1538] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:54 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:55.271559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-13fd9aeb-43cd-4f93-b7d6-71c2a3d668e9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:55.272115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-13fd9aeb-43cd-4f93-b7d6-71c2a3d668e9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:55.279114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13fd9aeb-43cd-4f93-b7d6-71c2a3d668e9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:55.279564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13fd9aeb-43cd-4f93-b7d6-71c2a3d668e9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:55.280351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13fd9aeb-43cd-4f93-b7d6-71c2a3d668e9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:55.280789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13fd9aeb-43cd-4f93-b7d6-71c2a3d668e9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:55.347056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-13fd9aeb-43cd-4f93-b7d6-71c2a3d668e9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:55.355409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-13fd9aeb-43cd-4f93-b7d6-71c2a3d668e9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087776 Jul 14 16:01:55.355999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 721/1539] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:55 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:55.370548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d3fb8bfe-dbbd-40e6-91da-33dd05e1583f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:55.374962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d3fb8bfe-dbbd-40e6-91da-33dd05e1583f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:55.377798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d3fb8bfe-dbbd-40e6-91da-33dd05e1583f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:55.378245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d3fb8bfe-dbbd-40e6-91da-33dd05e1583f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:55.379008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d3fb8bfe-dbbd-40e6-91da-33dd05e1583f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:55.379444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d3fb8bfe-dbbd-40e6-91da-33dd05e1583f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:55.411085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d3fb8bfe-dbbd-40e6-91da-33dd05e1583f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Jul 14 16:01:55.411795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 819/1540] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:55 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:55.443263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8cdb4b99-544c-4c3f-a6d3-3782c215cc09 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:55.444210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8cdb4b99-544c-4c3f-a6d3-3782c215cc09 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:55.451152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8cdb4b99-544c-4c3f-a6d3-3782c215cc09 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:55.451616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8cdb4b99-544c-4c3f-a6d3-3782c215cc09 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:55.452389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8cdb4b99-544c-4c3f-a6d3-3782c215cc09 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:55.452823 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8cdb4b99-544c-4c3f-a6d3-3782c215cc09 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:55.456408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:55.484190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8cdb4b99-544c-4c3f-a6d3-3782c215cc09 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044756 Jul 14 16:01:55.484802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 722/1541] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:55 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:56.372929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c24b4019-3b9c-4710-a7c5-a6c58658450c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:56.373457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c24b4019-3b9c-4710-a7c5-a6c58658450c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:56.375316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=84 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:01:56.380536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c24b4019-3b9c-4710-a7c5-a6c58658450c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.380981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c24b4019-3b9c-4710-a7c5-a6c58658450c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.381722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c24b4019-3b9c-4710-a7c5-a6c58658450c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.382150 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c24b4019-3b9c-4710-a7c5-a6c58658450c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.422325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-87b4d7dc-e3cb-4eac-8751-a1fa1b79e0c8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:56.423244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-87b4d7dc-e3cb-4eac-8751-a1fa1b79e0c8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:56.429779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-87b4d7dc-e3cb-4eac-8751-a1fa1b79e0c8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.430868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-87b4d7dc-e3cb-4eac-8751-a1fa1b79e0c8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.431648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-87b4d7dc-e3cb-4eac-8751-a1fa1b79e0c8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.432087 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-87b4d7dc-e3cb-4eac-8751-a1fa1b79e0c8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.444063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c24b4019-3b9c-4710-a7c5-a6c58658450c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:56.452070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c24b4019-3b9c-4710-a7c5-a6c58658450c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082982 Jul 14 16:01:56.452751 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 820/1542] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:56 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:01:56.460847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-87b4d7dc-e3cb-4eac-8751-a1fa1b79e0c8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042372 Jul 14 16:01:56.461998 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 723/1543] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:56 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:56.494995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-61477d43-5dfe-400c-9dd8-71b412229326 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:56.495951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-61477d43-5dfe-400c-9dd8-71b412229326 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:56.502140 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61477d43-5dfe-400c-9dd8-71b412229326 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.502589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61477d43-5dfe-400c-9dd8-71b412229326 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.503355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61477d43-5dfe-400c-9dd8-71b412229326 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:56.503829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61477d43-5dfe-400c-9dd8-71b412229326 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:56.532833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-61477d43-5dfe-400c-9dd8-71b412229326 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041793 Jul 14 16:01:56.533386 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 821/1544] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:56 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:57.469631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f73fd6c6-12dc-4fb1-b4e8-d7d6f2be56bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:57.470239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f73fd6c6-12dc-4fb1-b4e8-d7d6f2be56bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:57.473367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-22ebcec7-a311-4728-99ff-3d52eac253f6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:57.474288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-22ebcec7-a311-4728-99ff-3d52eac253f6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:57.476723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f73fd6c6-12dc-4fb1-b4e8-d7d6f2be56bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:57.477388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f73fd6c6-12dc-4fb1-b4e8-d7d6f2be56bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:57.478277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f73fd6c6-12dc-4fb1-b4e8-d7d6f2be56bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:57.478701 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f73fd6c6-12dc-4fb1-b4e8-d7d6f2be56bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:57.481219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22ebcec7-a311-4728-99ff-3d52eac253f6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:57.481672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22ebcec7-a311-4728-99ff-3d52eac253f6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:57.482438 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22ebcec7-a311-4728-99ff-3d52eac253f6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:57.482875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22ebcec7-a311-4728-99ff-3d52eac253f6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:57.513234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-22ebcec7-a311-4728-99ff-3d52eac253f6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043718 Jul 14 16:01:57.513814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 822/1545] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:57 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:57.544012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f73fd6c6-12dc-4fb1-b4e8-d7d6f2be56bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:57.544966 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d5680b9f-ee8f-43de-a1b6-bbb62b23ea4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:57.545892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d5680b9f-ee8f-43de-a1b6-bbb62b23ea4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:57.551701 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f73fd6c6-12dc-4fb1-b4e8-d7d6f2be56bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085836 Jul 14 16:01:57.551987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d5680b9f-ee8f-43de-a1b6-bbb62b23ea4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:57.552312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 724/1546] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:57 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:57.552440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d5680b9f-ee8f-43de-a1b6-bbb62b23ea4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:57.553287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d5680b9f-ee8f-43de-a1b6-bbb62b23ea4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:57.553731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d5680b9f-ee8f-43de-a1b6-bbb62b23ea4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:57.584027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d5680b9f-ee8f-43de-a1b6-bbb62b23ea4c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042977 Jul 14 16:01:57.584580 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 823/1547] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:57 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:58.525678 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0cfca218-7aad-48ac-a20a-6c1c06b1e86d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:58.526606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0cfca218-7aad-48ac-a20a-6c1c06b1e86d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:58.533165 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cfca218-7aad-48ac-a20a-6c1c06b1e86d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:58.533658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cfca218-7aad-48ac-a20a-6c1c06b1e86d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:58.534426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cfca218-7aad-48ac-a20a-6c1c06b1e86d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:58.534868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cfca218-7aad-48ac-a20a-6c1c06b1e86d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:58.565855 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0cfca218-7aad-48ac-a20a-6c1c06b1e86d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044600 Jul 14 16:01:58.566436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 725/1548] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:58 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:01:58.569179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c911344f-0df9-4e5e-9ffb-46583a3b81f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:58.569931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c911344f-0df9-4e5e-9ffb-46583a3b81f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:58.576708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c911344f-0df9-4e5e-9ffb-46583a3b81f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:58.577133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c911344f-0df9-4e5e-9ffb-46583a3b81f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:58.577892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c911344f-0df9-4e5e-9ffb-46583a3b81f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:58.578322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c911344f-0df9-4e5e-9ffb-46583a3b81f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:58.598235 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-74e5b37e-c152-4864-bcdb-a19e592e9cd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:58.599158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-74e5b37e-c152-4864-bcdb-a19e592e9cd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:58.606585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-74e5b37e-c152-4864-bcdb-a19e592e9cd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:58.607029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-74e5b37e-c152-4864-bcdb-a19e592e9cd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:58.607914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-74e5b37e-c152-4864-bcdb-a19e592e9cd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:58.608356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-74e5b37e-c152-4864-bcdb-a19e592e9cd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:58.639977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-74e5b37e-c152-4864-bcdb-a19e592e9cd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045756 Jul 14 16:01:58.640557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 726/1549] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:58 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:58.643673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c911344f-0df9-4e5e-9ffb-46583a3b81f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:58.652479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c911344f-0df9-4e5e-9ffb-46583a3b81f3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087232 Jul 14 16:01:58.653042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 824/1550] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:58 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:01:59.577903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-93d1b900-3608-4dd1-83eb-deaf98980acd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:01:59.578824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-93d1b900-3608-4dd1-83eb-deaf98980acd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:59.585313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93d1b900-3608-4dd1-83eb-deaf98980acd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.585768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93d1b900-3608-4dd1-83eb-deaf98980acd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.586576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93d1b900-3608-4dd1-83eb-deaf98980acd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.587019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93d1b900-3608-4dd1-83eb-deaf98980acd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.651484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3fb5dab1-9bf5-4b40-b602-aadff5cff4f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:59.652434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3fb5dab1-9bf5-4b40-b602-aadff5cff4f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:59.658980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3fb5dab1-9bf5-4b40-b602-aadff5cff4f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.659424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3fb5dab1-9bf5-4b40-b602-aadff5cff4f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.660471 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3fb5dab1-9bf5-4b40-b602-aadff5cff4f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.660934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3fb5dab1-9bf5-4b40-b602-aadff5cff4f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.686984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-93d1b900-3608-4dd1-83eb-deaf98980acd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "POST /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/action" status: 200 len: 76202 microversion: 2.1 time: 0.112769 Jul 14 16:01:59.693988 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 727/1551] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 16:01:59 2022] POST /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb/action => generated 76202 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:01:59.693988 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8d188514-9282-466e-b61c-5af6a92c0485 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:01:59.694250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3fb5dab1-9bf5-4b40-b602-aadff5cff4f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045666 Jul 14 16:01:59.694640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8d188514-9282-466e-b61c-5af6a92c0485 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:01:59.694750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 825/1552] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:01:59 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:01:59.700819 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d188514-9282-466e-b61c-5af6a92c0485 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.701266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d188514-9282-466e-b61c-5af6a92c0485 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.702029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d188514-9282-466e-b61c-5af6a92c0485 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:01:59.702459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d188514-9282-466e-b61c-5af6a92c0485 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:01:59.765163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8d188514-9282-466e-b61c-5af6a92c0485 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:01:59.773087 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8d188514-9282-466e-b61c-5af6a92c0485 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084324 Jul 14 16:01:59.773682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 728/1553] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:01:59 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:00.705503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-90968087-c5f8-4493-959f-c53144291e36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:00.706339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-90968087-c5f8-4493-959f-c53144291e36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:00.713536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90968087-c5f8-4493-959f-c53144291e36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:00.713987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90968087-c5f8-4493-959f-c53144291e36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:00.714775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90968087-c5f8-4493-959f-c53144291e36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:00.715211 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90968087-c5f8-4493-959f-c53144291e36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:00.752466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-90968087-c5f8-4493-959f-c53144291e36 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050982 Jul 14 16:02:00.753084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 826/1554] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:00 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:00.791585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-29bb9853-3ee6-4e69-a69a-8c620e571ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:00.792228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-29bb9853-3ee6-4e69-a69a-8c620e571ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:00.798939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-29bb9853-3ee6-4e69-a69a-8c620e571ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:00.799390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-29bb9853-3ee6-4e69-a69a-8c620e571ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:00.800267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-29bb9853-3ee6-4e69-a69a-8c620e571ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:00.800787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-29bb9853-3ee6-4e69-a69a-8c620e571ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:00.864158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-29bb9853-3ee6-4e69-a69a-8c620e571ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:00.872240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-29bb9853-3ee6-4e69-a69a-8c620e571ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085751 Jul 14 16:02:00.872815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 729/1555] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:00 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:01.764247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ea74a1b9-5d13-45ab-bd65-996ceba765fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:01.765168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ea74a1b9-5d13-45ab-bd65-996ceba765fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:01.771670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ea74a1b9-5d13-45ab-bd65-996ceba765fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.772131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ea74a1b9-5d13-45ab-bd65-996ceba765fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.772894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ea74a1b9-5d13-45ab-bd65-996ceba765fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.773335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ea74a1b9-5d13-45ab-bd65-996ceba765fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.799791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:01.805059 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ea74a1b9-5d13-45ab-bd65-996ceba765fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044717 Jul 14 16:02:01.805622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 827/1556] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:01 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:01.889325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4670a679-f4d1-495b-914a-4a6b2c9159b8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:01.889939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4670a679-f4d1-495b-914a-4a6b2c9159b8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:01.892396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=88 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:01.897808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4670a679-f4d1-495b-914a-4a6b2c9159b8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.898268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4670a679-f4d1-495b-914a-4a6b2c9159b8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.899927 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4670a679-f4d1-495b-914a-4a6b2c9159b8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:01.900375 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4670a679-f4d1-495b-914a-4a6b2c9159b8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:01.962336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4670a679-f4d1-495b-914a-4a6b2c9159b8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:01.969880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4670a679-f4d1-495b-914a-4a6b2c9159b8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084464 Jul 14 16:02:01.970446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 730/1557] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:01 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:02.816592 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-55239a7b-a9cf-48da-ac14-a6f18deb1e18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:02.817533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-55239a7b-a9cf-48da-ac14-a6f18deb1e18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:02.824275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-55239a7b-a9cf-48da-ac14-a6f18deb1e18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.824716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-55239a7b-a9cf-48da-ac14-a6f18deb1e18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:02.825469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-55239a7b-a9cf-48da-ac14-a6f18deb1e18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.825969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-55239a7b-a9cf-48da-ac14-a6f18deb1e18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:02.854797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-55239a7b-a9cf-48da-ac14-a6f18deb1e18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042220 Jul 14 16:02:02.855355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 828/1558] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:02 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:02.986518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7f4f765e-56f4-497e-998e-2ce25755655c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:02.987140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7f4f765e-56f4-497e-998e-2ce25755655c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:02.994501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7f4f765e-56f4-497e-998e-2ce25755655c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.994953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7f4f765e-56f4-497e-998e-2ce25755655c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:02.995767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7f4f765e-56f4-497e-998e-2ce25755655c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:02.996214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7f4f765e-56f4-497e-998e-2ce25755655c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:03.060485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7f4f765e-56f4-497e-998e-2ce25755655c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:03.068081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7f4f765e-56f4-497e-998e-2ce25755655c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085617 Jul 14 16:02:03.068586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 731/1559] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:02 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:03.866669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ce8fc17a-9e57-43a7-84cc-7967a280533f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:03.867854 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ce8fc17a-9e57-43a7-84cc-7967a280533f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:03.873802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce8fc17a-9e57-43a7-84cc-7967a280533f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:03.874260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce8fc17a-9e57-43a7-84cc-7967a280533f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:03.875021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce8fc17a-9e57-43a7-84cc-7967a280533f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:03.875461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce8fc17a-9e57-43a7-84cc-7967a280533f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:03.907050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ce8fc17a-9e57-43a7-84cc-7967a280533f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044538 Jul 14 16:02:03.907649 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 829/1560] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:03 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:04.084648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a332a723-23e8-4afa-afeb-d6687861e730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:04.085261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a332a723-23e8-4afa-afeb-d6687861e730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:04.092289 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a332a723-23e8-4afa-afeb-d6687861e730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:04.092741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a332a723-23e8-4afa-afeb-d6687861e730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:04.093504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a332a723-23e8-4afa-afeb-d6687861e730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:04.093938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a332a723-23e8-4afa-afeb-d6687861e730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:04.157816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a332a723-23e8-4afa-afeb-d6687861e730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:04.165786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a332a723-23e8-4afa-afeb-d6687861e730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084955 Jul 14 16:02:04.166340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 732/1561] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:04 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:04.920135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6cb8a803-c4bd-413a-ac32-ba6877bc8520 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:04.921048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6cb8a803-c4bd-413a-ac32-ba6877bc8520 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:04.927476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cb8a803-c4bd-413a-ac32-ba6877bc8520 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:04.927948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cb8a803-c4bd-413a-ac32-ba6877bc8520 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:04.928704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cb8a803-c4bd-413a-ac32-ba6877bc8520 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:04.929134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cb8a803-c4bd-413a-ac32-ba6877bc8520 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:04.957640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6cb8a803-c4bd-413a-ac32-ba6877bc8520 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041494 Jul 14 16:02:04.958184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 830/1562] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:04 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:05.182370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-31810310-2092-4f9e-9526-b98abb8ea968 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:05.182987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-31810310-2092-4f9e-9526-b98abb8ea968 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:05.189656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-31810310-2092-4f9e-9526-b98abb8ea968 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:05.190112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-31810310-2092-4f9e-9526-b98abb8ea968 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:05.190881 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-31810310-2092-4f9e-9526-b98abb8ea968 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:05.191332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-31810310-2092-4f9e-9526-b98abb8ea968 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:05.254803 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-31810310-2092-4f9e-9526-b98abb8ea968 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:05.265171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-31810310-2092-4f9e-9526-b98abb8ea968 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086730 Jul 14 16:02:05.265755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 733/1563] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:05 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:05.969795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c594f440-c886-46ae-88bc-1c6cfca253d3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:05.970720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c594f440-c886-46ae-88bc-1c6cfca253d3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:05.977933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c594f440-c886-46ae-88bc-1c6cfca253d3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:05.978387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c594f440-c886-46ae-88bc-1c6cfca253d3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:05.979223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c594f440-c886-46ae-88bc-1c6cfca253d3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:05.979707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c594f440-c886-46ae-88bc-1c6cfca253d3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:06.009491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c594f440-c886-46ae-88bc-1c6cfca253d3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043643 Jul 14 16:02:06.010055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 831/1564] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:05 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:06.282845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-73cc93e9-db65-400a-9281-f07d3dfe0f34 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:06.283385 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-73cc93e9-db65-400a-9281-f07d3dfe0f34 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:06.292508 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-73cc93e9-db65-400a-9281-f07d3dfe0f34 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:06.293179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-73cc93e9-db65-400a-9281-f07d3dfe0f34 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:06.294219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-73cc93e9-db65-400a-9281-f07d3dfe0f34 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:06.294667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-73cc93e9-db65-400a-9281-f07d3dfe0f34 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:06.356391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-73cc93e9-db65-400a-9281-f07d3dfe0f34 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:06.363861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-73cc93e9-db65-400a-9281-f07d3dfe0f34 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084900 Jul 14 16:02:06.364426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 734/1565] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:06 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:07.020961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f171f5cd-1e5c-4223-8549-25e435e9d22d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:07.021893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f171f5cd-1e5c-4223-8549-25e435e9d22d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:07.029388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f171f5cd-1e5c-4223-8549-25e435e9d22d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:07.029834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f171f5cd-1e5c-4223-8549-25e435e9d22d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:07.030594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f171f5cd-1e5c-4223-8549-25e435e9d22d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:07.031030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f171f5cd-1e5c-4223-8549-25e435e9d22d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:07.060887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f171f5cd-1e5c-4223-8549-25e435e9d22d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043890 Jul 14 16:02:07.061440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 832/1566] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:07 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:07.380256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ffc2f2f7-f956-4aa2-bcb8-bf457c12724c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:07.380873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ffc2f2f7-f956-4aa2-bcb8-bf457c12724c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:07.388019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ffc2f2f7-f956-4aa2-bcb8-bf457c12724c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:07.388475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ffc2f2f7-f956-4aa2-bcb8-bf457c12724c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:07.389243 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ffc2f2f7-f956-4aa2-bcb8-bf457c12724c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:07.389685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ffc2f2f7-f956-4aa2-bcb8-bf457c12724c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:07.454771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ffc2f2f7-f956-4aa2-bcb8-bf457c12724c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:07.463064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ffc2f2f7-f956-4aa2-bcb8-bf457c12724c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086674 Jul 14 16:02:07.463649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 735/1567] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:07 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:08.073437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-42ab2f8b-903d-494d-8042-ee0db0807754 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:08.074380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-42ab2f8b-903d-494d-8042-ee0db0807754 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:08.081173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-42ab2f8b-903d-494d-8042-ee0db0807754 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:08.081620 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-42ab2f8b-903d-494d-8042-ee0db0807754 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:08.082408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-42ab2f8b-903d-494d-8042-ee0db0807754 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:08.082841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-42ab2f8b-903d-494d-8042-ee0db0807754 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:08.112773 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-42ab2f8b-903d-494d-8042-ee0db0807754 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044174 Jul 14 16:02:08.113338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 833/1568] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:08 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:08.480737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ef7dd2ce-bd71-4996-a656-c1dffb84381f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:08.481345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ef7dd2ce-bd71-4996-a656-c1dffb84381f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:08.487824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ef7dd2ce-bd71-4996-a656-c1dffb84381f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:08.488273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ef7dd2ce-bd71-4996-a656-c1dffb84381f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:08.489021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ef7dd2ce-bd71-4996-a656-c1dffb84381f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:08.489450 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ef7dd2ce-bd71-4996-a656-c1dffb84381f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:08.549762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ef7dd2ce-bd71-4996-a656-c1dffb84381f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:08.557519 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ef7dd2ce-bd71-4996-a656-c1dffb84381f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081519 Jul 14 16:02:08.558086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 736/1569] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:08 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:09.123928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-73d0fc54-7b30-4a1a-88d6-eb4e388cb508 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.124838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-73d0fc54-7b30-4a1a-88d6-eb4e388cb508 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:09.131310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73d0fc54-7b30-4a1a-88d6-eb4e388cb508 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:09.131796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73d0fc54-7b30-4a1a-88d6-eb4e388cb508 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:09.132537 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73d0fc54-7b30-4a1a-88d6-eb4e388cb508 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:09.133476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73d0fc54-7b30-4a1a-88d6-eb4e388cb508 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:09.167393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-73d0fc54-7b30-4a1a-88d6-eb4e388cb508 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047446 Jul 14 16:02:09.168202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 834/1570] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:09.573494 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-846ecde2-8893-4f1d-8d77-aa6509adf143 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:09.574103 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-846ecde2-8893-4f1d-8d77-aa6509adf143 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:09.580588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-846ecde2-8893-4f1d-8d77-aa6509adf143 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:09.581041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-846ecde2-8893-4f1d-8d77-aa6509adf143 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:09.581801 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-846ecde2-8893-4f1d-8d77-aa6509adf143 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:09.582236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-846ecde2-8893-4f1d-8d77-aa6509adf143 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:09.643562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-846ecde2-8893-4f1d-8d77-aa6509adf143 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:09.652097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-846ecde2-8893-4f1d-8d77-aa6509adf143 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082535 Jul 14 16:02:09.652585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 737/1571] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:09 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:10.180119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ef115d1a-8b56-4f5b-87be-b51c81b4edd8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:10.181041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ef115d1a-8b56-4f5b-87be-b51c81b4edd8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:10.187517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef115d1a-8b56-4f5b-87be-b51c81b4edd8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.188004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef115d1a-8b56-4f5b-87be-b51c81b4edd8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.188769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef115d1a-8b56-4f5b-87be-b51c81b4edd8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.189208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef115d1a-8b56-4f5b-87be-b51c81b4edd8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.218308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ef115d1a-8b56-4f5b-87be-b51c81b4edd8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042618 Jul 14 16:02:10.218867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 835/1572] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:10 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:10.669024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ae7c2c2d-32c2-4e63-9c64-8c8b51504a3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:10.669715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ae7c2c2d-32c2-4e63-9c64-8c8b51504a3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:10.676224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ae7c2c2d-32c2-4e63-9c64-8c8b51504a3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.676670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ae7c2c2d-32c2-4e63-9c64-8c8b51504a3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.677419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ae7c2c2d-32c2-4e63-9c64-8c8b51504a3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:10.677849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ae7c2c2d-32c2-4e63-9c64-8c8b51504a3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:10.737623 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ae7c2c2d-32c2-4e63-9c64-8c8b51504a3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:10.746769 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ae7c2c2d-32c2-4e63-9c64-8c8b51504a3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081587 Jul 14 16:02:10.747343 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 738/1573] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:10 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:11.232636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-089d6615-e9f2-4b34-9108-d3293b56364d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:11.233480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-089d6615-e9f2-4b34-9108-d3293b56364d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:11.240124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-089d6615-e9f2-4b34-9108-d3293b56364d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:11.240575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-089d6615-e9f2-4b34-9108-d3293b56364d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:11.243109 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-089d6615-e9f2-4b34-9108-d3293b56364d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:11.243109 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-089d6615-e9f2-4b34-9108-d3293b56364d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:11.275230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-089d6615-e9f2-4b34-9108-d3293b56364d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049951 Jul 14 16:02:11.275823 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 836/1574] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:11 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:11.764123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b0cce28e-adf1-4249-a210-c1f3a298294f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:11.764741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b0cce28e-adf1-4249-a210-c1f3a298294f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:11.772704 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0cce28e-adf1-4249-a210-c1f3a298294f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:11.773155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0cce28e-adf1-4249-a210-c1f3a298294f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:11.775012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0cce28e-adf1-4249-a210-c1f3a298294f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:11.775454 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0cce28e-adf1-4249-a210-c1f3a298294f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:11.779622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:11.842787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b0cce28e-adf1-4249-a210-c1f3a298294f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:11.850248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b0cce28e-adf1-4249-a210-c1f3a298294f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090093 Jul 14 16:02:11.850814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 739/1575] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:11 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:12.286784 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1daaaf14-5c59-4ef0-a4eb-1c4807773e3c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:12.287737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1daaaf14-5c59-4ef0-a4eb-1c4807773e3c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:12.294421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1daaaf14-5c59-4ef0-a4eb-1c4807773e3c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:12.294875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1daaaf14-5c59-4ef0-a4eb-1c4807773e3c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:12.295652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1daaaf14-5c59-4ef0-a4eb-1c4807773e3c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:12.296093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1daaaf14-5c59-4ef0-a4eb-1c4807773e3c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:12.325815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1daaaf14-5c59-4ef0-a4eb-1c4807773e3c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043277 Jul 14 16:02:12.326382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 837/1576] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:12 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:12.868390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-91e4ea87-c052-4f61-be05-4f81de607456 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:12.869245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-91e4ea87-c052-4f61-be05-4f81de607456 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:12.875998 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91e4ea87-c052-4f61-be05-4f81de607456 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:12.876450 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91e4ea87-c052-4f61-be05-4f81de607456 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:12.877212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91e4ea87-c052-4f61-be05-4f81de607456 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:12.877648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91e4ea87-c052-4f61-be05-4f81de607456 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:12.938602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-91e4ea87-c052-4f61-be05-4f81de607456 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:12.946648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-91e4ea87-c052-4f61-be05-4f81de607456 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083147 Jul 14 16:02:12.947212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 740/1577] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:12 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:13.338432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-14b0b4f4-a8cd-4bb6-97fe-6359e3a05216 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:13.339388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-14b0b4f4-a8cd-4bb6-97fe-6359e3a05216 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:13.345513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:02:13.345744 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:02:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments (ip 10.222.0.99) !!! Jul 14 16:02:13.347891 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-14b0b4f4-a8cd-4bb6-97fe-6359e3a05216 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.348730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-14b0b4f4-a8cd-4bb6-97fe-6359e3a05216 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:13.349563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-14b0b4f4-a8cd-4bb6-97fe-6359e3a05216 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.350951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-14b0b4f4-a8cd-4bb6-97fe-6359e3a05216 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:13.384519 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-14b0b4f4-a8cd-4bb6-97fe-6359e3a05216 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050539 Jul 14 16:02:13.385089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 838/1578] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:13 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:13.962717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-21418f9a-b689-41b6-b565-3f045d267c49 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:13.963263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-21418f9a-b689-41b6-b565-3f045d267c49 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:13.969859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21418f9a-b689-41b6-b565-3f045d267c49 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.970323 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21418f9a-b689-41b6-b565-3f045d267c49 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:13.971057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21418f9a-b689-41b6-b565-3f045d267c49 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:13.971493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21418f9a-b689-41b6-b565-3f045d267c49 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.036812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-21418f9a-b689-41b6-b565-3f045d267c49 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:14.044727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-21418f9a-b689-41b6-b565-3f045d267c49 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085950 Jul 14 16:02:14.045310 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 741/1579] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:13 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:14.396359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b080bbe8-aff7-40a3-8ee8-0f778453adaa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:14.397289 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b080bbe8-aff7-40a3-8ee8-0f778453adaa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:14.404267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b080bbe8-aff7-40a3-8ee8-0f778453adaa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:14.404724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b080bbe8-aff7-40a3-8ee8-0f778453adaa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.405533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b080bbe8-aff7-40a3-8ee8-0f778453adaa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:14.405974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b080bbe8-aff7-40a3-8ee8-0f778453adaa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:14.435827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b080bbe8-aff7-40a3-8ee8-0f778453adaa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043432 Jul 14 16:02:14.436389 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 839/1580] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:14 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:15.060979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-02c7d476-2675-4f92-8b67-632f02550dac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:15.061594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-02c7d476-2675-4f92-8b67-632f02550dac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:15.068071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-02c7d476-2675-4f92-8b67-632f02550dac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.068526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-02c7d476-2675-4f92-8b67-632f02550dac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.069288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-02c7d476-2675-4f92-8b67-632f02550dac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.069732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-02c7d476-2675-4f92-8b67-632f02550dac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.131059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-02c7d476-2675-4f92-8b67-632f02550dac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:15.139428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-02c7d476-2675-4f92-8b67-632f02550dac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082242 Jul 14 16:02:15.140034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 742/1581] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:15 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:15.447762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-eeff5201-fea3-4334-8774-0d8e7dc5a17b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:15.448685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eeff5201-fea3-4334-8774-0d8e7dc5a17b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:15.455116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eeff5201-fea3-4334-8774-0d8e7dc5a17b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.455540 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eeff5201-fea3-4334-8774-0d8e7dc5a17b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.456321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eeff5201-fea3-4334-8774-0d8e7dc5a17b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:15.456750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eeff5201-fea3-4334-8774-0d8e7dc5a17b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:15.486276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-eeff5201-fea3-4334-8774-0d8e7dc5a17b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043082 Jul 14 16:02:15.486836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 840/1582] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:15 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:16.157494 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bbd2a1f9-3aaa-4f35-a595-166af4bfd88a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:16.158110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bbd2a1f9-3aaa-4f35-a595-166af4bfd88a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:16.165848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbd2a1f9-3aaa-4f35-a595-166af4bfd88a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:16.166300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbd2a1f9-3aaa-4f35-a595-166af4bfd88a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:16.167095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbd2a1f9-3aaa-4f35-a595-166af4bfd88a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:16.167502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbd2a1f9-3aaa-4f35-a595-166af4bfd88a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:16.232340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bbd2a1f9-3aaa-4f35-a595-166af4bfd88a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:16.239893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bbd2a1f9-3aaa-4f35-a595-166af4bfd88a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086253 Jul 14 16:02:16.240460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 743/1583] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:16 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:16.497631 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-251c2ba8-e1fa-4dc0-8dcb-8fc672482b8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:16.498539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-251c2ba8-e1fa-4dc0-8dcb-8fc672482b8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:16.504990 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-251c2ba8-e1fa-4dc0-8dcb-8fc672482b8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:16.505431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-251c2ba8-e1fa-4dc0-8dcb-8fc672482b8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:16.506174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-251c2ba8-e1fa-4dc0-8dcb-8fc672482b8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:16.506603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-251c2ba8-e1fa-4dc0-8dcb-8fc672482b8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:16.537149 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-251c2ba8-e1fa-4dc0-8dcb-8fc672482b8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043475 Jul 14 16:02:16.537701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 841/1584] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:16 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:17.256450 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0de49208-77bb-465b-a7ba-7dfeae533d73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:17.257071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0de49208-77bb-465b-a7ba-7dfeae533d73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:17.263718 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0de49208-77bb-465b-a7ba-7dfeae533d73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:17.264176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0de49208-77bb-465b-a7ba-7dfeae533d73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:17.264940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0de49208-77bb-465b-a7ba-7dfeae533d73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:17.265381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0de49208-77bb-465b-a7ba-7dfeae533d73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:17.326660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0de49208-77bb-465b-a7ba-7dfeae533d73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:17.334164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0de49208-77bb-465b-a7ba-7dfeae533d73 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081650 Jul 14 16:02:17.334731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 744/1585] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:17 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:17.549562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-12076b54-4588-49b8-bc55-c56a3bf517f0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:17.550426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-12076b54-4588-49b8-bc55-c56a3bf517f0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:17.556949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-12076b54-4588-49b8-bc55-c56a3bf517f0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:17.557401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-12076b54-4588-49b8-bc55-c56a3bf517f0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:17.558157 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-12076b54-4588-49b8-bc55-c56a3bf517f0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:17.558595 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-12076b54-4588-49b8-bc55-c56a3bf517f0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:17.588053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-12076b54-4588-49b8-bc55-c56a3bf517f0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042455 Jul 14 16:02:17.588608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 842/1586] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:17 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:18.351916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-62990f38-61de-4695-87b9-f92d025cd855 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:18.352450 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-62990f38-61de-4695-87b9-f92d025cd855 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:18.358761 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62990f38-61de-4695-87b9-f92d025cd855 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:18.359215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62990f38-61de-4695-87b9-f92d025cd855 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.360021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62990f38-61de-4695-87b9-f92d025cd855 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:18.360461 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62990f38-61de-4695-87b9-f92d025cd855 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.421625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-62990f38-61de-4695-87b9-f92d025cd855 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:18.429099 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-62990f38-61de-4695-87b9-f92d025cd855 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081550 Jul 14 16:02:18.430249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 745/1587] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:18 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:18.599617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8fec3f1e-310f-4727-9195-1eb780782466 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:18.600630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8fec3f1e-310f-4727-9195-1eb780782466 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:18.608073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8fec3f1e-310f-4727-9195-1eb780782466 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:18.608462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8fec3f1e-310f-4727-9195-1eb780782466 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.609225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8fec3f1e-310f-4727-9195-1eb780782466 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:18.609670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8fec3f1e-310f-4727-9195-1eb780782466 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:18.638890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8fec3f1e-310f-4727-9195-1eb780782466 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043206 Jul 14 16:02:18.639443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 843/1588] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:18 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:19.447459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4b07e86c-3631-443c-a742-e22ce33ec53a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:19.448119 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4b07e86c-3631-443c-a742-e22ce33ec53a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:19.454623 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4b07e86c-3631-443c-a742-e22ce33ec53a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:19.455075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4b07e86c-3631-443c-a742-e22ce33ec53a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:19.455870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4b07e86c-3631-443c-a742-e22ce33ec53a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:19.456309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4b07e86c-3631-443c-a742-e22ce33ec53a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:19.520935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4b07e86c-3631-443c-a742-e22ce33ec53a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:19.529691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4b07e86c-3631-443c-a742-e22ce33ec53a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087155 Jul 14 16:02:19.530252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 746/1589] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:19 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:19.651325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1317c4e5-ab87-4498-9ead-558b979d1653 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:19.652197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1317c4e5-ab87-4498-9ead-558b979d1653 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:19.658805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1317c4e5-ab87-4498-9ead-558b979d1653 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:19.659258 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1317c4e5-ab87-4498-9ead-558b979d1653 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:19.660052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1317c4e5-ab87-4498-9ead-558b979d1653 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:19.660746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1317c4e5-ab87-4498-9ead-558b979d1653 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:19.677686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:19.691060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1317c4e5-ab87-4498-9ead-558b979d1653 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044638 Jul 14 16:02:19.691633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 844/1590] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:19 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:20.546785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-98c3405e-ad48-41f9-8039-7cd28c62a545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:20.547396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-98c3405e-ad48-41f9-8039-7cd28c62a545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:20.553837 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-98c3405e-ad48-41f9-8039-7cd28c62a545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.554285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-98c3405e-ad48-41f9-8039-7cd28c62a545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.555728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-98c3405e-ad48-41f9-8039-7cd28c62a545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.556168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-98c3405e-ad48-41f9-8039-7cd28c62a545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.620503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-98c3405e-ad48-41f9-8039-7cd28c62a545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:20.627888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-98c3405e-ad48-41f9-8039-7cd28c62a545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084937 Jul 14 16:02:20.628456 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 747/1591] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:20 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:20.702566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0b987433-b7fe-46d3-b99f-7f8361f5456b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:20.703512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0b987433-b7fe-46d3-b99f-7f8361f5456b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:20.710060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b987433-b7fe-46d3-b99f-7f8361f5456b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.710518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b987433-b7fe-46d3-b99f-7f8361f5456b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.711454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b987433-b7fe-46d3-b99f-7f8361f5456b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:20.711912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b987433-b7fe-46d3-b99f-7f8361f5456b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:20.740245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0b987433-b7fe-46d3-b99f-7f8361f5456b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041639 Jul 14 16:02:20.740832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 845/1592] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:20 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:21.645593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ebdeff53-df3f-4136-8f45-94136160dc3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:21.646265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ebdeff53-df3f-4136-8f45-94136160dc3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:21.653366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ebdeff53-df3f-4136-8f45-94136160dc3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:21.653813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ebdeff53-df3f-4136-8f45-94136160dc3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:21.654572 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ebdeff53-df3f-4136-8f45-94136160dc3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:21.655010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ebdeff53-df3f-4136-8f45-94136160dc3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:21.716891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ebdeff53-df3f-4136-8f45-94136160dc3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:21.724443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ebdeff53-df3f-4136-8f45-94136160dc3b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082734 Jul 14 16:02:21.725028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 748/1593] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:21 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:21.752574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-11d80b2e-1041-498f-8ee6-0a3113122234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:21.753524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-11d80b2e-1041-498f-8ee6-0a3113122234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:21.760667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11d80b2e-1041-498f-8ee6-0a3113122234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:21.760988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11d80b2e-1041-498f-8ee6-0a3113122234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:21.761736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11d80b2e-1041-498f-8ee6-0a3113122234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:21.762167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11d80b2e-1041-498f-8ee6-0a3113122234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:21.791325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-11d80b2e-1041-498f-8ee6-0a3113122234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042482 Jul 14 16:02:21.791911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 846/1594] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:21 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:22.741560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-848cf5c5-78e3-4ab9-b296-49e021a81f61 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:22.742448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-848cf5c5-78e3-4ab9-b296-49e021a81f61 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:22.749132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-848cf5c5-78e3-4ab9-b296-49e021a81f61 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:22.749849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-848cf5c5-78e3-4ab9-b296-49e021a81f61 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:22.750511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-848cf5c5-78e3-4ab9-b296-49e021a81f61 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:22.750949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-848cf5c5-78e3-4ab9-b296-49e021a81f61 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:22.802645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8201535e-fa91-4e50-b865-ad07861d6179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:22.803551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8201535e-fa91-4e50-b865-ad07861d6179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:22.810513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8201535e-fa91-4e50-b865-ad07861d6179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:22.810647 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8201535e-fa91-4e50-b865-ad07861d6179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:22.811307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8201535e-fa91-4e50-b865-ad07861d6179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:22.811769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8201535e-fa91-4e50-b865-ad07861d6179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:22.812598 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-848cf5c5-78e3-4ab9-b296-49e021a81f61 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:22.820001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-848cf5c5-78e3-4ab9-b296-49e021a81f61 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082235 Jul 14 16:02:22.821180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 749/1595] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:22 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:22.841722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8201535e-fa91-4e50-b865-ad07861d6179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043013 Jul 14 16:02:22.842276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 847/1596] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:22 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:02:23.837575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f8da613b-5959-442c-9b05-d28f81744ac7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:23.838178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f8da613b-5959-442c-9b05-d28f81744ac7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:23.844531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8da613b-5959-442c-9b05-d28f81744ac7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:23.844978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8da613b-5959-442c-9b05-d28f81744ac7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:23.845726 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8da613b-5959-442c-9b05-d28f81744ac7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:23.846157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8da613b-5959-442c-9b05-d28f81744ac7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:23.853979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7a1eb2ae-de51-436d-b47b-5c97495442fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:23.854934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7a1eb2ae-de51-436d-b47b-5c97495442fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:23.861559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a1eb2ae-de51-436d-b47b-5c97495442fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:23.862012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a1eb2ae-de51-436d-b47b-5c97495442fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:23.862794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a1eb2ae-de51-436d-b47b-5c97495442fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:23.863234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a1eb2ae-de51-436d-b47b-5c97495442fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:23.893703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7a1eb2ae-de51-436d-b47b-5c97495442fd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044388 Jul 14 16:02:23.894284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 848/1597] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:23 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:02:23.908072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f8da613b-5959-442c-9b05-d28f81744ac7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:23.916624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f8da613b-5959-442c-9b05-d28f81744ac7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083093 Jul 14 16:02:23.917187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 750/1598] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:23 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:24.905231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8cda436d-aa80-4133-b27c-5dd722c5b578 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:24.906172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8cda436d-aa80-4133-b27c-5dd722c5b578 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:24.912917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8cda436d-aa80-4133-b27c-5dd722c5b578 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:24.913351 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8cda436d-aa80-4133-b27c-5dd722c5b578 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:24.914663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8cda436d-aa80-4133-b27c-5dd722c5b578 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:24.915087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8cda436d-aa80-4133-b27c-5dd722c5b578 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:24.933843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1f7774d1-a0dd-4847-8374-9121ee43ad51 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:24.934492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1f7774d1-a0dd-4847-8374-9121ee43ad51 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:24.940949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f7774d1-a0dd-4847-8374-9121ee43ad51 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:24.941401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f7774d1-a0dd-4847-8374-9121ee43ad51 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:24.942164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f7774d1-a0dd-4847-8374-9121ee43ad51 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:24.942601 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f7774d1-a0dd-4847-8374-9121ee43ad51 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:24.944006 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8cda436d-aa80-4133-b27c-5dd722c5b578 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042696 Jul 14 16:02:24.944568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 849/1599] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:24 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:25.009885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1f7774d1-a0dd-4847-8374-9121ee43ad51 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:25.017328 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1f7774d1-a0dd-4847-8374-9121ee43ad51 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088086 Jul 14 16:02:25.017885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 751/1600] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:24 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:25.954899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ec1ec127-8ae6-4845-ac16-2522328b0dc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:25.955837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ec1ec127-8ae6-4845-ac16-2522328b0dc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:25.963202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec1ec127-8ae6-4845-ac16-2522328b0dc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.963688 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec1ec127-8ae6-4845-ac16-2522328b0dc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:25.964454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec1ec127-8ae6-4845-ac16-2522328b0dc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:25.964878 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec1ec127-8ae6-4845-ac16-2522328b0dc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:26.000304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ec1ec127-8ae6-4845-ac16-2522328b0dc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049326 Jul 14 16:02:26.000874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 850/1601] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:25 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:26.034859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dcc2f744-1384-4c46-8365-38b6a50eb333 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:26.035750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dcc2f744-1384-4c46-8365-38b6a50eb333 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:26.042818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dcc2f744-1384-4c46-8365-38b6a50eb333 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:26.043268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dcc2f744-1384-4c46-8365-38b6a50eb333 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:26.044067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dcc2f744-1384-4c46-8365-38b6a50eb333 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:26.044507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dcc2f744-1384-4c46-8365-38b6a50eb333 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:26.106956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-dcc2f744-1384-4c46-8365-38b6a50eb333 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:26.114466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dcc2f744-1384-4c46-8365-38b6a50eb333 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083445 Jul 14 16:02:26.115027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 752/1602] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:26 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:27.013354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-263ef065-046d-43af-932e-564185a9f857 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:27.014307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-263ef065-046d-43af-932e-564185a9f857 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:27.016692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=62 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:27.022012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-263ef065-046d-43af-932e-564185a9f857 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:27.022464 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-263ef065-046d-43af-932e-564185a9f857 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:27.023279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-263ef065-046d-43af-932e-564185a9f857 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:27.023780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-263ef065-046d-43af-932e-564185a9f857 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:27.053116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-263ef065-046d-43af-932e-564185a9f857 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044716 Jul 14 16:02:27.053682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 851/1603] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:27 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:27.133112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-15d22eb7-0fcc-4b57-b59f-92ccef9189bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:27.134031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-15d22eb7-0fcc-4b57-b59f-92ccef9189bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:27.141831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-15d22eb7-0fcc-4b57-b59f-92ccef9189bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:27.142487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-15d22eb7-0fcc-4b57-b59f-92ccef9189bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:27.143652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-15d22eb7-0fcc-4b57-b59f-92ccef9189bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:27.144310 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-15d22eb7-0fcc-4b57-b59f-92ccef9189bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:27.209514 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-15d22eb7-0fcc-4b57-b59f-92ccef9189bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:27.218166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-15d22eb7-0fcc-4b57-b59f-92ccef9189bd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090852 Jul 14 16:02:27.218728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 753/1604] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:27 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:28.065607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-18b19c51-e20c-4f4d-bd53-2f96f7936adf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:28.066530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-18b19c51-e20c-4f4d-bd53-2f96f7936adf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:28.073503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-18b19c51-e20c-4f4d-bd53-2f96f7936adf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.073955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-18b19c51-e20c-4f4d-bd53-2f96f7936adf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.074717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-18b19c51-e20c-4f4d-bd53-2f96f7936adf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.075162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-18b19c51-e20c-4f4d-bd53-2f96f7936adf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.105988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-18b19c51-e20c-4f4d-bd53-2f96f7936adf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044382 Jul 14 16:02:28.106563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 852/1605] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:28 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:28.235051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-16be99d6-1bf4-4b2b-b104-1ebdcd4922ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:28.235683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-16be99d6-1bf4-4b2b-b104-1ebdcd4922ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:28.242380 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-16be99d6-1bf4-4b2b-b104-1ebdcd4922ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.242829 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-16be99d6-1bf4-4b2b-b104-1ebdcd4922ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.243582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-16be99d6-1bf4-4b2b-b104-1ebdcd4922ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:28.244040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-16be99d6-1bf4-4b2b-b104-1ebdcd4922ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:28.305106 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-16be99d6-1bf4-4b2b-b104-1ebdcd4922ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:28.312472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-16be99d6-1bf4-4b2b-b104-1ebdcd4922ac tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081288 Jul 14 16:02:28.313032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 754/1606] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:28 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:29.118602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-28a6b7ae-1504-4a44-954c-a935eceeb535 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:29.119520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-28a6b7ae-1504-4a44-954c-a935eceeb535 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:29.126019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28a6b7ae-1504-4a44-954c-a935eceeb535 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:29.126476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28a6b7ae-1504-4a44-954c-a935eceeb535 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:29.127238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28a6b7ae-1504-4a44-954c-a935eceeb535 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:29.127712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28a6b7ae-1504-4a44-954c-a935eceeb535 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:29.156676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-28a6b7ae-1504-4a44-954c-a935eceeb535 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042820 Jul 14 16:02:29.157230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 853/1607] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:29 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:29.329256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7603dec0-adf4-44e3-ac61-c475d683f381 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:29.329778 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7603dec0-adf4-44e3-ac61-c475d683f381 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:29.337061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7603dec0-adf4-44e3-ac61-c475d683f381 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:29.337515 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7603dec0-adf4-44e3-ac61-c475d683f381 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:29.338313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7603dec0-adf4-44e3-ac61-c475d683f381 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:29.338750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7603dec0-adf4-44e3-ac61-c475d683f381 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:29.404340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7603dec0-adf4-44e3-ac61-c475d683f381 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:29.407988 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:29.413225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7603dec0-adf4-44e3-ac61-c475d683f381 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087976 Jul 14 16:02:29.414327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 755/1608] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:29 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:30.169676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2f8b2bcc-397a-4f06-aba1-8154c42c5f77 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:30.170078 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2f8b2bcc-397a-4f06-aba1-8154c42c5f77 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:30.176665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f8b2bcc-397a-4f06-aba1-8154c42c5f77 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:30.177115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f8b2bcc-397a-4f06-aba1-8154c42c5f77 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:30.177891 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f8b2bcc-397a-4f06-aba1-8154c42c5f77 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:30.178375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f8b2bcc-397a-4f06-aba1-8154c42c5f77 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:30.208072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2f8b2bcc-397a-4f06-aba1-8154c42c5f77 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043141 Jul 14 16:02:30.208633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 854/1609] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:30 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:30.431073 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-755cce1c-0722-4d94-96d3-4a8efeeb73a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:30.431716 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-755cce1c-0722-4d94-96d3-4a8efeeb73a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:30.438518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-755cce1c-0722-4d94-96d3-4a8efeeb73a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:30.438972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-755cce1c-0722-4d94-96d3-4a8efeeb73a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:30.439765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-755cce1c-0722-4d94-96d3-4a8efeeb73a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:30.440212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-755cce1c-0722-4d94-96d3-4a8efeeb73a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:30.506316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-755cce1c-0722-4d94-96d3-4a8efeeb73a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:30.514746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-755cce1c-0722-4d94-96d3-4a8efeeb73a0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088369 Jul 14 16:02:30.515316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 756/1610] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:30 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:31.220765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-76b46dac-b6b0-4767-bf69-7de09b997fd1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:31.221591 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-76b46dac-b6b0-4767-bf69-7de09b997fd1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:31.229079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76b46dac-b6b0-4767-bf69-7de09b997fd1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:31.229528 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76b46dac-b6b0-4767-bf69-7de09b997fd1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:31.230276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76b46dac-b6b0-4767-bf69-7de09b997fd1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:31.230710 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76b46dac-b6b0-4767-bf69-7de09b997fd1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:31.259408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-76b46dac-b6b0-4767-bf69-7de09b997fd1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042692 Jul 14 16:02:31.260144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 855/1611] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:31 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:31.532130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1eda9458-d324-445b-abd1-26636694ac43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:31.532671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1eda9458-d324-445b-abd1-26636694ac43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:31.540739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1eda9458-d324-445b-abd1-26636694ac43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:31.541192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1eda9458-d324-445b-abd1-26636694ac43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:31.541964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1eda9458-d324-445b-abd1-26636694ac43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:31.542407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1eda9458-d324-445b-abd1-26636694ac43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:31.606487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1eda9458-d324-445b-abd1-26636694ac43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:31.613936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1eda9458-d324-445b-abd1-26636694ac43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085811 Jul 14 16:02:31.614499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 757/1612] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:31 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:32.271282 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cfc1bf0b-a8d2-4e8e-9a76-dbd1bbc6cdcf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:32.272279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cfc1bf0b-a8d2-4e8e-9a76-dbd1bbc6cdcf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:32.279564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cfc1bf0b-a8d2-4e8e-9a76-dbd1bbc6cdcf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:32.280048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cfc1bf0b-a8d2-4e8e-9a76-dbd1bbc6cdcf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.280863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cfc1bf0b-a8d2-4e8e-9a76-dbd1bbc6cdcf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:32.281303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cfc1bf0b-a8d2-4e8e-9a76-dbd1bbc6cdcf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.310601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cfc1bf0b-a8d2-4e8e-9a76-dbd1bbc6cdcf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043341 Jul 14 16:02:32.311157 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 856/1613] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:32 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:32.631351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8f51a7bb-52f3-4edd-8a32-b6e2d965bdfc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:32.631940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8f51a7bb-52f3-4edd-8a32-b6e2d965bdfc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:32.635139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=56 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:32.640476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f51a7bb-52f3-4edd-8a32-b6e2d965bdfc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:32.640935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f51a7bb-52f3-4edd-8a32-b6e2d965bdfc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.641710 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f51a7bb-52f3-4edd-8a32-b6e2d965bdfc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:32.642184 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f51a7bb-52f3-4edd-8a32-b6e2d965bdfc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:32.704651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8f51a7bb-52f3-4edd-8a32-b6e2d965bdfc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:32.712399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8f51a7bb-52f3-4edd-8a32-b6e2d965bdfc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084995 Jul 14 16:02:32.712979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 758/1614] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:32 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:33.323201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c1bad015-db29-4b10-9a72-c4428e3273a1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:33.324067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c1bad015-db29-4b10-9a72-c4428e3273a1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:33.330278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c1bad015-db29-4b10-9a72-c4428e3273a1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:33.330726 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c1bad015-db29-4b10-9a72-c4428e3273a1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:33.331485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c1bad015-db29-4b10-9a72-c4428e3273a1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:33.331968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c1bad015-db29-4b10-9a72-c4428e3273a1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:33.362076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c1bad015-db29-4b10-9a72-c4428e3273a1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043825 Jul 14 16:02:33.362631 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 857/1615] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:33 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:33.730075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-faba91ca-b052-4007-bee4-40e27f83c5ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:33.730719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-faba91ca-b052-4007-bee4-40e27f83c5ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:33.737175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-faba91ca-b052-4007-bee4-40e27f83c5ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:33.737621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-faba91ca-b052-4007-bee4-40e27f83c5ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:33.738375 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-faba91ca-b052-4007-bee4-40e27f83c5ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:33.738810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-faba91ca-b052-4007-bee4-40e27f83c5ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:33.805669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-faba91ca-b052-4007-bee4-40e27f83c5ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:33.813241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-faba91ca-b052-4007-bee4-40e27f83c5ff tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087939 Jul 14 16:02:33.813809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 759/1616] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:33 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:34.373183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4d24b104-d0e7-490f-b964-5a6761067ca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:34.374021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4d24b104-d0e7-490f-b964-5a6761067ca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:34.380492 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4d24b104-d0e7-490f-b964-5a6761067ca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.380933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4d24b104-d0e7-490f-b964-5a6761067ca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.381689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4d24b104-d0e7-490f-b964-5a6761067ca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.382623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4d24b104-d0e7-490f-b964-5a6761067ca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.411465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4d24b104-d0e7-490f-b964-5a6761067ca6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042456 Jul 14 16:02:34.412034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 858/1617] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:34 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:34.829883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8ee8d867-4968-462a-a4f6-fd6dcc1c1de9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:34.830493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8ee8d867-4968-462a-a4f6-fd6dcc1c1de9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:34.837509 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ee8d867-4968-462a-a4f6-fd6dcc1c1de9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.837949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ee8d867-4968-462a-a4f6-fd6dcc1c1de9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.838707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ee8d867-4968-462a-a4f6-fd6dcc1c1de9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:34.839158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ee8d867-4968-462a-a4f6-fd6dcc1c1de9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:34.901578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8ee8d867-4968-462a-a4f6-fd6dcc1c1de9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:34.911877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8ee8d867-4968-462a-a4f6-fd6dcc1c1de9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085780 Jul 14 16:02:34.912456 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 760/1618] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:34 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:35.422490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-854b26d1-a834-445e-9363-070c405e913b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:35.423447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-854b26d1-a834-445e-9363-070c405e913b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:35.430510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-854b26d1-a834-445e-9363-070c405e913b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:35.430958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-854b26d1-a834-445e-9363-070c405e913b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:35.431746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-854b26d1-a834-445e-9363-070c405e913b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:35.432184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-854b26d1-a834-445e-9363-070c405e913b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:35.461759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-854b26d1-a834-445e-9363-070c405e913b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043259 Jul 14 16:02:35.462306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 859/1619] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:35 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:35.931279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4f2013ce-c642-439d-b206-c4b9e75bccfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:35.931912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4f2013ce-c642-439d-b206-c4b9e75bccfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:35.938528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4f2013ce-c642-439d-b206-c4b9e75bccfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:35.938991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4f2013ce-c642-439d-b206-c4b9e75bccfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:35.939802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4f2013ce-c642-439d-b206-c4b9e75bccfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:35.940247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4f2013ce-c642-439d-b206-c4b9e75bccfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:36.002332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4f2013ce-c642-439d-b206-c4b9e75bccfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:36.010710 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4f2013ce-c642-439d-b206-c4b9e75bccfa tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085016 Jul 14 16:02:36.011283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 761/1620] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:35 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:36.472413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-311441d1-9202-4fc3-baa7-3649bf8bc5b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:36.473340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-311441d1-9202-4fc3-baa7-3649bf8bc5b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:36.480713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-311441d1-9202-4fc3-baa7-3649bf8bc5b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:36.481168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-311441d1-9202-4fc3-baa7-3649bf8bc5b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:36.481929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-311441d1-9202-4fc3-baa7-3649bf8bc5b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:36.482368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-311441d1-9202-4fc3-baa7-3649bf8bc5b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:36.510713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-311441d1-9202-4fc3-baa7-3649bf8bc5b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042294 Jul 14 16:02:36.511276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 860/1621] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:36 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:37.028357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b526b63e-7a0e-4f50-8123-6f937cb1ad7b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:37.028973 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b526b63e-7a0e-4f50-8123-6f937cb1ad7b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:37.035453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b526b63e-7a0e-4f50-8123-6f937cb1ad7b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.036192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b526b63e-7a0e-4f50-8123-6f937cb1ad7b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.036951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b526b63e-7a0e-4f50-8123-6f937cb1ad7b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.037396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b526b63e-7a0e-4f50-8123-6f937cb1ad7b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.098470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b526b63e-7a0e-4f50-8123-6f937cb1ad7b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:37.106722 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b526b63e-7a0e-4f50-8123-6f937cb1ad7b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082212 Jul 14 16:02:37.107291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 762/1622] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:37 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:37.521614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0a8375dd-1084-4d6f-a2aa-7a15d4da7e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:37.522523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0a8375dd-1084-4d6f-a2aa-7a15d4da7e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:37.529641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a8375dd-1084-4d6f-a2aa-7a15d4da7e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.530088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a8375dd-1084-4d6f-a2aa-7a15d4da7e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.530874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a8375dd-1084-4d6f-a2aa-7a15d4da7e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:37.531305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a8375dd-1084-4d6f-a2aa-7a15d4da7e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:37.534812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:37.560310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0a8375dd-1084-4d6f-a2aa-7a15d4da7e5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042629 Jul 14 16:02:37.560865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 861/1623] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:37 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:38.123486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-432e2e19-cdf0-4aa7-8181-b6aa7d481477 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:38.124132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-432e2e19-cdf0-4aa7-8181-b6aa7d481477 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:38.130606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-432e2e19-cdf0-4aa7-8181-b6aa7d481477 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:38.131121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-432e2e19-cdf0-4aa7-8181-b6aa7d481477 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:38.131926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-432e2e19-cdf0-4aa7-8181-b6aa7d481477 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:38.132496 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-432e2e19-cdf0-4aa7-8181-b6aa7d481477 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:38.199041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-432e2e19-cdf0-4aa7-8181-b6aa7d481477 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:38.206485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-432e2e19-cdf0-4aa7-8181-b6aa7d481477 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086856 Jul 14 16:02:38.207056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 763/1624] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:38 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:38.572290 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b204331f-9707-4f4f-afb9-f317fe33053f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:38.573213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b204331f-9707-4f4f-afb9-f317fe33053f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:38.579804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b204331f-9707-4f4f-afb9-f317fe33053f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:38.580254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b204331f-9707-4f4f-afb9-f317fe33053f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:38.581014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b204331f-9707-4f4f-afb9-f317fe33053f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:38.581456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b204331f-9707-4f4f-afb9-f317fe33053f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:38.611514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b204331f-9707-4f4f-afb9-f317fe33053f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043443 Jul 14 16:02:38.612106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 862/1625] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:38 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:39.223778 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-825678e2-5f24-4d51-8d65-86c7245a2d0b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:39.224389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-825678e2-5f24-4d51-8d65-86c7245a2d0b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:39.230988 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-825678e2-5f24-4d51-8d65-86c7245a2d0b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.231438 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-825678e2-5f24-4d51-8d65-86c7245a2d0b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.232233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-825678e2-5f24-4d51-8d65-86c7245a2d0b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.232672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-825678e2-5f24-4d51-8d65-86c7245a2d0b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.293696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-825678e2-5f24-4d51-8d65-86c7245a2d0b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:39.301206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-825678e2-5f24-4d51-8d65-86c7245a2d0b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081350 Jul 14 16:02:39.301771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 764/1626] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:39 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:39.623350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bc0140cb-2e12-4842-95ab-a82919761720 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:39.624218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bc0140cb-2e12-4842-95ab-a82919761720 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:39.630847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc0140cb-2e12-4842-95ab-a82919761720 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.631294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc0140cb-2e12-4842-95ab-a82919761720 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.632224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc0140cb-2e12-4842-95ab-a82919761720 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:39.632658 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc0140cb-2e12-4842-95ab-a82919761720 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:39.661946 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bc0140cb-2e12-4842-95ab-a82919761720 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042648 Jul 14 16:02:39.662582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 863/1627] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:39 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:40.318578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-db1b7fb4-4e56-47ef-96dc-f50a763bce01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:40.319127 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-db1b7fb4-4e56-47ef-96dc-f50a763bce01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:40.326625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db1b7fb4-4e56-47ef-96dc-f50a763bce01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:40.327079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db1b7fb4-4e56-47ef-96dc-f50a763bce01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:40.327873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db1b7fb4-4e56-47ef-96dc-f50a763bce01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:40.328319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db1b7fb4-4e56-47ef-96dc-f50a763bce01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:40.392336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-db1b7fb4-4e56-47ef-96dc-f50a763bce01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:40.400067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-db1b7fb4-4e56-47ef-96dc-f50a763bce01 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085445 Jul 14 16:02:40.400641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 765/1628] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:40 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:40.674613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6d0f0f87-fcac-48ff-b79e-73091b7d3169 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:40.675530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6d0f0f87-fcac-48ff-b79e-73091b7d3169 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:40.682922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6d0f0f87-fcac-48ff-b79e-73091b7d3169 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:40.683349 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6d0f0f87-fcac-48ff-b79e-73091b7d3169 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:40.684144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6d0f0f87-fcac-48ff-b79e-73091b7d3169 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:40.684584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6d0f0f87-fcac-48ff-b79e-73091b7d3169 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:40.715158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6d0f0f87-fcac-48ff-b79e-73091b7d3169 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044493 Jul 14 16:02:40.715745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 864/1629] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:40 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:41.417200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1bcebc0e-f3d5-48b8-b1dd-77ae2e61703c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:41.417959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1bcebc0e-f3d5-48b8-b1dd-77ae2e61703c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:41.424039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1bcebc0e-f3d5-48b8-b1dd-77ae2e61703c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:41.424486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1bcebc0e-f3d5-48b8-b1dd-77ae2e61703c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:41.425236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1bcebc0e-f3d5-48b8-b1dd-77ae2e61703c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:41.425669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1bcebc0e-f3d5-48b8-b1dd-77ae2e61703c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:41.487486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1bcebc0e-f3d5-48b8-b1dd-77ae2e61703c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:41.495894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1bcebc0e-f3d5-48b8-b1dd-77ae2e61703c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082521 Jul 14 16:02:41.496652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 766/1630] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:41 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:41.726837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cfe9b789-9786-4be0-be32-6ff6322d199f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:41.727691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cfe9b789-9786-4be0-be32-6ff6322d199f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:41.734146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cfe9b789-9786-4be0-be32-6ff6322d199f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:41.734599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cfe9b789-9786-4be0-be32-6ff6322d199f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:41.735365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cfe9b789-9786-4be0-be32-6ff6322d199f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:41.735832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cfe9b789-9786-4be0-be32-6ff6322d199f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:41.765536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cfe9b789-9786-4be0-be32-6ff6322d199f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042747 Jul 14 16:02:41.766088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 865/1631] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:41 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:42.512969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-948f83b5-76cc-4509-b46c-1d31578c4235 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:42.513575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-948f83b5-76cc-4509-b46c-1d31578c4235 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:42.520028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-948f83b5-76cc-4509-b46c-1d31578c4235 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:42.520476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-948f83b5-76cc-4509-b46c-1d31578c4235 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:42.521233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-948f83b5-76cc-4509-b46c-1d31578c4235 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:42.521662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-948f83b5-76cc-4509-b46c-1d31578c4235 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:42.586810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-948f83b5-76cc-4509-b46c-1d31578c4235 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:42.594334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-948f83b5-76cc-4509-b46c-1d31578c4235 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085230 Jul 14 16:02:42.594898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 767/1632] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:42 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:42.777967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9c689937-89e4-421a-856c-ee1356cbecd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:42.778813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9c689937-89e4-421a-856c-ee1356cbecd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:42.785313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c689937-89e4-421a-856c-ee1356cbecd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:42.786017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c689937-89e4-421a-856c-ee1356cbecd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:42.786810 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c689937-89e4-421a-856c-ee1356cbecd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:42.787249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c689937-89e4-421a-856c-ee1356cbecd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:42.818549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9c689937-89e4-421a-856c-ee1356cbecd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044658 Jul 14 16:02:42.819111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 866/1633] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:42 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:43.611659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-187aa7e6-4879-423c-a5d9-c91ffe9886b1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:43.612205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-187aa7e6-4879-423c-a5d9-c91ffe9886b1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:43.619409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-187aa7e6-4879-423c-a5d9-c91ffe9886b1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:43.619886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-187aa7e6-4879-423c-a5d9-c91ffe9886b1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:43.620682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-187aa7e6-4879-423c-a5d9-c91ffe9886b1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:43.621117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-187aa7e6-4879-423c-a5d9-c91ffe9886b1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:43.685288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-187aa7e6-4879-423c-a5d9-c91ffe9886b1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:43.693487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-187aa7e6-4879-423c-a5d9-c91ffe9886b1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085705 Jul 14 16:02:43.694070 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 768/1634] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:43 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:43.830485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a842c07f-50bd-4868-851c-51044874a72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:43.831413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a842c07f-50bd-4868-851c-51044874a72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:43.838204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a842c07f-50bd-4868-851c-51044874a72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:43.838658 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a842c07f-50bd-4868-851c-51044874a72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:43.839422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a842c07f-50bd-4868-851c-51044874a72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:43.839893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a842c07f-50bd-4868-851c-51044874a72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:43.869057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a842c07f-50bd-4868-851c-51044874a72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042498 Jul 14 16:02:43.869547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 867/1635] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:43 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:44.710880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4591d16e-c020-4db4-a536-b8f5df09d1cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:44.711573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4591d16e-c020-4db4-a536-b8f5df09d1cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:44.718221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4591d16e-c020-4db4-a536-b8f5df09d1cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:44.718663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4591d16e-c020-4db4-a536-b8f5df09d1cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:44.719426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4591d16e-c020-4db4-a536-b8f5df09d1cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:44.719956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4591d16e-c020-4db4-a536-b8f5df09d1cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:44.782257 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4591d16e-c020-4db4-a536-b8f5df09d1cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:44.791030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4591d16e-c020-4db4-a536-b8f5df09d1cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084650 Jul 14 16:02:44.791652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 769/1636] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:44 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:44.880003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e09d21b1-f7e2-48c4-a276-fb674d65da18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:44.880933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e09d21b1-f7e2-48c4-a276-fb674d65da18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:44.888190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e09d21b1-f7e2-48c4-a276-fb674d65da18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:44.888642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e09d21b1-f7e2-48c4-a276-fb674d65da18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:44.889413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e09d21b1-f7e2-48c4-a276-fb674d65da18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:44.889838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e09d21b1-f7e2-48c4-a276-fb674d65da18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:44.918940 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e09d21b1-f7e2-48c4-a276-fb674d65da18 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043039 Jul 14 16:02:44.919507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 868/1637] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:44 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:45.808783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3f1ce262-9731-4716-bcd7-12b2dc9b4a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:45.809432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3f1ce262-9731-4716-bcd7-12b2dc9b4a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:45.815919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3f1ce262-9731-4716-bcd7-12b2dc9b4a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:45.816371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3f1ce262-9731-4716-bcd7-12b2dc9b4a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:45.817133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3f1ce262-9731-4716-bcd7-12b2dc9b4a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:45.817571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3f1ce262-9731-4716-bcd7-12b2dc9b4a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:45.879017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3f1ce262-9731-4716-bcd7-12b2dc9b4a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:45.886918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3f1ce262-9731-4716-bcd7-12b2dc9b4a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082102 Jul 14 16:02:45.887480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 770/1638] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:45 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:45.930577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-649fdbec-1076-4372-b82d-36233cfedeb3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:45.931536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-649fdbec-1076-4372-b82d-36233cfedeb3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:45.938030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-649fdbec-1076-4372-b82d-36233cfedeb3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:45.938474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-649fdbec-1076-4372-b82d-36233cfedeb3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:45.939231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-649fdbec-1076-4372-b82d-36233cfedeb3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:45.939693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-649fdbec-1076-4372-b82d-36233cfedeb3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:45.969171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-649fdbec-1076-4372-b82d-36233cfedeb3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042687 Jul 14 16:02:45.969722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 869/1639] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:45 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:46.903021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bbabfc47-7c57-4f1c-8f4c-9685e95e67d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:46.903661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bbabfc47-7c57-4f1c-8f4c-9685e95e67d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:46.910112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbabfc47-7c57-4f1c-8f4c-9685e95e67d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:46.910561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbabfc47-7c57-4f1c-8f4c-9685e95e67d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:46.911575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbabfc47-7c57-4f1c-8f4c-9685e95e67d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:46.912045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbabfc47-7c57-4f1c-8f4c-9685e95e67d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:46.976627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bbabfc47-7c57-4f1c-8f4c-9685e95e67d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:46.980827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bc5c0f2e-483b-415b-b4a7-48bd8a639dc3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:46.981749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bc5c0f2e-483b-415b-b4a7-48bd8a639dc3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:46.984238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bbabfc47-7c57-4f1c-8f4c-9685e95e67d7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085096 Jul 14 16:02:46.984991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 771/1640] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:46 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:46.988222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc5c0f2e-483b-415b-b4a7-48bd8a639dc3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:46.988673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc5c0f2e-483b-415b-b4a7-48bd8a639dc3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:46.989925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc5c0f2e-483b-415b-b4a7-48bd8a639dc3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:46.990389 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc5c0f2e-483b-415b-b4a7-48bd8a639dc3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:47.021494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bc5c0f2e-483b-415b-b4a7-48bd8a639dc3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044574 Jul 14 16:02:47.022057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 870/1641] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:46 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:48.002187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d2f1b2af-beef-4a15-974d-a6c7e27af101 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:48.002794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d2f1b2af-beef-4a15-974d-a6c7e27af101 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:48.009503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d2f1b2af-beef-4a15-974d-a6c7e27af101 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:48.009951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d2f1b2af-beef-4a15-974d-a6c7e27af101 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:48.010827 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d2f1b2af-beef-4a15-974d-a6c7e27af101 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:48.011268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d2f1b2af-beef-4a15-974d-a6c7e27af101 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:48.030560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:48.033298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-498fb6fc-1314-4e02-ada1-8045ae3e4465 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:48.034225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-498fb6fc-1314-4e02-ada1-8045ae3e4465 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:48.041502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-498fb6fc-1314-4e02-ada1-8045ae3e4465 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:48.041954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-498fb6fc-1314-4e02-ada1-8045ae3e4465 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:48.042727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-498fb6fc-1314-4e02-ada1-8045ae3e4465 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:48.043163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-498fb6fc-1314-4e02-ada1-8045ae3e4465 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:48.074054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-498fb6fc-1314-4e02-ada1-8045ae3e4465 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044728 Jul 14 16:02:48.074639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 871/1642] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:48 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:02:48.077393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d2f1b2af-beef-4a15-974d-a6c7e27af101 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:48.088456 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d2f1b2af-beef-4a15-974d-a6c7e27af101 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.089862 Jul 14 16:02:48.089249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 772/1643] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:47 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:49.086062 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-20fb9211-abf2-44ca-b4d3-364b2564f907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:49.086877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-20fb9211-abf2-44ca-b4d3-364b2564f907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:49.093302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20fb9211-abf2-44ca-b4d3-364b2564f907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:49.093742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20fb9211-abf2-44ca-b4d3-364b2564f907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:49.094486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20fb9211-abf2-44ca-b4d3-364b2564f907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:49.094912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20fb9211-abf2-44ca-b4d3-364b2564f907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:49.105827 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e92b8dac-9635-4310-89ac-25f89046c222 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:49.106582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e92b8dac-9635-4310-89ac-25f89046c222 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:49.113007 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e92b8dac-9635-4310-89ac-25f89046c222 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:49.113469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e92b8dac-9635-4310-89ac-25f89046c222 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:49.114237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e92b8dac-9635-4310-89ac-25f89046c222 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:49.114680 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e92b8dac-9635-4310-89ac-25f89046c222 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:49.124773 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-20fb9211-abf2-44ca-b4d3-364b2564f907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042822 Jul 14 16:02:49.125341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 872/1644] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:49 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:49.182820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e92b8dac-9635-4310-89ac-25f89046c222 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:49.191499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e92b8dac-9635-4310-89ac-25f89046c222 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.089411 Jul 14 16:02:49.192115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 773/1645] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:49 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:50.136834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a2242010-1462-442f-98dc-9069a80ff769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:50.137789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a2242010-1462-442f-98dc-9069a80ff769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:50.144301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2242010-1462-442f-98dc-9069a80ff769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:50.144752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2242010-1462-442f-98dc-9069a80ff769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:50.145512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2242010-1462-442f-98dc-9069a80ff769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:50.145951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2242010-1462-442f-98dc-9069a80ff769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:50.175680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a2242010-1462-442f-98dc-9069a80ff769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042780 Jul 14 16:02:50.176241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 873/1646] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:50 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:50.209078 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-55a3b857-0177-498a-8f7c-0889cc33ca2e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:50.209685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-55a3b857-0177-498a-8f7c-0889cc33ca2e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:50.216177 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55a3b857-0177-498a-8f7c-0889cc33ca2e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:50.216624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55a3b857-0177-498a-8f7c-0889cc33ca2e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:50.217379 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55a3b857-0177-498a-8f7c-0889cc33ca2e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:50.217817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55a3b857-0177-498a-8f7c-0889cc33ca2e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:50.281938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-55a3b857-0177-498a-8f7c-0889cc33ca2e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:50.290254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-55a3b857-0177-498a-8f7c-0889cc33ca2e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085154 Jul 14 16:02:50.290824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 774/1647] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:50 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:51.188051 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-35a43e94-29ed-43d7-9cf5-1ed0ee5b8f90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:51.188974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-35a43e94-29ed-43d7-9cf5-1ed0ee5b8f90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:51.195540 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-35a43e94-29ed-43d7-9cf5-1ed0ee5b8f90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:51.196072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-35a43e94-29ed-43d7-9cf5-1ed0ee5b8f90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:51.196832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-35a43e94-29ed-43d7-9cf5-1ed0ee5b8f90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:51.197269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-35a43e94-29ed-43d7-9cf5-1ed0ee5b8f90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:51.227620 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-35a43e94-29ed-43d7-9cf5-1ed0ee5b8f90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043589 Jul 14 16:02:51.228193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 874/1648] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:51 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:51.306739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e4e9067f-045a-4a97-b0df-c85c811fd7a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:51.307352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e4e9067f-045a-4a97-b0df-c85c811fd7a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:51.313958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e4e9067f-045a-4a97-b0df-c85c811fd7a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:51.314415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e4e9067f-045a-4a97-b0df-c85c811fd7a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:51.315179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e4e9067f-045a-4a97-b0df-c85c811fd7a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:51.315641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e4e9067f-045a-4a97-b0df-c85c811fd7a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:51.386143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e4e9067f-045a-4a97-b0df-c85c811fd7a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:51.393765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e4e9067f-045a-4a97-b0df-c85c811fd7a3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.091413 Jul 14 16:02:51.394346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 775/1649] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:51 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:52.238631 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8d4a6934-5f39-45c3-b3f4-53549f425413 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:52.239547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8d4a6934-5f39-45c3-b3f4-53549f425413 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:52.246114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8d4a6934-5f39-45c3-b3f4-53549f425413 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:52.246559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8d4a6934-5f39-45c3-b3f4-53549f425413 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:52.247307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8d4a6934-5f39-45c3-b3f4-53549f425413 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:52.247766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8d4a6934-5f39-45c3-b3f4-53549f425413 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:52.277998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8d4a6934-5f39-45c3-b3f4-53549f425413 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043298 Jul 14 16:02:52.278466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 875/1650] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:52 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:52.412966 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bd071776-7271-4a63-a859-b30ee0e64fe1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:52.414051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bd071776-7271-4a63-a859-b30ee0e64fe1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:52.427565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bd071776-7271-4a63-a859-b30ee0e64fe1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:52.428053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bd071776-7271-4a63-a859-b30ee0e64fe1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:52.428990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bd071776-7271-4a63-a859-b30ee0e64fe1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:52.429439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bd071776-7271-4a63-a859-b30ee0e64fe1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:52.490850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bd071776-7271-4a63-a859-b30ee0e64fe1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:52.498995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bd071776-7271-4a63-a859-b30ee0e64fe1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090286 Jul 14 16:02:52.499583 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 776/1651] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:52 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:53.290695 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-06a07ab0-f639-4ba5-b615-9204fffd6b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:53.291545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-06a07ab0-f639-4ba5-b615-9204fffd6b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:53.298199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06a07ab0-f639-4ba5-b615-9204fffd6b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:53.298646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06a07ab0-f639-4ba5-b615-9204fffd6b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:53.299409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06a07ab0-f639-4ba5-b615-9204fffd6b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:53.299871 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06a07ab0-f639-4ba5-b615-9204fffd6b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:53.329659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-06a07ab0-f639-4ba5-b615-9204fffd6b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044123 Jul 14 16:02:53.330223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 876/1652] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:53 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:53.516346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0c9c46b3-23fe-4263-8132-b340713305e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:53.516963 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0c9c46b3-23fe-4263-8132-b340713305e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:53.524661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c9c46b3-23fe-4263-8132-b340713305e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:53.525121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c9c46b3-23fe-4263-8132-b340713305e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:53.525876 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c9c46b3-23fe-4263-8132-b340713305e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:53.526315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c9c46b3-23fe-4263-8132-b340713305e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:53.588076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0c9c46b3-23fe-4263-8132-b340713305e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:53.595443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0c9c46b3-23fe-4263-8132-b340713305e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083003 Jul 14 16:02:53.596040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 777/1653] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:53 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:54.341357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-56fadf79-9024-4c02-83bb-bfa6af283cb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:54.342237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-56fadf79-9024-4c02-83bb-bfa6af283cb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:54.348933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-56fadf79-9024-4c02-83bb-bfa6af283cb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:54.349392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-56fadf79-9024-4c02-83bb-bfa6af283cb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:54.350169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-56fadf79-9024-4c02-83bb-bfa6af283cb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:54.350751 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-56fadf79-9024-4c02-83bb-bfa6af283cb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:54.376232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:54.381390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-56fadf79-9024-4c02-83bb-bfa6af283cb4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044114 Jul 14 16:02:54.382621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 877/1654] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:54 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:54.613013 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bb607645-9622-4010-8a9d-2d4d0c143ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:54.613570 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bb607645-9622-4010-8a9d-2d4d0c143ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:54.621015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb607645-9622-4010-8a9d-2d4d0c143ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:54.621468 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb607645-9622-4010-8a9d-2d4d0c143ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:54.622234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb607645-9622-4010-8a9d-2d4d0c143ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:54.622671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb607645-9622-4010-8a9d-2d4d0c143ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:54.685651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bb607645-9622-4010-8a9d-2d4d0c143ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:54.693082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bb607645-9622-4010-8a9d-2d4d0c143ab4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084006 Jul 14 16:02:54.693641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 778/1655] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:54 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:55.393886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-51e28957-eafe-47a5-8d1a-05d79817c812 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:55.394936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-51e28957-eafe-47a5-8d1a-05d79817c812 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:55.401785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51e28957-eafe-47a5-8d1a-05d79817c812 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:55.402242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51e28957-eafe-47a5-8d1a-05d79817c812 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:55.403011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51e28957-eafe-47a5-8d1a-05d79817c812 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:55.403453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51e28957-eafe-47a5-8d1a-05d79817c812 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:55.434057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-51e28957-eafe-47a5-8d1a-05d79817c812 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044177 Jul 14 16:02:55.434627 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 878/1656] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:55 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:55.711802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-98a1d294-0804-45f3-80ba-aceb8dc81934 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:55.712339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-98a1d294-0804-45f3-80ba-aceb8dc81934 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:55.718968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-98a1d294-0804-45f3-80ba-aceb8dc81934 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:55.719412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-98a1d294-0804-45f3-80ba-aceb8dc81934 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:55.720202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-98a1d294-0804-45f3-80ba-aceb8dc81934 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:55.720637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-98a1d294-0804-45f3-80ba-aceb8dc81934 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:55.784314 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-98a1d294-0804-45f3-80ba-aceb8dc81934 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:55.792680 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-98a1d294-0804-45f3-80ba-aceb8dc81934 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085470 Jul 14 16:02:55.793252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 779/1657] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:55 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:56.445359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b4fb7efc-c55d-4eb1-aa4b-1639eda19235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:56.446324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b4fb7efc-c55d-4eb1-aa4b-1639eda19235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:56.452902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4fb7efc-c55d-4eb1-aa4b-1639eda19235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:56.453348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4fb7efc-c55d-4eb1-aa4b-1639eda19235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:56.454111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4fb7efc-c55d-4eb1-aa4b-1639eda19235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:56.454552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4fb7efc-c55d-4eb1-aa4b-1639eda19235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:56.486266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b4fb7efc-c55d-4eb1-aa4b-1639eda19235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045420 Jul 14 16:02:56.486843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 879/1658] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:56 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:56.810022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d28d8211-9f55-4ea1-a703-7d4ab9821c0a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:56.810590 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d28d8211-9f55-4ea1-a703-7d4ab9821c0a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:56.817069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d28d8211-9f55-4ea1-a703-7d4ab9821c0a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:56.817518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d28d8211-9f55-4ea1-a703-7d4ab9821c0a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:56.818281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d28d8211-9f55-4ea1-a703-7d4ab9821c0a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:56.818721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d28d8211-9f55-4ea1-a703-7d4ab9821c0a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:56.880209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d28d8211-9f55-4ea1-a703-7d4ab9821c0a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:56.887889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d28d8211-9f55-4ea1-a703-7d4ab9821c0a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081798 Jul 14 16:02:56.888460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 780/1659] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:56 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:57.498615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9a887fe6-7b39-4e84-8904-b2453551faf8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:57.499535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9a887fe6-7b39-4e84-8904-b2453551faf8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:57.501865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=58 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:02:57.508599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a887fe6-7b39-4e84-8904-b2453551faf8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.509049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a887fe6-7b39-4e84-8904-b2453551faf8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.509814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a887fe6-7b39-4e84-8904-b2453551faf8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.510254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a887fe6-7b39-4e84-8904-b2453551faf8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.539570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9a887fe6-7b39-4e84-8904-b2453551faf8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045012 Jul 14 16:02:57.540155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 880/1660] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:57 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:57.904772 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f4ca9481-83e5-433d-9cc4-0c5c40ed01ad tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:57.905489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f4ca9481-83e5-433d-9cc4-0c5c40ed01ad tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:57.917628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4ca9481-83e5-433d-9cc4-0c5c40ed01ad tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.918078 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4ca9481-83e5-433d-9cc4-0c5c40ed01ad tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.918907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4ca9481-83e5-433d-9cc4-0c5c40ed01ad tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:57.919344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4ca9481-83e5-433d-9cc4-0c5c40ed01ad tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:57.982600 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f4ca9481-83e5-433d-9cc4-0c5c40ed01ad tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:57.990341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f4ca9481-83e5-433d-9cc4-0c5c40ed01ad tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.089360 Jul 14 16:02:57.991166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 781/1661] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:57 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:02:58.551204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bfb2dfde-9585-445b-9ea5-d91792a8b0e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:58.552072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bfb2dfde-9585-445b-9ea5-d91792a8b0e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:58.559126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bfb2dfde-9585-445b-9ea5-d91792a8b0e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:58.559666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bfb2dfde-9585-445b-9ea5-d91792a8b0e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:58.560637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bfb2dfde-9585-445b-9ea5-d91792a8b0e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:58.561252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bfb2dfde-9585-445b-9ea5-d91792a8b0e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:58.592223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bfb2dfde-9585-445b-9ea5-d91792a8b0e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045069 Jul 14 16:02:58.592790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 881/1662] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:58 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:02:59.006299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b49b86b3-4d6a-4925-957d-e8fd85b9c638 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:59.008150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b49b86b3-4d6a-4925-957d-e8fd85b9c638 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:59.014597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b49b86b3-4d6a-4925-957d-e8fd85b9c638 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:59.015048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b49b86b3-4d6a-4925-957d-e8fd85b9c638 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:59.015846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b49b86b3-4d6a-4925-957d-e8fd85b9c638 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:59.016287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b49b86b3-4d6a-4925-957d-e8fd85b9c638 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:59.077702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b49b86b3-4d6a-4925-957d-e8fd85b9c638 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:02:59.085694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b49b86b3-4d6a-4925-957d-e8fd85b9c638 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082688 Jul 14 16:02:59.086266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 782/1663] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:02:59 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:02:59.604469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fb022a8b-12f9-40ef-89bb-9b49194d8f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:02:59.605391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fb022a8b-12f9-40ef-89bb-9b49194d8f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:02:59.611843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb022a8b-12f9-40ef-89bb-9b49194d8f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:59.612289 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb022a8b-12f9-40ef-89bb-9b49194d8f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:59.613037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb022a8b-12f9-40ef-89bb-9b49194d8f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:02:59.613473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fb022a8b-12f9-40ef-89bb-9b49194d8f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:02:59.642651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fb022a8b-12f9-40ef-89bb-9b49194d8f5b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042798 Jul 14 16:02:59.643213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 882/1664] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:02:59 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:00.102810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8a9214e6-e8d6-439a-a950-0e8c4e63fc26 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:00.103431 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8a9214e6-e8d6-439a-a950-0e8c4e63fc26 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:00.110046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a9214e6-e8d6-439a-a950-0e8c4e63fc26 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:00.110501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a9214e6-e8d6-439a-a950-0e8c4e63fc26 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:00.111261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a9214e6-e8d6-439a-a950-0e8c4e63fc26 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:00.111724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a9214e6-e8d6-439a-a950-0e8c4e63fc26 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:00.177470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8a9214e6-e8d6-439a-a950-0e8c4e63fc26 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:00.185108 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8a9214e6-e8d6-439a-a950-0e8c4e63fc26 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086562 Jul 14 16:03:00.185679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 783/1665] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:00 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:00.654231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1e2eed9e-352e-499a-9bed-87ab0bf0850f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:00.655160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1e2eed9e-352e-499a-9bed-87ab0bf0850f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:00.662038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1e2eed9e-352e-499a-9bed-87ab0bf0850f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:00.662375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1e2eed9e-352e-499a-9bed-87ab0bf0850f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:00.664320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1e2eed9e-352e-499a-9bed-87ab0bf0850f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:00.664758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1e2eed9e-352e-499a-9bed-87ab0bf0850f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:00.694485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1e2eed9e-352e-499a-9bed-87ab0bf0850f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043746 Jul 14 16:03:00.695052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 883/1666] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:00 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:01.201871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9e3ad53c-d66c-4f25-9057-19f6e660bf4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:01.203064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9e3ad53c-d66c-4f25-9057-19f6e660bf4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:01.209085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e3ad53c-d66c-4f25-9057-19f6e660bf4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:01.210059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e3ad53c-d66c-4f25-9057-19f6e660bf4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:01.210921 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e3ad53c-d66c-4f25-9057-19f6e660bf4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:01.211424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e3ad53c-d66c-4f25-9057-19f6e660bf4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:01.276868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9e3ad53c-d66c-4f25-9057-19f6e660bf4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:01.284424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9e3ad53c-d66c-4f25-9057-19f6e660bf4f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086427 Jul 14 16:03:01.284997 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 784/1667] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:01 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:01.706088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-37af5c00-224e-4839-a638-11fe00d1bd8c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:01.707001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-37af5c00-224e-4839-a638-11fe00d1bd8c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:01.714354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37af5c00-224e-4839-a638-11fe00d1bd8c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:01.714812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37af5c00-224e-4839-a638-11fe00d1bd8c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:01.715554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37af5c00-224e-4839-a638-11fe00d1bd8c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:01.716049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37af5c00-224e-4839-a638-11fe00d1bd8c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:01.744978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-37af5c00-224e-4839-a638-11fe00d1bd8c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042830 Jul 14 16:03:01.745658 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 884/1668] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:01 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:02.302780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-58a21b70-2ab2-4368-a7b1-7d842015dfdf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:02.304151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-58a21b70-2ab2-4368-a7b1-7d842015dfdf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:02.311035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58a21b70-2ab2-4368-a7b1-7d842015dfdf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:02.311483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58a21b70-2ab2-4368-a7b1-7d842015dfdf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:02.312288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58a21b70-2ab2-4368-a7b1-7d842015dfdf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:02.312723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58a21b70-2ab2-4368-a7b1-7d842015dfdf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:02.377107 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-58a21b70-2ab2-4368-a7b1-7d842015dfdf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:02.384803 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-58a21b70-2ab2-4368-a7b1-7d842015dfdf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086103 Jul 14 16:03:02.385378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 785/1669] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:02 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:02.756629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-15a56cb1-6f01-4615-ac6c-8185dead21e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:02.757730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-15a56cb1-6f01-4615-ac6c-8185dead21e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:02.764417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15a56cb1-6f01-4615-ac6c-8185dead21e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:02.764872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15a56cb1-6f01-4615-ac6c-8185dead21e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:02.765633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15a56cb1-6f01-4615-ac6c-8185dead21e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:02.766123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15a56cb1-6f01-4615-ac6c-8185dead21e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:02.797679 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-15a56cb1-6f01-4615-ac6c-8185dead21e5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045171 Jul 14 16:03:02.798235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 885/1670] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:02 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:03.541388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3a33e56f-2f78-44f1-8e4a-45e8c3dda8b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:03.542006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3a33e56f-2f78-44f1-8e4a-45e8c3dda8b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:03.543896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=56 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:03.549288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3a33e56f-2f78-44f1-8e4a-45e8c3dda8b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:03.549742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3a33e56f-2f78-44f1-8e4a-45e8c3dda8b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:03.550514 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3a33e56f-2f78-44f1-8e4a-45e8c3dda8b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:03.550955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3a33e56f-2f78-44f1-8e4a-45e8c3dda8b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:03.623637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3a33e56f-2f78-44f1-8e4a-45e8c3dda8b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:03.631216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3a33e56f-2f78-44f1-8e4a-45e8c3dda8b2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.232041 Jul 14 16:03:03.632407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 786/1671] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:03 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:03.809579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-555d0de5-c254-4637-9ad0-04e3cf95b166 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:03.810421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-555d0de5-c254-4637-9ad0-04e3cf95b166 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:03.816471 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-555d0de5-c254-4637-9ad0-04e3cf95b166 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:03.816922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-555d0de5-c254-4637-9ad0-04e3cf95b166 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:03.817682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-555d0de5-c254-4637-9ad0-04e3cf95b166 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:03.818186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-555d0de5-c254-4637-9ad0-04e3cf95b166 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:03.848258 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-555d0de5-c254-4637-9ad0-04e3cf95b166 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042853 Jul 14 16:03:03.848818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 886/1672] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:03 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:04.650878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0ff4924b-2aad-453c-98d6-03dc8a29bfe2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:04.651518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0ff4924b-2aad-453c-98d6-03dc8a29bfe2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:04.659128 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0ff4924b-2aad-453c-98d6-03dc8a29bfe2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:04.659750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0ff4924b-2aad-453c-98d6-03dc8a29bfe2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:04.660507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0ff4924b-2aad-453c-98d6-03dc8a29bfe2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:04.661198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0ff4924b-2aad-453c-98d6-03dc8a29bfe2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:04.726688 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0ff4924b-2aad-453c-98d6-03dc8a29bfe2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:04.734138 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0ff4924b-2aad-453c-98d6-03dc8a29bfe2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088815 Jul 14 16:03:04.734707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 787/1673] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:04 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:04.859929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c6d85940-7a90-47ca-ab53-19773ab1b469 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:04.860850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c6d85940-7a90-47ca-ab53-19773ab1b469 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:04.867558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c6d85940-7a90-47ca-ab53-19773ab1b469 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:04.868039 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c6d85940-7a90-47ca-ab53-19773ab1b469 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:04.868804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c6d85940-7a90-47ca-ab53-19773ab1b469 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:04.869238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c6d85940-7a90-47ca-ab53-19773ab1b469 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:04.898980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c6d85940-7a90-47ca-ab53-19773ab1b469 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043072 Jul 14 16:03:04.899530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 887/1674] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:04 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:05.751140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d10bd787-b12b-4ef4-b137-62152900ef00 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:05.751784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d10bd787-b12b-4ef4-b137-62152900ef00 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:05.758983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d10bd787-b12b-4ef4-b137-62152900ef00 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:05.759432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d10bd787-b12b-4ef4-b137-62152900ef00 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:05.760221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d10bd787-b12b-4ef4-b137-62152900ef00 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:05.760661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d10bd787-b12b-4ef4-b137-62152900ef00 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:05.823935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d10bd787-b12b-4ef4-b137-62152900ef00 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:05.831372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d10bd787-b12b-4ef4-b137-62152900ef00 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084128 Jul 14 16:03:05.831965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 788/1675] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:05 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:05.909801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ee635a6b-5ba2-46d1-85dd-54c7f10506d4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:05.910727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ee635a6b-5ba2-46d1-85dd-54c7f10506d4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:05.917931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee635a6b-5ba2-46d1-85dd-54c7f10506d4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:05.918382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee635a6b-5ba2-46d1-85dd-54c7f10506d4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:05.919150 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee635a6b-5ba2-46d1-85dd-54c7f10506d4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:05.919606 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ee635a6b-5ba2-46d1-85dd-54c7f10506d4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:05.952225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ee635a6b-5ba2-46d1-85dd-54c7f10506d4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046314 Jul 14 16:03:05.952801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 888/1676] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:05 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:06.848842 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1902de4c-78dc-4990-955c-763a3973bb1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:06.849456 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1902de4c-78dc-4990-955c-763a3973bb1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:06.856967 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1902de4c-78dc-4990-955c-763a3973bb1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.857415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1902de4c-78dc-4990-955c-763a3973bb1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.858175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1902de4c-78dc-4990-955c-763a3973bb1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.858613 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1902de4c-78dc-4990-955c-763a3973bb1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.862608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:06.920565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1902de4c-78dc-4990-955c-763a3973bb1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:06.927900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1902de4c-78dc-4990-955c-763a3973bb1e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082971 Jul 14 16:03:06.929030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 789/1677] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:06 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:06.964370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-93dd04df-5b09-4d7b-a3f5-76c8941b59fa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:06.965292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-93dd04df-5b09-4d7b-a3f5-76c8941b59fa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:06.971704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93dd04df-5b09-4d7b-a3f5-76c8941b59fa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.972149 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93dd04df-5b09-4d7b-a3f5-76c8941b59fa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:06.972893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93dd04df-5b09-4d7b-a3f5-76c8941b59fa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:06.973324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93dd04df-5b09-4d7b-a3f5-76c8941b59fa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:07.003120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-93dd04df-5b09-4d7b-a3f5-76c8941b59fa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043298 Jul 14 16:03:07.003689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 889/1678] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:06 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:07.945359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6301fb31-42d0-4fab-88f0-32ff92503f6d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:07.945971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6301fb31-42d0-4fab-88f0-32ff92503f6d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:07.952455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6301fb31-42d0-4fab-88f0-32ff92503f6d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:07.952905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6301fb31-42d0-4fab-88f0-32ff92503f6d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:07.953666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6301fb31-42d0-4fab-88f0-32ff92503f6d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:07.954104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6301fb31-42d0-4fab-88f0-32ff92503f6d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:08.014648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-70d201d6-abb0-4a9f-a0cf-fcef4e11c0e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:08.015570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-70d201d6-abb0-4a9f-a0cf-fcef4e11c0e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:08.015776 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6301fb31-42d0-4fab-88f0-32ff92503f6d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:08.022793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70d201d6-abb0-4a9f-a0cf-fcef4e11c0e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:08.023804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70d201d6-abb0-4a9f-a0cf-fcef4e11c0e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:08.024273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6301fb31-42d0-4fab-88f0-32ff92503f6d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083381 Jul 14 16:03:08.024584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70d201d6-abb0-4a9f-a0cf-fcef4e11c0e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:08.024861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 790/1679] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:07 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:08.025027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70d201d6-abb0-4a9f-a0cf-fcef4e11c0e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:08.055977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-70d201d6-abb0-4a9f-a0cf-fcef4e11c0e1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045220 Jul 14 16:03:08.056534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 890/1680] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:08 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:09.042382 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3db485ae-c16e-46b1-9bac-3858f500757c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:09.043028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3db485ae-c16e-46b1-9bac-3858f500757c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:09.049539 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3db485ae-c16e-46b1-9bac-3858f500757c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.049992 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3db485ae-c16e-46b1-9bac-3858f500757c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.050754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3db485ae-c16e-46b1-9bac-3858f500757c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.051194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3db485ae-c16e-46b1-9bac-3858f500757c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.067780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-28a7b4d1-ca1d-4f7f-b21b-80e38e6239e4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:09.068682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-28a7b4d1-ca1d-4f7f-b21b-80e38e6239e4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:09.075316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28a7b4d1-ca1d-4f7f-b21b-80e38e6239e4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.075808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28a7b4d1-ca1d-4f7f-b21b-80e38e6239e4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.076600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28a7b4d1-ca1d-4f7f-b21b-80e38e6239e4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:09.077024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28a7b4d1-ca1d-4f7f-b21b-80e38e6239e4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:09.109941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-28a7b4d1-ca1d-4f7f-b21b-80e38e6239e4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046168 Jul 14 16:03:09.110510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 891/1681] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:09 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:09.120419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3db485ae-c16e-46b1-9bac-3858f500757c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:09.128078 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3db485ae-c16e-46b1-9bac-3858f500757c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090424 Jul 14 16:03:09.128641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 791/1682] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:09 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:10.122163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d830a66e-360f-4feb-8557-8a7ca4ac2260 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:10.123086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d830a66e-360f-4feb-8557-8a7ca4ac2260 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:10.129749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d830a66e-360f-4feb-8557-8a7ca4ac2260 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:10.130207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d830a66e-360f-4feb-8557-8a7ca4ac2260 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.130974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d830a66e-360f-4feb-8557-8a7ca4ac2260 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:10.132216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d830a66e-360f-4feb-8557-8a7ca4ac2260 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.145193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-29179272-5b30-46ca-b023-2682c2d0af89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:10.145872 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-29179272-5b30-46ca-b023-2682c2d0af89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:10.153237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-29179272-5b30-46ca-b023-2682c2d0af89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:10.153683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-29179272-5b30-46ca-b023-2682c2d0af89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.154460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-29179272-5b30-46ca-b023-2682c2d0af89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:10.154895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-29179272-5b30-46ca-b023-2682c2d0af89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:10.162970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d830a66e-360f-4feb-8557-8a7ca4ac2260 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044748 Jul 14 16:03:10.163825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 892/1683] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:10 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:10.218922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-29179272-5b30-46ca-b023-2682c2d0af89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:10.226578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-29179272-5b30-46ca-b023-2682c2d0af89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085223 Jul 14 16:03:10.227139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 792/1684] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:10 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:11.175003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-231de5a5-3a1c-4f61-bd7b-0165bd9e8967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:11.175976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-231de5a5-3a1c-4f61-bd7b-0165bd9e8967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:11.182567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-231de5a5-3a1c-4f61-bd7b-0165bd9e8967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.183007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-231de5a5-3a1c-4f61-bd7b-0165bd9e8967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.183803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-231de5a5-3a1c-4f61-bd7b-0165bd9e8967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.184235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-231de5a5-3a1c-4f61-bd7b-0165bd9e8967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.213701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-231de5a5-3a1c-4f61-bd7b-0165bd9e8967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042604 Jul 14 16:03:11.214252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 893/1685] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:11 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:11.243567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5b440356-dcb3-4e5b-a179-8d04c6519a43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:11.244203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5b440356-dcb3-4e5b-a179-8d04c6519a43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:11.250564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b440356-dcb3-4e5b-a179-8d04c6519a43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.251005 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b440356-dcb3-4e5b-a179-8d04c6519a43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.251792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b440356-dcb3-4e5b-a179-8d04c6519a43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:11.252229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b440356-dcb3-4e5b-a179-8d04c6519a43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:11.313897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5b440356-dcb3-4e5b-a179-8d04c6519a43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:11.322300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5b440356-dcb3-4e5b-a179-8d04c6519a43 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082655 Jul 14 16:03:11.323149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 793/1686] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:11 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:12.225899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c36d3114-4c66-4494-a06c-fed1d0d5c768 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:12.226832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c36d3114-4c66-4494-a06c-fed1d0d5c768 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:12.233787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c36d3114-4c66-4494-a06c-fed1d0d5c768 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.234237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c36d3114-4c66-4494-a06c-fed1d0d5c768 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.235020 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c36d3114-4c66-4494-a06c-fed1d0d5c768 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.235464 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c36d3114-4c66-4494-a06c-fed1d0d5c768 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.252539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:12.265912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c36d3114-4c66-4494-a06c-fed1d0d5c768 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044580 Jul 14 16:03:12.266479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 894/1687] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:12 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:12.340315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-950c3c01-eaf3-4dc0-b157-8908a191f6f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:12.340923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-950c3c01-eaf3-4dc0-b157-8908a191f6f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:12.347483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-950c3c01-eaf3-4dc0-b157-8908a191f6f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.347978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-950c3c01-eaf3-4dc0-b157-8908a191f6f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.348801 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-950c3c01-eaf3-4dc0-b157-8908a191f6f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:12.349358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-950c3c01-eaf3-4dc0-b157-8908a191f6f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:12.412001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-950c3c01-eaf3-4dc0-b157-8908a191f6f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:12.421344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-950c3c01-eaf3-4dc0-b157-8908a191f6f2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084903 Jul 14 16:03:12.421915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 794/1688] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:12 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:13.278586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2284f7a0-2b27-440b-84a9-8a4a33146e4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:13.279418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2284f7a0-2b27-440b-84a9-8a4a33146e4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:13.286202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2284f7a0-2b27-440b-84a9-8a4a33146e4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.286653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2284f7a0-2b27-440b-84a9-8a4a33146e4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.287505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2284f7a0-2b27-440b-84a9-8a4a33146e4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.287967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2284f7a0-2b27-440b-84a9-8a4a33146e4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.316809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2284f7a0-2b27-440b-84a9-8a4a33146e4e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042284 Jul 14 16:03:13.317358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 895/1689] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:13 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:13.439063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b5c34c5a-edd6-4753-9297-ace2a643cb9d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:13.439699 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b5c34c5a-edd6-4753-9297-ace2a643cb9d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:13.446946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5c34c5a-edd6-4753-9297-ace2a643cb9d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.447400 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5c34c5a-edd6-4753-9297-ace2a643cb9d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.448197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5c34c5a-edd6-4753-9297-ace2a643cb9d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:13.448634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5c34c5a-edd6-4753-9297-ace2a643cb9d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:13.515086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b5c34c5a-edd6-4753-9297-ace2a643cb9d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:13.523429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b5c34c5a-edd6-4753-9297-ace2a643cb9d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088230 Jul 14 16:03:13.524034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 795/1690] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:13 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:14.330198 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-32090322-33b5-4cd5-bfb1-d713334ca505 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:14.331042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-32090322-33b5-4cd5-bfb1-d713334ca505 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:14.338769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-32090322-33b5-4cd5-bfb1-d713334ca505 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.339226 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-32090322-33b5-4cd5-bfb1-d713334ca505 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.340055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-32090322-33b5-4cd5-bfb1-d713334ca505 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.340483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-32090322-33b5-4cd5-bfb1-d713334ca505 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.373283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-32090322-33b5-4cd5-bfb1-d713334ca505 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047517 Jul 14 16:03:14.373869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 896/1691] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:14 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:14.542747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d307b37b-7d9f-407b-8eee-5b8ffd67396b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:14.543347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d307b37b-7d9f-407b-8eee-5b8ffd67396b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:14.549977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d307b37b-7d9f-407b-8eee-5b8ffd67396b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.550419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d307b37b-7d9f-407b-8eee-5b8ffd67396b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.551185 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d307b37b-7d9f-407b-8eee-5b8ffd67396b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:14.551648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d307b37b-7d9f-407b-8eee-5b8ffd67396b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:14.618932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d307b37b-7d9f-407b-8eee-5b8ffd67396b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:14.626695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d307b37b-7d9f-407b-8eee-5b8ffd67396b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.089367 Jul 14 16:03:14.627308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 796/1692] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:14 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:15.385190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9315b16e-74fe-4535-ab80-e43f246b5c8b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:15.386023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9315b16e-74fe-4535-ab80-e43f246b5c8b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:15.392572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9315b16e-74fe-4535-ab80-e43f246b5c8b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.393012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9315b16e-74fe-4535-ab80-e43f246b5c8b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.393762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9315b16e-74fe-4535-ab80-e43f246b5c8b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.394188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9315b16e-74fe-4535-ab80-e43f246b5c8b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.424030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9315b16e-74fe-4535-ab80-e43f246b5c8b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042896 Jul 14 16:03:15.424581 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 897/1693] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:15 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:15.644188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-33f29938-1b8a-4657-9147-66e213c4746a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:15.644809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-33f29938-1b8a-4657-9147-66e213c4746a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:15.652302 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33f29938-1b8a-4657-9147-66e213c4746a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.655178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33f29938-1b8a-4657-9147-66e213c4746a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.655178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33f29938-1b8a-4657-9147-66e213c4746a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:15.655178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-33f29938-1b8a-4657-9147-66e213c4746a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:15.718400 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-33f29938-1b8a-4657-9147-66e213c4746a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:15.726955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-33f29938-1b8a-4657-9147-66e213c4746a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086564 Jul 14 16:03:15.727540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 797/1694] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:15 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:16.435587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-41850327-c3a3-4d17-a264-412fad52bb44 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:16.436528 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-41850327-c3a3-4d17-a264-412fad52bb44 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:16.442988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-41850327-c3a3-4d17-a264-412fad52bb44 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.443436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-41850327-c3a3-4d17-a264-412fad52bb44 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.444483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-41850327-c3a3-4d17-a264-412fad52bb44 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.444916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-41850327-c3a3-4d17-a264-412fad52bb44 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.473400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-41850327-c3a3-4d17-a264-412fad52bb44 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041756 Jul 14 16:03:16.473961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 898/1695] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:16 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:16.744197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0d8dcbc9-37a6-413b-8ef7-8fd0ec80121f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:16.744769 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0d8dcbc9-37a6-413b-8ef7-8fd0ec80121f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:16.751307 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d8dcbc9-37a6-413b-8ef7-8fd0ec80121f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.751796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d8dcbc9-37a6-413b-8ef7-8fd0ec80121f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.752571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d8dcbc9-37a6-413b-8ef7-8fd0ec80121f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:16.753014 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d8dcbc9-37a6-413b-8ef7-8fd0ec80121f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:16.818292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0d8dcbc9-37a6-413b-8ef7-8fd0ec80121f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:16.826142 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0d8dcbc9-37a6-413b-8ef7-8fd0ec80121f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086171 Jul 14 16:03:16.826711 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 798/1696] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:16 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:17.485827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d6659caf-60f2-405e-bccb-9f40e78704db tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:17.486794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d6659caf-60f2-405e-bccb-9f40e78704db tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:17.495761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6659caf-60f2-405e-bccb-9f40e78704db tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.496220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6659caf-60f2-405e-bccb-9f40e78704db tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.496999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6659caf-60f2-405e-bccb-9f40e78704db tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.497443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6659caf-60f2-405e-bccb-9f40e78704db tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.527991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d6659caf-60f2-405e-bccb-9f40e78704db tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046084 Jul 14 16:03:17.528568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 899/1697] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:17 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:17.844540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-04005503-1951-44ea-887f-d44e3d8ecd35 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:17.845099 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-04005503-1951-44ea-887f-d44e3d8ecd35 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:17.852133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04005503-1951-44ea-887f-d44e3d8ecd35 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.852575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04005503-1951-44ea-887f-d44e3d8ecd35 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.853857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04005503-1951-44ea-887f-d44e3d8ecd35 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:17.853857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04005503-1951-44ea-887f-d44e3d8ecd35 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:17.920739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-04005503-1951-44ea-887f-d44e3d8ecd35 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:17.928858 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-04005503-1951-44ea-887f-d44e3d8ecd35 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088418 Jul 14 16:03:17.929479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 799/1698] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:17 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:18.540538 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-48f46e5f-f114-479c-bd9e-b309e9986c06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:18.541401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-48f46e5f-f114-479c-bd9e-b309e9986c06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:18.547938 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48f46e5f-f114-479c-bd9e-b309e9986c06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:18.548389 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48f46e5f-f114-479c-bd9e-b309e9986c06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:18.549150 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48f46e5f-f114-479c-bd9e-b309e9986c06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:18.549584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48f46e5f-f114-479c-bd9e-b309e9986c06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:18.578472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-48f46e5f-f114-479c-bd9e-b309e9986c06 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042853 Jul 14 16:03:18.579048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 900/1699] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:18 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:18.946789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-617c6825-93bd-4b7a-9fa9-a566efa010d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:18.947389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-617c6825-93bd-4b7a-9fa9-a566efa010d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:18.953858 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-617c6825-93bd-4b7a-9fa9-a566efa010d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:18.954303 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-617c6825-93bd-4b7a-9fa9-a566efa010d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:18.955055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-617c6825-93bd-4b7a-9fa9-a566efa010d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:18.955488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-617c6825-93bd-4b7a-9fa9-a566efa010d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.017757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-617c6825-93bd-4b7a-9fa9-a566efa010d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:19.025591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-617c6825-93bd-4b7a-9fa9-a566efa010d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083631 Jul 14 16:03:19.026157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 800/1700] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:18 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:19.590242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e3b000a-9dea-4b8f-b165-ce1c095be186 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:19.591196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e3b000a-9dea-4b8f-b165-ce1c095be186 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:19.597740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e3b000a-9dea-4b8f-b165-ce1c095be186 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.598191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e3b000a-9dea-4b8f-b165-ce1c095be186 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.598951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e3b000a-9dea-4b8f-b165-ce1c095be186 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:19.599394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e3b000a-9dea-4b8f-b165-ce1c095be186 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:19.630004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e3b000a-9dea-4b8f-b165-ce1c095be186 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043698 Jul 14 16:03:19.630564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 901/1701] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:19 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:20.042676 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-709762bb-ba8d-4d84-ba16-c7dd06dbb06b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:20.043291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-709762bb-ba8d-4d84-ba16-c7dd06dbb06b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:20.049807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-709762bb-ba8d-4d84-ba16-c7dd06dbb06b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.050265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-709762bb-ba8d-4d84-ba16-c7dd06dbb06b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.051029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-709762bb-ba8d-4d84-ba16-c7dd06dbb06b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.051471 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-709762bb-ba8d-4d84-ba16-c7dd06dbb06b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.112134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-709762bb-ba8d-4d84-ba16-c7dd06dbb06b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:20.120187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-709762bb-ba8d-4d84-ba16-c7dd06dbb06b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081399 Jul 14 16:03:20.120758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 801/1702] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:20 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:20.512010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:03:20.512284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:03:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:03:20.640971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bd44ca1a-2cf5-42cc-b324-e1087cae38d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:20.641926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bd44ca1a-2cf5-42cc-b324-e1087cae38d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:20.648996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd44ca1a-2cf5-42cc-b324-e1087cae38d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.649447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd44ca1a-2cf5-42cc-b324-e1087cae38d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.650213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd44ca1a-2cf5-42cc-b324-e1087cae38d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:20.650765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd44ca1a-2cf5-42cc-b324-e1087cae38d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:20.680719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bd44ca1a-2cf5-42cc-b324-e1087cae38d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043604 Jul 14 16:03:20.681282 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 902/1703] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:20 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:21.137609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8611923e-976a-443d-a306-91e70b44b2e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:21.138239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8611923e-976a-443d-a306-91e70b44b2e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:21.144613 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8611923e-976a-443d-a306-91e70b44b2e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.145061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8611923e-976a-443d-a306-91e70b44b2e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.145826 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8611923e-976a-443d-a306-91e70b44b2e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.146263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8611923e-976a-443d-a306-91e70b44b2e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.208326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8611923e-976a-443d-a306-91e70b44b2e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:21.216620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8611923e-976a-443d-a306-91e70b44b2e0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082846 Jul 14 16:03:21.217122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 802/1704] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:21 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:21.692255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-901e2b06-7a72-4ef2-befa-fbf01489e7d0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:21.693173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-901e2b06-7a72-4ef2-befa-fbf01489e7d0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:21.700282 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-901e2b06-7a72-4ef2-befa-fbf01489e7d0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.700729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-901e2b06-7a72-4ef2-befa-fbf01489e7d0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.701484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-901e2b06-7a72-4ef2-befa-fbf01489e7d0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:21.701915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-901e2b06-7a72-4ef2-befa-fbf01489e7d0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:21.730845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-901e2b06-7a72-4ef2-befa-fbf01489e7d0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042557 Jul 14 16:03:21.731405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 903/1705] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:21 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:22.233717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9bde19b4-6e16-4395-bc28-e63a6e6773f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:22.234325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9bde19b4-6e16-4395-bc28-e63a6e6773f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:22.241287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9bde19b4-6e16-4395-bc28-e63a6e6773f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.241733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9bde19b4-6e16-4395-bc28-e63a6e6773f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.242492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9bde19b4-6e16-4395-bc28-e63a6e6773f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.242930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9bde19b4-6e16-4395-bc28-e63a6e6773f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.307943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9bde19b4-6e16-4395-bc28-e63a6e6773f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:22.315630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9bde19b4-6e16-4395-bc28-e63a6e6773f5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085809 Jul 14 16:03:22.316216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 803/1706] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:22 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:22.742322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-223344d3-4bfe-446a-ae29-59df7263d121 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:22.743249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-223344d3-4bfe-446a-ae29-59df7263d121 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:22.750052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-223344d3-4bfe-446a-ae29-59df7263d121 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.750500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-223344d3-4bfe-446a-ae29-59df7263d121 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.751265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-223344d3-4bfe-446a-ae29-59df7263d121 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:22.751736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-223344d3-4bfe-446a-ae29-59df7263d121 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:22.781391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-223344d3-4bfe-446a-ae29-59df7263d121 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043034 Jul 14 16:03:22.782009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 904/1707] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:22 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:23.333340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-979a561a-5d89-4a70-b995-37de87602d52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:23.333877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-979a561a-5d89-4a70-b995-37de87602d52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:23.341044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-979a561a-5d89-4a70-b995-37de87602d52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.341501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-979a561a-5d89-4a70-b995-37de87602d52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.342269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-979a561a-5d89-4a70-b995-37de87602d52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.342711 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-979a561a-5d89-4a70-b995-37de87602d52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.403787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-979a561a-5d89-4a70-b995-37de87602d52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:23.411649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-979a561a-5d89-4a70-b995-37de87602d52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081996 Jul 14 16:03:23.412385 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 804/1708] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:23 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:23.793532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-47c75638-d571-4b16-bc00-53b9b90cc51d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:23.794454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-47c75638-d571-4b16-bc00-53b9b90cc51d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:23.801293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-47c75638-d571-4b16-bc00-53b9b90cc51d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.801740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-47c75638-d571-4b16-bc00-53b9b90cc51d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.802508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-47c75638-d571-4b16-bc00-53b9b90cc51d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:23.803574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-47c75638-d571-4b16-bc00-53b9b90cc51d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:23.833448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-47c75638-d571-4b16-bc00-53b9b90cc51d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043881 Jul 14 16:03:23.834034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 905/1709] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:23 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:24.430228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e22dd59a-4572-4e5e-ada1-da3e986b8090 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:24.430896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e22dd59a-4572-4e5e-ada1-da3e986b8090 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:24.437406 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e22dd59a-4572-4e5e-ada1-da3e986b8090 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:24.437836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e22dd59a-4572-4e5e-ada1-da3e986b8090 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:24.438599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e22dd59a-4572-4e5e-ada1-da3e986b8090 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:24.439037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e22dd59a-4572-4e5e-ada1-da3e986b8090 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:24.502393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e22dd59a-4572-4e5e-ada1-da3e986b8090 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:24.505813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:24.512275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e22dd59a-4572-4e5e-ada1-da3e986b8090 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087117 Jul 14 16:03:24.512849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 805/1710] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:24 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:24.845693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dec45b09-bcdd-47a1-85f1-0e8bd70d0cde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:24.846617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dec45b09-bcdd-47a1-85f1-0e8bd70d0cde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:24.853881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dec45b09-bcdd-47a1-85f1-0e8bd70d0cde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:24.854333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dec45b09-bcdd-47a1-85f1-0e8bd70d0cde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:24.855091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dec45b09-bcdd-47a1-85f1-0e8bd70d0cde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:24.855526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dec45b09-bcdd-47a1-85f1-0e8bd70d0cde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:24.885962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dec45b09-bcdd-47a1-85f1-0e8bd70d0cde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044187 Jul 14 16:03:24.886531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 906/1711] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:24 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:25.529363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f1526722-5532-42a6-bdeb-9c23efcb81e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:25.529978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f1526722-5532-42a6-bdeb-9c23efcb81e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:25.536812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1526722-5532-42a6-bdeb-9c23efcb81e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:25.537317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1526722-5532-42a6-bdeb-9c23efcb81e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:25.538184 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1526722-5532-42a6-bdeb-9c23efcb81e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:25.538625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1526722-5532-42a6-bdeb-9c23efcb81e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:25.602474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f1526722-5532-42a6-bdeb-9c23efcb81e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:25.609967 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f1526722-5532-42a6-bdeb-9c23efcb81e1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084517 Jul 14 16:03:25.610538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 806/1712] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:25 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:25.898288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-13d2a65c-b5fd-40b6-af84-5c0f7d06dba2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:25.899235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-13d2a65c-b5fd-40b6-af84-5c0f7d06dba2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:25.905794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13d2a65c-b5fd-40b6-af84-5c0f7d06dba2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:25.906247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13d2a65c-b5fd-40b6-af84-5c0f7d06dba2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:25.907017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13d2a65c-b5fd-40b6-af84-5c0f7d06dba2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:25.907461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13d2a65c-b5fd-40b6-af84-5c0f7d06dba2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:25.937791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-13d2a65c-b5fd-40b6-af84-5c0f7d06dba2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044365 Jul 14 16:03:25.938346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 907/1713] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:25 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:26.627331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5a1c7121-61c3-43f6-b474-31e80e26dce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:26.627904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5a1c7121-61c3-43f6-b474-31e80e26dce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:26.635868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5a1c7121-61c3-43f6-b474-31e80e26dce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:26.636323 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5a1c7121-61c3-43f6-b474-31e80e26dce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:26.637088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5a1c7121-61c3-43f6-b474-31e80e26dce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:26.637526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5a1c7121-61c3-43f6-b474-31e80e26dce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:26.703054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5a1c7121-61c3-43f6-b474-31e80e26dce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:26.711289 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5a1c7121-61c3-43f6-b474-31e80e26dce8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087858 Jul 14 16:03:26.711893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 807/1714] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:26 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:26.949681 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b85189e2-85fb-4976-91cf-3c22fb0dc3ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:26.950606 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b85189e2-85fb-4976-91cf-3c22fb0dc3ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:26.957125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b85189e2-85fb-4976-91cf-3c22fb0dc3ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:26.957578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b85189e2-85fb-4976-91cf-3c22fb0dc3ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:26.958344 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b85189e2-85fb-4976-91cf-3c22fb0dc3ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:26.958782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b85189e2-85fb-4976-91cf-3c22fb0dc3ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:26.988252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b85189e2-85fb-4976-91cf-3c22fb0dc3ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042686 Jul 14 16:03:26.988812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 908/1715] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:26 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:27.728753 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-10e75fae-a17c-4b18-8ea1-e9f768888d98 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:27.729617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-10e75fae-a17c-4b18-8ea1-e9f768888d98 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:27.736006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-10e75fae-a17c-4b18-8ea1-e9f768888d98 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:27.736456 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-10e75fae-a17c-4b18-8ea1-e9f768888d98 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:27.737218 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-10e75fae-a17c-4b18-8ea1-e9f768888d98 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:27.737654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-10e75fae-a17c-4b18-8ea1-e9f768888d98 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:27.799617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-10e75fae-a17c-4b18-8ea1-e9f768888d98 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:27.807790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-10e75fae-a17c-4b18-8ea1-e9f768888d98 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083380 Jul 14 16:03:27.808352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 808/1716] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:27 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:27.999836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-26a0339c-57f0-4329-8ac8-545878a53db3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:28.000750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-26a0339c-57f0-4329-8ac8-545878a53db3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:28.002999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=58 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:28.008653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26a0339c-57f0-4329-8ac8-545878a53db3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:28.009130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26a0339c-57f0-4329-8ac8-545878a53db3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:28.009890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26a0339c-57f0-4329-8ac8-545878a53db3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:28.010322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26a0339c-57f0-4329-8ac8-545878a53db3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:28.040345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-26a0339c-57f0-4329-8ac8-545878a53db3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044314 Jul 14 16:03:28.040891 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 909/1717] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:27 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:28.824590 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5bcfa8e0-0a38-41e4-be74-1ea6899edae5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:28.825137 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5bcfa8e0-0a38-41e4-be74-1ea6899edae5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:28.831797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5bcfa8e0-0a38-41e4-be74-1ea6899edae5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:28.832262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5bcfa8e0-0a38-41e4-be74-1ea6899edae5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:28.833033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5bcfa8e0-0a38-41e4-be74-1ea6899edae5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:28.833475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5bcfa8e0-0a38-41e4-be74-1ea6899edae5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:28.861986 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:03:28.864080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:03:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 (ip 10.222.0.99) !!! Jul 14 16:03:28.897214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5bcfa8e0-0a38-41e4-be74-1ea6899edae5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:28.904965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5bcfa8e0-0a38-41e4-be74-1ea6899edae5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084289 Jul 14 16:03:28.905542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 809/1718] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:28 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:29.052430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2fd405d0-121a-45d6-a5e1-9c3ef14dc592 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:29.053700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2fd405d0-121a-45d6-a5e1-9c3ef14dc592 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:29.060299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2fd405d0-121a-45d6-a5e1-9c3ef14dc592 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:29.060745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2fd405d0-121a-45d6-a5e1-9c3ef14dc592 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:29.061526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2fd405d0-121a-45d6-a5e1-9c3ef14dc592 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:29.061956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2fd405d0-121a-45d6-a5e1-9c3ef14dc592 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:29.091748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2fd405d0-121a-45d6-a5e1-9c3ef14dc592 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043435 Jul 14 16:03:29.092231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 910/1719] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:29 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:29.922282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b8273f4f-5ad2-450c-a829-ea351949fcaf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:29.922881 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b8273f4f-5ad2-450c-a829-ea351949fcaf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:29.930051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8273f4f-5ad2-450c-a829-ea351949fcaf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:29.930494 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8273f4f-5ad2-450c-a829-ea351949fcaf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:29.931251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8273f4f-5ad2-450c-a829-ea351949fcaf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:29.931708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8273f4f-5ad2-450c-a829-ea351949fcaf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:29.994901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b8273f4f-5ad2-450c-a829-ea351949fcaf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:30.002668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b8273f4f-5ad2-450c-a829-ea351949fcaf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084219 Jul 14 16:03:30.003267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 810/1720] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:29 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:30.103814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e8f679fb-af49-4896-b90c-6293a0456009 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:30.104736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e8f679fb-af49-4896-b90c-6293a0456009 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:30.111183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e8f679fb-af49-4896-b90c-6293a0456009 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:30.111667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e8f679fb-af49-4896-b90c-6293a0456009 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:30.112426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e8f679fb-af49-4896-b90c-6293a0456009 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:30.112862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e8f679fb-af49-4896-b90c-6293a0456009 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:30.116760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:30.144964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e8f679fb-af49-4896-b90c-6293a0456009 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045486 Jul 14 16:03:30.145610 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 911/1721] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:30 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:31.020883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-815c6ebe-0afe-46e7-96f3-40c4120a748b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:31.020883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-815c6ebe-0afe-46e7-96f3-40c4120a748b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:31.027247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-815c6ebe-0afe-46e7-96f3-40c4120a748b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:31.027732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-815c6ebe-0afe-46e7-96f3-40c4120a748b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:31.028491 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-815c6ebe-0afe-46e7-96f3-40c4120a748b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:31.028928 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-815c6ebe-0afe-46e7-96f3-40c4120a748b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:31.100271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-815c6ebe-0afe-46e7-96f3-40c4120a748b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:31.107929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-815c6ebe-0afe-46e7-96f3-40c4120a748b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.091752 Jul 14 16:03:31.108500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 811/1722] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:31 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:31.157886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7f21d19f-c252-49e7-bbb2-c4ff4866b0dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:31.158830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7f21d19f-c252-49e7-bbb2-c4ff4866b0dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:31.165844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f21d19f-c252-49e7-bbb2-c4ff4866b0dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:31.166296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f21d19f-c252-49e7-bbb2-c4ff4866b0dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:31.167060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f21d19f-c252-49e7-bbb2-c4ff4866b0dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:31.167502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f21d19f-c252-49e7-bbb2-c4ff4866b0dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:31.197385 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7f21d19f-c252-49e7-bbb2-c4ff4866b0dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043489 Jul 14 16:03:31.198271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 912/1723] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:31 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:32.125938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-647c882e-cb21-4fd9-8681-63b8b6df9913 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:32.126553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-647c882e-cb21-4fd9-8681-63b8b6df9913 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:32.134131 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-647c882e-cb21-4fd9-8681-63b8b6df9913 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:32.134579 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-647c882e-cb21-4fd9-8681-63b8b6df9913 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:32.135353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-647c882e-cb21-4fd9-8681-63b8b6df9913 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:32.135923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-647c882e-cb21-4fd9-8681-63b8b6df9913 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:32.199845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-647c882e-cb21-4fd9-8681-63b8b6df9913 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:32.207571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-647c882e-cb21-4fd9-8681-63b8b6df9913 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085502 Jul 14 16:03:32.208767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 812/1724] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:32 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:32.210092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-eb0cecb6-283c-4784-81ff-c1845027f133 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:32.211191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eb0cecb6-283c-4784-81ff-c1845027f133 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:32.218240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb0cecb6-283c-4784-81ff-c1845027f133 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:32.218718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb0cecb6-283c-4784-81ff-c1845027f133 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:32.219629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb0cecb6-283c-4784-81ff-c1845027f133 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:32.220088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb0cecb6-283c-4784-81ff-c1845027f133 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:32.250345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-eb0cecb6-283c-4784-81ff-c1845027f133 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045133 Jul 14 16:03:32.250819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 913/1725] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:32 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:33.226026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-56cad134-30e7-4958-b77b-3b337dc299f0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:33.226643 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-56cad134-30e7-4958-b77b-3b337dc299f0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:33.233145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-56cad134-30e7-4958-b77b-3b337dc299f0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:33.233600 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-56cad134-30e7-4958-b77b-3b337dc299f0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:33.234365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-56cad134-30e7-4958-b77b-3b337dc299f0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:33.234817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-56cad134-30e7-4958-b77b-3b337dc299f0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:33.263813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1e44c018-aebb-4d2d-af3c-9d0e439dee80 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:33.264649 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1e44c018-aebb-4d2d-af3c-9d0e439dee80 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:33.270863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1e44c018-aebb-4d2d-af3c-9d0e439dee80 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:33.271353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1e44c018-aebb-4d2d-af3c-9d0e439dee80 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:33.272204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1e44c018-aebb-4d2d-af3c-9d0e439dee80 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:33.272640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1e44c018-aebb-4d2d-af3c-9d0e439dee80 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:33.297255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-56cad134-30e7-4958-b77b-3b337dc299f0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:33.305468 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-56cad134-30e7-4958-b77b-3b337dc299f0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083537 Jul 14 16:03:33.306048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 813/1726] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:33 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:33.310975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1e44c018-aebb-4d2d-af3c-9d0e439dee80 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050986 Jul 14 16:03:33.311992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 914/1727] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:33 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:34.324093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ba74494c-d666-4cf0-bf31-3a28a89f9c18 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:34.324646 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ba74494c-d666-4cf0-bf31-3a28a89f9c18 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:34.324984 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8794b2e7-9783-488e-8e0a-cbd1b5c5053a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:34.326360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8794b2e7-9783-488e-8e0a-cbd1b5c5053a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:34.327111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=56 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:34.332459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba74494c-d666-4cf0-bf31-3a28a89f9c18 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:34.332913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba74494c-d666-4cf0-bf31-3a28a89f9c18 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:34.333845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba74494c-d666-4cf0-bf31-3a28a89f9c18 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:34.334608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba74494c-d666-4cf0-bf31-3a28a89f9c18 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:34.336300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8794b2e7-9783-488e-8e0a-cbd1b5c5053a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:34.336955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8794b2e7-9783-488e-8e0a-cbd1b5c5053a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:34.338094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8794b2e7-9783-488e-8e0a-cbd1b5c5053a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:34.338738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8794b2e7-9783-488e-8e0a-cbd1b5c5053a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:34.383140 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8794b2e7-9783-488e-8e0a-cbd1b5c5053a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.064762 Jul 14 16:03:34.383764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 915/1728] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:34 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:34.401145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ba74494c-d666-4cf0-bf31-3a28a89f9c18 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:34.409960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ba74494c-d666-4cf0-bf31-3a28a89f9c18 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.091750 Jul 14 16:03:34.410528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 814/1729] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:34 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:35.394668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6cc6d629-0250-4407-a6c8-919ab14c0bd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:35.395589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6cc6d629-0250-4407-a6c8-919ab14c0bd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:35.403994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cc6d629-0250-4407-a6c8-919ab14c0bd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:35.404436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cc6d629-0250-4407-a6c8-919ab14c0bd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:35.405202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cc6d629-0250-4407-a6c8-919ab14c0bd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:35.405638 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6cc6d629-0250-4407-a6c8-919ab14c0bd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:35.432281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5fdeeca3-a8bf-42c5-81c0-3421207070db tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:35.432886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5fdeeca3-a8bf-42c5-81c0-3421207070db tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:35.435714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6cc6d629-0250-4407-a6c8-919ab14c0bd2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044922 Jul 14 16:03:35.436293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 916/1730] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:35 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:35.439171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5fdeeca3-a8bf-42c5-81c0-3421207070db tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:35.439637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5fdeeca3-a8bf-42c5-81c0-3421207070db tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:35.440413 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5fdeeca3-a8bf-42c5-81c0-3421207070db tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:35.440845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5fdeeca3-a8bf-42c5-81c0-3421207070db tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:35.508526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5fdeeca3-a8bf-42c5-81c0-3421207070db tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:35.516031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5fdeeca3-a8bf-42c5-81c0-3421207070db tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088036 Jul 14 16:03:35.516592 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 815/1731] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:35 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:36.446693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-eb182143-8fb2-480c-8498-d0318fb8ebd6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:36.447764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eb182143-8fb2-480c-8498-d0318fb8ebd6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:36.454451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb182143-8fb2-480c-8498-d0318fb8ebd6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:36.454900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb182143-8fb2-480c-8498-d0318fb8ebd6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:36.455696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb182143-8fb2-480c-8498-d0318fb8ebd6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:36.456131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb182143-8fb2-480c-8498-d0318fb8ebd6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:36.487081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-eb182143-8fb2-480c-8498-d0318fb8ebd6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044435 Jul 14 16:03:36.487657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 917/1732] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:36 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:36.533020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dc223892-2932-4e92-ac11-9c42c5eb617c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:36.533618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dc223892-2932-4e92-ac11-9c42c5eb617c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:36.541083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc223892-2932-4e92-ac11-9c42c5eb617c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:36.541528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc223892-2932-4e92-ac11-9c42c5eb617c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:36.542283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc223892-2932-4e92-ac11-9c42c5eb617c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:36.542718 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc223892-2932-4e92-ac11-9c42c5eb617c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:36.605592 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-dc223892-2932-4e92-ac11-9c42c5eb617c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:36.613228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dc223892-2932-4e92-ac11-9c42c5eb617c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084052 Jul 14 16:03:36.613785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 816/1733] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:36 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:37.499042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2a6f99eb-d5c2-4b8b-97fb-22aad3623972 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:37.499983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2a6f99eb-d5c2-4b8b-97fb-22aad3623972 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:37.507075 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a6f99eb-d5c2-4b8b-97fb-22aad3623972 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:37.507523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a6f99eb-d5c2-4b8b-97fb-22aad3623972 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:37.508323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a6f99eb-d5c2-4b8b-97fb-22aad3623972 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:37.508794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2a6f99eb-d5c2-4b8b-97fb-22aad3623972 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:37.539787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2a6f99eb-d5c2-4b8b-97fb-22aad3623972 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044650 Jul 14 16:03:37.540358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 918/1734] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:37 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:37.630318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d0b542f3-f0ba-4d54-9d20-47a02dfdd9f9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:37.631199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d0b542f3-f0ba-4d54-9d20-47a02dfdd9f9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:37.637974 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d0b542f3-f0ba-4d54-9d20-47a02dfdd9f9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:37.638424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d0b542f3-f0ba-4d54-9d20-47a02dfdd9f9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:37.639190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d0b542f3-f0ba-4d54-9d20-47a02dfdd9f9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:37.639649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d0b542f3-f0ba-4d54-9d20-47a02dfdd9f9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:37.702085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d0b542f3-f0ba-4d54-9d20-47a02dfdd9f9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:37.710305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d0b542f3-f0ba-4d54-9d20-47a02dfdd9f9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083991 Jul 14 16:03:37.710877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 817/1735] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:37 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:38.550614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a1b58528-2f1e-49e6-a39e-7cb1ac20b07e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:38.551549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a1b58528-2f1e-49e6-a39e-7cb1ac20b07e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:38.558721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1b58528-2f1e-49e6-a39e-7cb1ac20b07e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:38.559172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1b58528-2f1e-49e6-a39e-7cb1ac20b07e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:38.559977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1b58528-2f1e-49e6-a39e-7cb1ac20b07e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:38.560421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1b58528-2f1e-49e6-a39e-7cb1ac20b07e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:38.590228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a1b58528-2f1e-49e6-a39e-7cb1ac20b07e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043601 Jul 14 16:03:38.590790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 919/1736] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:38 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:38.726667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-98dd7397-71e1-4150-a891-69a34c2e0767 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:38.727335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-98dd7397-71e1-4150-a891-69a34c2e0767 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:38.733987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-98dd7397-71e1-4150-a891-69a34c2e0767 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:38.734436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-98dd7397-71e1-4150-a891-69a34c2e0767 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:38.735227 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-98dd7397-71e1-4150-a891-69a34c2e0767 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:38.735686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-98dd7397-71e1-4150-a891-69a34c2e0767 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:38.799799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-98dd7397-71e1-4150-a891-69a34c2e0767 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:38.808782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-98dd7397-71e1-4150-a891-69a34c2e0767 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086183 Jul 14 16:03:38.809285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 818/1737] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:38 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:39.602969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4848ab93-1913-4970-8811-b2532d5aa586 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:39.603832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4848ab93-1913-4970-8811-b2532d5aa586 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:39.610287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4848ab93-1913-4970-8811-b2532d5aa586 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:39.610733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4848ab93-1913-4970-8811-b2532d5aa586 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:39.611487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4848ab93-1913-4970-8811-b2532d5aa586 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:39.611945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4848ab93-1913-4970-8811-b2532d5aa586 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:39.641370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4848ab93-1913-4970-8811-b2532d5aa586 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043245 Jul 14 16:03:39.641925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 920/1738] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:39 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:39.826010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c1f263be-881b-47e6-a48b-cc070a7e4bca tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:39.826625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c1f263be-881b-47e6-a48b-cc070a7e4bca tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:39.833183 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1f263be-881b-47e6-a48b-cc070a7e4bca tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:39.833637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1f263be-881b-47e6-a48b-cc070a7e4bca tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:39.835731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1f263be-881b-47e6-a48b-cc070a7e4bca tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:39.836175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1f263be-881b-47e6-a48b-cc070a7e4bca tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:39.902752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c1f263be-881b-47e6-a48b-cc070a7e4bca tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:39.910429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c1f263be-881b-47e6-a48b-cc070a7e4bca tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088359 Jul 14 16:03:39.911001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 819/1739] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:39 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:40.652367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c97c1d8a-11ab-47cd-a41d-7078ec14f9fc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:40.653293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c97c1d8a-11ab-47cd-a41d-7078ec14f9fc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:40.660034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c97c1d8a-11ab-47cd-a41d-7078ec14f9fc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:40.660483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c97c1d8a-11ab-47cd-a41d-7078ec14f9fc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:40.661246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c97c1d8a-11ab-47cd-a41d-7078ec14f9fc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:40.662446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c97c1d8a-11ab-47cd-a41d-7078ec14f9fc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:40.692071 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c97c1d8a-11ab-47cd-a41d-7078ec14f9fc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043597 Jul 14 16:03:40.692625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 921/1740] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:40 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:40.928572 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0a4e0913-89b0-4958-88fb-bcf6eb31f16e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:40.929119 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0a4e0913-89b0-4958-88fb-bcf6eb31f16e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:40.935256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a4e0913-89b0-4958-88fb-bcf6eb31f16e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:40.935742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a4e0913-89b0-4958-88fb-bcf6eb31f16e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:40.936498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a4e0913-89b0-4958-88fb-bcf6eb31f16e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:40.936932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a4e0913-89b0-4958-88fb-bcf6eb31f16e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:41.000292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0a4e0913-89b0-4958-88fb-bcf6eb31f16e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:41.008027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0a4e0913-89b0-4958-88fb-bcf6eb31f16e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084007 Jul 14 16:03:41.008589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 820/1741] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:40 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:41.704761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e21e9a75-52aa-4bb6-bba8-3111df35345c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:41.705808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e21e9a75-52aa-4bb6-bba8-3111df35345c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:41.713856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e21e9a75-52aa-4bb6-bba8-3111df35345c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:41.714301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e21e9a75-52aa-4bb6-bba8-3111df35345c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:41.715068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e21e9a75-52aa-4bb6-bba8-3111df35345c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:41.715562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e21e9a75-52aa-4bb6-bba8-3111df35345c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:41.747130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e21e9a75-52aa-4bb6-bba8-3111df35345c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046977 Jul 14 16:03:41.747744 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 922/1742] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:41 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:42.024937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5ca14fe5-5948-43df-ade7-d70a47a44ba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:42.025622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5ca14fe5-5948-43df-ade7-d70a47a44ba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:42.032384 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ca14fe5-5948-43df-ade7-d70a47a44ba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:42.032851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ca14fe5-5948-43df-ade7-d70a47a44ba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:42.033676 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ca14fe5-5948-43df-ade7-d70a47a44ba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:42.034144 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ca14fe5-5948-43df-ade7-d70a47a44ba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:42.100902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5ca14fe5-5948-43df-ade7-d70a47a44ba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:42.111334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5ca14fe5-5948-43df-ade7-d70a47a44ba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090087 Jul 14 16:03:42.112354 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 821/1743] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:42 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:42.762481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a0043fc7-f0b6-4e33-aff7-5d9b4b325033 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:42.763414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a0043fc7-f0b6-4e33-aff7-5d9b4b325033 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:42.770153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0043fc7-f0b6-4e33-aff7-5d9b4b325033 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:42.770600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0043fc7-f0b6-4e33-aff7-5d9b4b325033 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:42.771474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0043fc7-f0b6-4e33-aff7-5d9b4b325033 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:42.773065 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0043fc7-f0b6-4e33-aff7-5d9b4b325033 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:42.805504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a0043fc7-f0b6-4e33-aff7-5d9b4b325033 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049071 Jul 14 16:03:42.806089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 923/1744] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:42 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:43.131835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-062f054a-1bdd-4305-8e82-26e655d04e9a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:43.133154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-062f054a-1bdd-4305-8e82-26e655d04e9a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:43.143835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-062f054a-1bdd-4305-8e82-26e655d04e9a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:43.144304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-062f054a-1bdd-4305-8e82-26e655d04e9a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:43.145094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-062f054a-1bdd-4305-8e82-26e655d04e9a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:43.145534 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-062f054a-1bdd-4305-8e82-26e655d04e9a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:43.164273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:43.215397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-062f054a-1bdd-4305-8e82-26e655d04e9a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:43.223191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-062f054a-1bdd-4305-8e82-26e655d04e9a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.097515 Jul 14 16:03:43.223790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 822/1745] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:43 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:43.818448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-180e7af2-d106-455c-8f7a-7bc2a22d011f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:43.819902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-180e7af2-d106-455c-8f7a-7bc2a22d011f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:43.826542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-180e7af2-d106-455c-8f7a-7bc2a22d011f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:43.826990 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-180e7af2-d106-455c-8f7a-7bc2a22d011f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:43.827790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-180e7af2-d106-455c-8f7a-7bc2a22d011f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:43.828226 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-180e7af2-d106-455c-8f7a-7bc2a22d011f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:43.858763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-180e7af2-d106-455c-8f7a-7bc2a22d011f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044851 Jul 14 16:03:43.859329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 924/1746] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:43 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:44.241470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3dcb5941-a2d5-473a-a127-720b0f84d50f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:44.242084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3dcb5941-a2d5-473a-a127-720b0f84d50f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:44.248651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3dcb5941-a2d5-473a-a127-720b0f84d50f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:44.249108 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3dcb5941-a2d5-473a-a127-720b0f84d50f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:44.249871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3dcb5941-a2d5-473a-a127-720b0f84d50f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:44.250303 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3dcb5941-a2d5-473a-a127-720b0f84d50f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:44.316813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3dcb5941-a2d5-473a-a127-720b0f84d50f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:44.325542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3dcb5941-a2d5-473a-a127-720b0f84d50f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.089051 Jul 14 16:03:44.326130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 823/1747] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:44 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:44.870570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c2230f64-51d8-477c-808b-ffd3ac5a963a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:44.871486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c2230f64-51d8-477c-808b-ffd3ac5a963a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:44.878281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c2230f64-51d8-477c-808b-ffd3ac5a963a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:44.878724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c2230f64-51d8-477c-808b-ffd3ac5a963a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:44.879484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c2230f64-51d8-477c-808b-ffd3ac5a963a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:44.879944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c2230f64-51d8-477c-808b-ffd3ac5a963a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:44.909490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c2230f64-51d8-477c-808b-ffd3ac5a963a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042836 Jul 14 16:03:44.910085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 925/1748] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:44 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:45.343057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f34c6f3a-6fd6-4982-93b2-9f02a1d086fc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:45.343706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f34c6f3a-6fd6-4982-93b2-9f02a1d086fc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:45.352196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f34c6f3a-6fd6-4982-93b2-9f02a1d086fc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:45.352675 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f34c6f3a-6fd6-4982-93b2-9f02a1d086fc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:45.353503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f34c6f3a-6fd6-4982-93b2-9f02a1d086fc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:45.353949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f34c6f3a-6fd6-4982-93b2-9f02a1d086fc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:45.423059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f34c6f3a-6fd6-4982-93b2-9f02a1d086fc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:45.433146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f34c6f3a-6fd6-4982-93b2-9f02a1d086fc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.093951 Jul 14 16:03:45.433891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 824/1749] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:45 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:45.922558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4ba75b57-1c24-4867-afb7-eee41523affd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:45.923613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4ba75b57-1c24-4867-afb7-eee41523affd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:45.930995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ba75b57-1c24-4867-afb7-eee41523affd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:45.931498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ba75b57-1c24-4867-afb7-eee41523affd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:45.932340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ba75b57-1c24-4867-afb7-eee41523affd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:45.932776 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ba75b57-1c24-4867-afb7-eee41523affd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:45.964857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4ba75b57-1c24-4867-afb7-eee41523affd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046275 Jul 14 16:03:45.965435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 926/1750] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:45 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:46.451308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-104aed43-f099-41bd-99ae-45b94e43fd76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:46.452000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-104aed43-f099-41bd-99ae-45b94e43fd76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:46.458843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-104aed43-f099-41bd-99ae-45b94e43fd76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:46.459291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-104aed43-f099-41bd-99ae-45b94e43fd76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:46.460091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-104aed43-f099-41bd-99ae-45b94e43fd76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:46.460538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-104aed43-f099-41bd-99ae-45b94e43fd76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:46.528288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-104aed43-f099-41bd-99ae-45b94e43fd76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:46.536212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-104aed43-f099-41bd-99ae-45b94e43fd76 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088769 Jul 14 16:03:46.537085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 825/1751] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:46 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:46.978479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-acadd430-1358-46f6-ad23-9a9dea31e47c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:46.979406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-acadd430-1358-46f6-ad23-9a9dea31e47c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:46.986293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acadd430-1358-46f6-ad23-9a9dea31e47c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:46.986752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acadd430-1358-46f6-ad23-9a9dea31e47c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:46.987532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acadd430-1358-46f6-ad23-9a9dea31e47c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:46.988103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acadd430-1358-46f6-ad23-9a9dea31e47c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:47.015652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:47.021519 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-acadd430-1358-46f6-ad23-9a9dea31e47c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047272 Jul 14 16:03:47.022700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 927/1752] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:46 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:47.555350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0750a0d6-2ee9-44c5-a364-504a266182b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:47.555984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0750a0d6-2ee9-44c5-a364-504a266182b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:47.562484 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0750a0d6-2ee9-44c5-a364-504a266182b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:47.562941 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0750a0d6-2ee9-44c5-a364-504a266182b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:47.563724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0750a0d6-2ee9-44c5-a364-504a266182b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:47.564163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0750a0d6-2ee9-44c5-a364-504a266182b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:47.627853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0750a0d6-2ee9-44c5-a364-504a266182b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:47.637063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0750a0d6-2ee9-44c5-a364-504a266182b9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086909 Jul 14 16:03:47.637639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 826/1753] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:47 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:48.033928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a0418537-7cdd-4300-b948-f24312dcd492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:48.034999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a0418537-7cdd-4300-b948-f24312dcd492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:48.042801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0418537-7cdd-4300-b948-f24312dcd492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:48.043251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0418537-7cdd-4300-b948-f24312dcd492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:48.044042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0418537-7cdd-4300-b948-f24312dcd492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:48.044479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a0418537-7cdd-4300-b948-f24312dcd492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:48.073906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a0418537-7cdd-4300-b948-f24312dcd492 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043959 Jul 14 16:03:48.074454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 928/1754] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:48 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:48.656587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4cf656e5-61c6-482a-8626-98a8b2803544 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:48.657191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4cf656e5-61c6-482a-8626-98a8b2803544 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:48.664979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4cf656e5-61c6-482a-8626-98a8b2803544 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:48.665436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4cf656e5-61c6-482a-8626-98a8b2803544 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:48.666207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4cf656e5-61c6-482a-8626-98a8b2803544 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:48.666650 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4cf656e5-61c6-482a-8626-98a8b2803544 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:48.735286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4cf656e5-61c6-482a-8626-98a8b2803544 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:48.743451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4cf656e5-61c6-482a-8626-98a8b2803544 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090345 Jul 14 16:03:48.744175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 827/1755] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:48 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:49.086264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-871e395b-ec30-4a55-ab38-7b18e296c1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:49.087302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-871e395b-ec30-4a55-ab38-7b18e296c1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:49.094068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-871e395b-ec30-4a55-ab38-7b18e296c1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:49.094596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-871e395b-ec30-4a55-ab38-7b18e296c1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:49.095373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-871e395b-ec30-4a55-ab38-7b18e296c1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:49.095848 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-871e395b-ec30-4a55-ab38-7b18e296c1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:49.126415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-871e395b-ec30-4a55-ab38-7b18e296c1ec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044715 Jul 14 16:03:49.126971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 929/1756] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:49 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:49.760549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b71f31ee-7c26-43a7-9fda-94d555201c67 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:49.761161 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b71f31ee-7c26-43a7-9fda-94d555201c67 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:49.767719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b71f31ee-7c26-43a7-9fda-94d555201c67 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:49.768172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b71f31ee-7c26-43a7-9fda-94d555201c67 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:49.768934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b71f31ee-7c26-43a7-9fda-94d555201c67 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:49.769371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b71f31ee-7c26-43a7-9fda-94d555201c67 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:49.832330 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b71f31ee-7c26-43a7-9fda-94d555201c67 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:49.840979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b71f31ee-7c26-43a7-9fda-94d555201c67 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084249 Jul 14 16:03:49.841651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 828/1757] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:49 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:50.137815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-62aa936f-bdf5-4679-af5e-260b4728fea7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:50.138779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-62aa936f-bdf5-4679-af5e-260b4728fea7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:50.145499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62aa936f-bdf5-4679-af5e-260b4728fea7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:50.146782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62aa936f-bdf5-4679-af5e-260b4728fea7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:50.147998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62aa936f-bdf5-4679-af5e-260b4728fea7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:50.148435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62aa936f-bdf5-4679-af5e-260b4728fea7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:50.177406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-62aa936f-bdf5-4679-af5e-260b4728fea7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043631 Jul 14 16:03:50.177964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 930/1758] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:50 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:50.858988 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1893b637-7c14-4c40-b790-0143329fbc32 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:50.859616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1893b637-7c14-4c40-b790-0143329fbc32 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:50.867535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1893b637-7c14-4c40-b790-0143329fbc32 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:50.868025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1893b637-7c14-4c40-b790-0143329fbc32 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:50.868815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1893b637-7c14-4c40-b790-0143329fbc32 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:50.869240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1893b637-7c14-4c40-b790-0143329fbc32 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:50.932993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1893b637-7c14-4c40-b790-0143329fbc32 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:50.940595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1893b637-7c14-4c40-b790-0143329fbc32 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085712 Jul 14 16:03:50.941159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 829/1759] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:50 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:51.189388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9bdbe771-100d-43a3-a3d7-687797ac6bf0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:51.190314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9bdbe771-100d-43a3-a3d7-687797ac6bf0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:51.198396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9bdbe771-100d-43a3-a3d7-687797ac6bf0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:51.198857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9bdbe771-100d-43a3-a3d7-687797ac6bf0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:51.199640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9bdbe771-100d-43a3-a3d7-687797ac6bf0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:51.200081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9bdbe771-100d-43a3-a3d7-687797ac6bf0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:51.230845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9bdbe771-100d-43a3-a3d7-687797ac6bf0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045420 Jul 14 16:03:51.231412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 931/1760] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:51 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:51.958091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-07d44be1-ec02-4b98-8131-74f0360d3ca8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:51.959289 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-07d44be1-ec02-4b98-8131-74f0360d3ca8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:51.965772 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07d44be1-ec02-4b98-8131-74f0360d3ca8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:51.966225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07d44be1-ec02-4b98-8131-74f0360d3ca8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:51.966993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07d44be1-ec02-4b98-8131-74f0360d3ca8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:51.967432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07d44be1-ec02-4b98-8131-74f0360d3ca8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:52.030511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-07d44be1-ec02-4b98-8131-74f0360d3ca8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:52.039188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-07d44be1-ec02-4b98-8131-74f0360d3ca8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085019 Jul 14 16:03:52.039777 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 830/1761] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:51 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:52.243550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a85d9f3c-0eba-4fcd-b7af-e626f1322646 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:52.244501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a85d9f3c-0eba-4fcd-b7af-e626f1322646 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:52.250948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a85d9f3c-0eba-4fcd-b7af-e626f1322646 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:52.251392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a85d9f3c-0eba-4fcd-b7af-e626f1322646 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:52.252186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a85d9f3c-0eba-4fcd-b7af-e626f1322646 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:52.252619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a85d9f3c-0eba-4fcd-b7af-e626f1322646 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:52.281607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a85d9f3c-0eba-4fcd-b7af-e626f1322646 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042082 Jul 14 16:03:52.282166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 932/1762] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:52 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:53.057964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d20848c7-679e-4cf9-b4f8-9c02601f770d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:53.058776 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d20848c7-679e-4cf9-b4f8-9c02601f770d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:53.065928 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d20848c7-679e-4cf9-b4f8-9c02601f770d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:53.066374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d20848c7-679e-4cf9-b4f8-9c02601f770d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:53.067210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d20848c7-679e-4cf9-b4f8-9c02601f770d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:53.068434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d20848c7-679e-4cf9-b4f8-9c02601f770d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:53.139203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d20848c7-679e-4cf9-b4f8-9c02601f770d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:53.146953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d20848c7-679e-4cf9-b4f8-9c02601f770d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.094584 Jul 14 16:03:53.147564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 831/1763] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:53 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:53.293112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ad6e5d90-c30f-4536-9417-91c563bd5dec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:53.294057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ad6e5d90-c30f-4536-9417-91c563bd5dec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:53.300612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad6e5d90-c30f-4536-9417-91c563bd5dec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:53.301068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad6e5d90-c30f-4536-9417-91c563bd5dec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:53.301878 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad6e5d90-c30f-4536-9417-91c563bd5dec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:53.302873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad6e5d90-c30f-4536-9417-91c563bd5dec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:53.333492 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ad6e5d90-c30f-4536-9417-91c563bd5dec tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044233 Jul 14 16:03:53.334167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 933/1764] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:53 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:54.164792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-08a7ce9a-baf5-4f06-a21a-0149a81a9d38 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:54.165391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-08a7ce9a-baf5-4f06-a21a-0149a81a9d38 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:54.172082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-08a7ce9a-baf5-4f06-a21a-0149a81a9d38 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:54.172534 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-08a7ce9a-baf5-4f06-a21a-0149a81a9d38 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:54.173297 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-08a7ce9a-baf5-4f06-a21a-0149a81a9d38 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:54.173739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-08a7ce9a-baf5-4f06-a21a-0149a81a9d38 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:54.236045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-08a7ce9a-baf5-4f06-a21a-0149a81a9d38 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:54.245060 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-08a7ce9a-baf5-4f06-a21a-0149a81a9d38 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084880 Jul 14 16:03:54.245632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 832/1765] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:54 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:54.345522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-79839713-d3ca-4a18-8c99-dc97395f4959 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:54.346356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-79839713-d3ca-4a18-8c99-dc97395f4959 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:54.353784 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79839713-d3ca-4a18-8c99-dc97395f4959 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:54.354234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79839713-d3ca-4a18-8c99-dc97395f4959 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:54.354999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79839713-d3ca-4a18-8c99-dc97395f4959 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:54.355436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79839713-d3ca-4a18-8c99-dc97395f4959 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:54.387304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-79839713-d3ca-4a18-8c99-dc97395f4959 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045934 Jul 14 16:03:54.387897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 934/1766] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:54 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:55.262101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-656371af-5469-4b13-a387-f10b8b60e137 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:55.262659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-656371af-5469-4b13-a387-f10b8b60e137 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:55.269183 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-656371af-5469-4b13-a387-f10b8b60e137 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:55.269822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-656371af-5469-4b13-a387-f10b8b60e137 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:55.270524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-656371af-5469-4b13-a387-f10b8b60e137 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:55.271463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-656371af-5469-4b13-a387-f10b8b60e137 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:55.335947 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-656371af-5469-4b13-a387-f10b8b60e137 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:55.343525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-656371af-5469-4b13-a387-f10b8b60e137 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085451 Jul 14 16:03:55.344118 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 833/1767] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:55 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:55.400158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-38655988-2354-4e9a-8fb8-8ab466cabff0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:55.401082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-38655988-2354-4e9a-8fb8-8ab466cabff0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:55.407933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38655988-2354-4e9a-8fb8-8ab466cabff0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:55.408377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38655988-2354-4e9a-8fb8-8ab466cabff0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:55.409236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38655988-2354-4e9a-8fb8-8ab466cabff0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:55.409669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38655988-2354-4e9a-8fb8-8ab466cabff0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:55.439572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-38655988-2354-4e9a-8fb8-8ab466cabff0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044205 Jul 14 16:03:55.440161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 935/1768] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:55 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:56.361350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-263dcdcd-fd61-498a-87ad-9781d14e6157 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:56.362098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-263dcdcd-fd61-498a-87ad-9781d14e6157 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:56.369479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-263dcdcd-fd61-498a-87ad-9781d14e6157 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:56.369924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-263dcdcd-fd61-498a-87ad-9781d14e6157 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:56.370702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-263dcdcd-fd61-498a-87ad-9781d14e6157 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:56.371139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-263dcdcd-fd61-498a-87ad-9781d14e6157 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:56.436718 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-263dcdcd-fd61-498a-87ad-9781d14e6157 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:56.445098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-263dcdcd-fd61-498a-87ad-9781d14e6157 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087797 Jul 14 16:03:56.445689 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 834/1769] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:56 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:56.453151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e722f455-1458-4d4f-bed6-d79d25594cf7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:56.454101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e722f455-1458-4d4f-bed6-d79d25594cf7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:56.462380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e722f455-1458-4d4f-bed6-d79d25594cf7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:56.462831 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e722f455-1458-4d4f-bed6-d79d25594cf7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:56.463626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e722f455-1458-4d4f-bed6-d79d25594cf7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:56.464084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e722f455-1458-4d4f-bed6-d79d25594cf7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:56.496034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e722f455-1458-4d4f-bed6-d79d25594cf7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046782 Jul 14 16:03:56.496619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 936/1770] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:56 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:57.462957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0212870d-a66c-4496-a1dd-bc95945d244c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:57.463556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0212870d-a66c-4496-a1dd-bc95945d244c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:57.469562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0212870d-a66c-4496-a1dd-bc95945d244c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.470046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0212870d-a66c-4496-a1dd-bc95945d244c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.470812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0212870d-a66c-4496-a1dd-bc95945d244c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.471253 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0212870d-a66c-4496-a1dd-bc95945d244c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.508567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ad0a8f4e-9762-4516-9ecb-405cbc1fcc27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:57.509525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ad0a8f4e-9762-4516-9ecb-405cbc1fcc27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:57.516073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad0a8f4e-9762-4516-9ecb-405cbc1fcc27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.516525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad0a8f4e-9762-4516-9ecb-405cbc1fcc27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.517297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad0a8f4e-9762-4516-9ecb-405cbc1fcc27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:57.517733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad0a8f4e-9762-4516-9ecb-405cbc1fcc27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:57.536416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0212870d-a66c-4496-a1dd-bc95945d244c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:57.549112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ad0a8f4e-9762-4516-9ecb-405cbc1fcc27 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045727 Jul 14 16:03:57.549875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 937/1771] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:57 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:57.550204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0212870d-a66c-4496-a1dd-bc95945d244c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.091635 Jul 14 16:03:57.550787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 835/1772] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:57 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:03:58.561429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a24c9176-715a-4d36-b4cd-dbe9a52b64d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:58.562354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a24c9176-715a-4d36-b4cd-dbe9a52b64d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:58.564949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=58 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:03:58.568819 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4fc86b0d-ca08-4fc8-acaf-10875ca91415 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:58.569643 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4fc86b0d-ca08-4fc8-acaf-10875ca91415 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:58.571183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a24c9176-715a-4d36-b4cd-dbe9a52b64d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:58.571654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a24c9176-715a-4d36-b4cd-dbe9a52b64d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:58.572420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a24c9176-715a-4d36-b4cd-dbe9a52b64d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:58.572857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a24c9176-715a-4d36-b4cd-dbe9a52b64d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:58.576232 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4fc86b0d-ca08-4fc8-acaf-10875ca91415 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:58.577611 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4fc86b0d-ca08-4fc8-acaf-10875ca91415 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:58.577611 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4fc86b0d-ca08-4fc8-acaf-10875ca91415 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:58.578028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4fc86b0d-ca08-4fc8-acaf-10875ca91415 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:58.606599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a24c9176-715a-4d36-b4cd-dbe9a52b64d1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049300 Jul 14 16:03:58.607556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 938/1773] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:58 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:03:58.649333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4fc86b0d-ca08-4fc8-acaf-10875ca91415 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:58.656888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4fc86b0d-ca08-4fc8-acaf-10875ca91415 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.093485 Jul 14 16:03:58.657459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 836/1774] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:58 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:03:59.617965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-868b9386-7fba-4797-aa0b-5660cb7f1115 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:59.618882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-868b9386-7fba-4797-aa0b-5660cb7f1115 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:59.625333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-868b9386-7fba-4797-aa0b-5660cb7f1115 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:59.625777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-868b9386-7fba-4797-aa0b-5660cb7f1115 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:59.626526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-868b9386-7fba-4797-aa0b-5660cb7f1115 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:59.626958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-868b9386-7fba-4797-aa0b-5660cb7f1115 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:59.656960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-868b9386-7fba-4797-aa0b-5660cb7f1115 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043000 Jul 14 16:03:59.657517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 939/1775] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:03:59 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:03:59.674077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6b465278-b444-4364-a3d3-2c92b1f23706 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:03:59.674713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6b465278-b444-4364-a3d3-2c92b1f23706 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:03:59.681333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b465278-b444-4364-a3d3-2c92b1f23706 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:59.681779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b465278-b444-4364-a3d3-2c92b1f23706 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:59.682542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b465278-b444-4364-a3d3-2c92b1f23706 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:03:59.682974 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b465278-b444-4364-a3d3-2c92b1f23706 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:03:59.746848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6b465278-b444-4364-a3d3-2c92b1f23706 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:03:59.754446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6b465278-b444-4364-a3d3-2c92b1f23706 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084153 Jul 14 16:03:59.755038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 837/1776] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:03:59 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:00.668626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4be7cce3-9494-4a2a-96ca-b90a97975f93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:00.669552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4be7cce3-9494-4a2a-96ca-b90a97975f93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:00.676063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4be7cce3-9494-4a2a-96ca-b90a97975f93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:00.676514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4be7cce3-9494-4a2a-96ca-b90a97975f93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:00.677962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4be7cce3-9494-4a2a-96ca-b90a97975f93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:00.678469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4be7cce3-9494-4a2a-96ca-b90a97975f93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:00.707509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4be7cce3-9494-4a2a-96ca-b90a97975f93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042812 Jul 14 16:04:00.708112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 940/1777] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:04:00 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:00.771330 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0f982721-e495-4091-bfb4-6e90b9ad2bfd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:00.771983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0f982721-e495-4091-bfb4-6e90b9ad2bfd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:00.778468 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0f982721-e495-4091-bfb4-6e90b9ad2bfd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:00.778924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0f982721-e495-4091-bfb4-6e90b9ad2bfd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:00.779725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0f982721-e495-4091-bfb4-6e90b9ad2bfd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:00.780172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0f982721-e495-4091-bfb4-6e90b9ad2bfd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:00.842502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0f982721-e495-4091-bfb4-6e90b9ad2bfd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:00.850904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0f982721-e495-4091-bfb4-6e90b9ad2bfd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083419 Jul 14 16:04:00.851477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 838/1778] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:00 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:01.719753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2680187f-9aaa-4308-bf59-5018d5909e3d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:01.720666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2680187f-9aaa-4308-bf59-5018d5909e3d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:01.728139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2680187f-9aaa-4308-bf59-5018d5909e3d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:01.728596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2680187f-9aaa-4308-bf59-5018d5909e3d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:01.729438 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2680187f-9aaa-4308-bf59-5018d5909e3d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:01.729876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2680187f-9aaa-4308-bf59-5018d5909e3d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:01.759219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2680187f-9aaa-4308-bf59-5018d5909e3d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043414 Jul 14 16:04:01.759813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 941/1779] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:04:01 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:01.867363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f6698f3a-890f-4795-91e2-2c9028dafb84 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:01.868004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f6698f3a-890f-4795-91e2-2c9028dafb84 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:01.874572 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f6698f3a-890f-4795-91e2-2c9028dafb84 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:01.875024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f6698f3a-890f-4795-91e2-2c9028dafb84 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:01.875825 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f6698f3a-890f-4795-91e2-2c9028dafb84 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:01.876272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f6698f3a-890f-4795-91e2-2c9028dafb84 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:01.880156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:01.944721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f6698f3a-890f-4795-91e2-2c9028dafb84 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:01.952777 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f6698f3a-890f-4795-91e2-2c9028dafb84 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.089480 Jul 14 16:04:01.953355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 839/1780] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:01 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:02.770530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4c8c4bb1-4bd2-4812-8701-c770ac9a0328 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:02.771636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4c8c4bb1-4bd2-4812-8701-c770ac9a0328 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:02.778106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4c8c4bb1-4bd2-4812-8701-c770ac9a0328 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:02.778554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4c8c4bb1-4bd2-4812-8701-c770ac9a0328 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:02.779310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4c8c4bb1-4bd2-4812-8701-c770ac9a0328 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:02.779777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4c8c4bb1-4bd2-4812-8701-c770ac9a0328 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:02.812456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4c8c4bb1-4bd2-4812-8701-c770ac9a0328 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045865 Jul 14 16:04:02.813030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 942/1781] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:04:02 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:04:02.971005 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-eaa0a77c-75fd-4eb3-8519-618a27adc4ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:02.971692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-eaa0a77c-75fd-4eb3-8519-618a27adc4ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:02.979204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eaa0a77c-75fd-4eb3-8519-618a27adc4ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:02.979686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eaa0a77c-75fd-4eb3-8519-618a27adc4ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:02.980450 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eaa0a77c-75fd-4eb3-8519-618a27adc4ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:02.980883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eaa0a77c-75fd-4eb3-8519-618a27adc4ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:03.044694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-eaa0a77c-75fd-4eb3-8519-618a27adc4ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:03.053418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-eaa0a77c-75fd-4eb3-8519-618a27adc4ef tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085729 Jul 14 16:04:03.054032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 840/1782] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:02 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:03.824689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e67625e5-ea72-4bf9-874c-215bb808537e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Action: 'action', calling method: >, body: {"os-getConsoleOutput": {}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:04:03.825601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e67625e5-ea72-4bf9-874c-215bb808537e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:03.831843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e67625e5-ea72-4bf9-874c-215bb808537e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:03.832297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e67625e5-ea72-4bf9-874c-215bb808537e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:03.833128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e67625e5-ea72-4bf9-874c-215bb808537e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:03.834090 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e67625e5-ea72-4bf9-874c-215bb808537e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:03.927579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e67625e5-ea72-4bf9-874c-215bb808537e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "POST /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/action" status: 200 len: 76619 microversion: 2.1 time: 0.106758 Jul 14 16:04:03.928285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 943/1783] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 16:04:03 2022] POST /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86/action => generated 76619 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:04:04.070482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3edfbc48-5047-426a-b0ad-e4140360e78f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:04.071132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3edfbc48-5047-426a-b0ad-e4140360e78f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:04.077522 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3edfbc48-5047-426a-b0ad-e4140360e78f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:04.078094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3edfbc48-5047-426a-b0ad-e4140360e78f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:04.078651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3edfbc48-5047-426a-b0ad-e4140360e78f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:04.079104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3edfbc48-5047-426a-b0ad-e4140360e78f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:04.150612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3edfbc48-5047-426a-b0ad-e4140360e78f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:04.158495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3edfbc48-5047-426a-b0ad-e4140360e78f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.092634 Jul 14 16:04:04.159095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 841/1784] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:04 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:05.176115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9afff011-9cc2-4ed8-a6d4-426c1e49cfe3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:05.176822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9afff011-9cc2-4ed8-a6d4-426c1e49cfe3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:05.184119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9afff011-9cc2-4ed8-a6d4-426c1e49cfe3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:05.184573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9afff011-9cc2-4ed8-a6d4-426c1e49cfe3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:05.185342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9afff011-9cc2-4ed8-a6d4-426c1e49cfe3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:05.185778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9afff011-9cc2-4ed8-a6d4-426c1e49cfe3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:05.252418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9afff011-9cc2-4ed8-a6d4-426c1e49cfe3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:05.257289 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:05.262350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9afff011-9cc2-4ed8-a6d4-426c1e49cfe3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090488 Jul 14 16:04:05.262919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 944/1785] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:05 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:06.279993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cbc6f5c9-7801-474b-9552-9a5893552893 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:06.280609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cbc6f5c9-7801-474b-9552-9a5893552893 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:06.282915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=56 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:06.290069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cbc6f5c9-7801-474b-9552-9a5893552893 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:06.290518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cbc6f5c9-7801-474b-9552-9a5893552893 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:06.291286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cbc6f5c9-7801-474b-9552-9a5893552893 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:06.291768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cbc6f5c9-7801-474b-9552-9a5893552893 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:06.354409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cbc6f5c9-7801-474b-9552-9a5893552893 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:06.361847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cbc6f5c9-7801-474b-9552-9a5893552893 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085726 Jul 14 16:04:06.362404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 842/1786] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:06 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:07.378616 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4addb884-42cb-4492-b4e0-ed370d27a781 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:07.380017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4addb884-42cb-4492-b4e0-ed370d27a781 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:07.387496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4addb884-42cb-4492-b4e0-ed370d27a781 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:07.388043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4addb884-42cb-4492-b4e0-ed370d27a781 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:07.388805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4addb884-42cb-4492-b4e0-ed370d27a781 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:07.389239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4addb884-42cb-4492-b4e0-ed370d27a781 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:07.457609 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4addb884-42cb-4492-b4e0-ed370d27a781 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:07.478383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4addb884-42cb-4492-b4e0-ed370d27a781 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.103841 Jul 14 16:04:07.479014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 945/1787] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:07 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:07.530012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6c4e7a54-e1a6-4f84-9ff7-61e865ee1d8b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:07.530593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6c4e7a54-e1a6-4f84-9ff7-61e865ee1d8b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:07.538299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c4e7a54-e1a6-4f84-9ff7-61e865ee1d8b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:07.538759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c4e7a54-e1a6-4f84-9ff7-61e865ee1d8b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:07.539553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c4e7a54-e1a6-4f84-9ff7-61e865ee1d8b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:07.540030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c4e7a54-e1a6-4f84-9ff7-61e865ee1d8b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:07.568345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6c4e7a54-e1a6-4f84-9ff7-61e865ee1d8b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:04:07.631895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6c4e7a54-e1a6-4f84-9ff7-61e865ee1d8b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [b48851c6-dbfd-41b0-8993-0bb7cc36d21b] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 16:04:08.494725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c3daa349-408e-459f-be5a-b4f9f7f24841 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:08.495337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c3daa349-408e-459f-be5a-b4f9f7f24841 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:08.501919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3daa349-408e-459f-be5a-b4f9f7f24841 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:08.502302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3daa349-408e-459f-be5a-b4f9f7f24841 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:08.503058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3daa349-408e-459f-be5a-b4f9f7f24841 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:08.503494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3daa349-408e-459f-be5a-b4f9f7f24841 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:08.565319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c3daa349-408e-459f-be5a-b4f9f7f24841 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:08.572985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c3daa349-408e-459f-be5a-b4f9f7f24841 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082169 Jul 14 16:04:08.573550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 946/1788] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:08 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:08.638587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [None req-6c4e7a54-e1a6-4f84-9ff7-61e865ee1d8b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [b48851c6-dbfd-41b0-8993-0bb7cc36d21b] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 44270. Jul 14 16:04:08.664661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6c4e7a54-e1a6-4f84-9ff7-61e865ee1d8b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 204 len: 0 microversion: 2.20 time: 1.138530 Jul 14 16:04:08.665853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 843/1789] 10.222.0.99 () {60 vars in 1279 bytes} [Thu Jul 14 16:04:07 2022] DELETE /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 0 bytes in 1140 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jul 14 16:04:08.676096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fda8e9af-3959-40c0-a442-c62ed05c3eb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:08.676715 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fda8e9af-3959-40c0-a442-c62ed05c3eb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:08.682923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fda8e9af-3959-40c0-a442-c62ed05c3eb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:08.683377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fda8e9af-3959-40c0-a442-c62ed05c3eb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:08.684181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fda8e9af-3959-40c0-a442-c62ed05c3eb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:08.684619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fda8e9af-3959-40c0-a442-c62ed05c3eb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:08.815570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fda8e9af-3959-40c0-a442-c62ed05c3eb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:08.824707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fda8e9af-3959-40c0-a442-c62ed05c3eb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:08.826189 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fda8e9af-3959-40c0-a442-c62ed05c3eb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:08.827346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fda8e9af-3959-40c0-a442-c62ed05c3eb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156964 Jul 14 16:04:08.827946 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 947/1790] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:08 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:09.590543 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e8a239bd-56fb-492e-a4d5-ebf62b32a44e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:09.591277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e8a239bd-56fb-492e-a4d5-ebf62b32a44e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:09.601452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e8a239bd-56fb-492e-a4d5-ebf62b32a44e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:09.601903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e8a239bd-56fb-492e-a4d5-ebf62b32a44e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:09.602656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e8a239bd-56fb-492e-a4d5-ebf62b32a44e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:09.603091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e8a239bd-56fb-492e-a4d5-ebf62b32a44e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:09.669214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e8a239bd-56fb-492e-a4d5-ebf62b32a44e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:09.676686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e8a239bd-56fb-492e-a4d5-ebf62b32a44e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090412 Jul 14 16:04:09.677735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 844/1791] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:09 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:09.846857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c571785a-bffc-4d07-8797-5784f59b0522 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:09.848160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c571785a-bffc-4d07-8797-5784f59b0522 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:09.855284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c571785a-bffc-4d07-8797-5784f59b0522 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:09.855790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c571785a-bffc-4d07-8797-5784f59b0522 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:09.856545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c571785a-bffc-4d07-8797-5784f59b0522 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:09.856982 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c571785a-bffc-4d07-8797-5784f59b0522 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:09.989789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c571785a-bffc-4d07-8797-5784f59b0522 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:09.998903 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c571785a-bffc-4d07-8797-5784f59b0522 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:10.000422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c571785a-bffc-4d07-8797-5784f59b0522 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:10.001586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c571785a-bffc-4d07-8797-5784f59b0522 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158699 Jul 14 16:04:10.002151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 948/1792] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:09 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:10.694361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b39edc0a-3d6f-4198-adce-2d2a6bf0aba8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:10.694969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b39edc0a-3d6f-4198-adce-2d2a6bf0aba8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:10.701203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b39edc0a-3d6f-4198-adce-2d2a6bf0aba8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:10.701641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b39edc0a-3d6f-4198-adce-2d2a6bf0aba8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:10.702388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b39edc0a-3d6f-4198-adce-2d2a6bf0aba8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:10.702820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b39edc0a-3d6f-4198-adce-2d2a6bf0aba8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:10.763539 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b39edc0a-3d6f-4198-adce-2d2a6bf0aba8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:10.772562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b39edc0a-3d6f-4198-adce-2d2a6bf0aba8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082090 Jul 14 16:04:10.773160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 845/1793] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:10 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:11.019386 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bd9f088d-6183-4985-a293-24322623a507 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:11.020152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bd9f088d-6183-4985-a293-24322623a507 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:11.026955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd9f088d-6183-4985-a293-24322623a507 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:11.027402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd9f088d-6183-4985-a293-24322623a507 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:11.028196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd9f088d-6183-4985-a293-24322623a507 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:11.028632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd9f088d-6183-4985-a293-24322623a507 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:11.155754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd9f088d-6183-4985-a293-24322623a507 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:11.165399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd9f088d-6183-4985-a293-24322623a507 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:11.166888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd9f088d-6183-4985-a293-24322623a507 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:11.168082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bd9f088d-6183-4985-a293-24322623a507 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.152634 Jul 14 16:04:11.168642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 949/1794] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:11 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:11.600210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:04:11.600797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:04:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:04:11.790036 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c8e36554-f241-4973-86a0-d4b48d4bc1d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:11.790648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c8e36554-f241-4973-86a0-d4b48d4bc1d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:11.797152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c8e36554-f241-4973-86a0-d4b48d4bc1d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:11.797600 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c8e36554-f241-4973-86a0-d4b48d4bc1d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:11.798366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c8e36554-f241-4973-86a0-d4b48d4bc1d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:11.798808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c8e36554-f241-4973-86a0-d4b48d4bc1d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:11.863053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c8e36554-f241-4973-86a0-d4b48d4bc1d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:11.870692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c8e36554-f241-4973-86a0-d4b48d4bc1d4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085108 Jul 14 16:04:11.871256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 846/1795] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:11 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:12.186442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1a500bfc-a205-49d5-af46-9c8e0e657a10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:12.187087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1a500bfc-a205-49d5-af46-9c8e0e657a10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:12.193910 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a500bfc-a205-49d5-af46-9c8e0e657a10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:12.194348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a500bfc-a205-49d5-af46-9c8e0e657a10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:12.195103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a500bfc-a205-49d5-af46-9c8e0e657a10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:12.195534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a500bfc-a205-49d5-af46-9c8e0e657a10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:12.326776 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1a500bfc-a205-49d5-af46-9c8e0e657a10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:12.337211 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1a500bfc-a205-49d5-af46-9c8e0e657a10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:12.338793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1a500bfc-a205-49d5-af46-9c8e0e657a10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:12.339993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1a500bfc-a205-49d5-af46-9c8e0e657a10 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.157448 Jul 14 16:04:12.340547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 950/1796] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:12 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:12.888037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-91b9522b-a067-42bf-9064-980883b0cbf7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:12.888633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-91b9522b-a067-42bf-9064-980883b0cbf7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:12.894960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91b9522b-a067-42bf-9064-980883b0cbf7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:12.895578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91b9522b-a067-42bf-9064-980883b0cbf7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:12.896365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91b9522b-a067-42bf-9064-980883b0cbf7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:12.896914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91b9522b-a067-42bf-9064-980883b0cbf7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:12.958554 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-91b9522b-a067-42bf-9064-980883b0cbf7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:12.966019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-91b9522b-a067-42bf-9064-980883b0cbf7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081913 Jul 14 16:04:12.966581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 847/1797] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:12 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:13.359575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-09c275c4-5e96-4a37-b330-ca3b7c63965a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:13.360377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-09c275c4-5e96-4a37-b330-ca3b7c63965a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:13.367259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-09c275c4-5e96-4a37-b330-ca3b7c63965a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:13.367745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-09c275c4-5e96-4a37-b330-ca3b7c63965a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:13.368512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-09c275c4-5e96-4a37-b330-ca3b7c63965a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:13.368949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-09c275c4-5e96-4a37-b330-ca3b7c63965a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:13.499291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-09c275c4-5e96-4a37-b330-ca3b7c63965a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:13.508299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-09c275c4-5e96-4a37-b330-ca3b7c63965a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:13.509788 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-09c275c4-5e96-4a37-b330-ca3b7c63965a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:13.510944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-09c275c4-5e96-4a37-b330-ca3b7c63965a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.155626 Jul 14 16:04:13.511501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 951/1798] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:13 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:13.983663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2be78cba-667a-4d35-a416-141fb01cc881 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:13.984224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2be78cba-667a-4d35-a416-141fb01cc881 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:13.991419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2be78cba-667a-4d35-a416-141fb01cc881 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:13.991888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2be78cba-667a-4d35-a416-141fb01cc881 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:13.992693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2be78cba-667a-4d35-a416-141fb01cc881 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:13.993115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2be78cba-667a-4d35-a416-141fb01cc881 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:14.062492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2be78cba-667a-4d35-a416-141fb01cc881 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:14.071003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2be78cba-667a-4d35-a416-141fb01cc881 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.091365 Jul 14 16:04:14.071573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 848/1799] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:13 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:14.530144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e284b343-9653-41dd-8dbc-c8f72addb434 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:14.530693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e284b343-9653-41dd-8dbc-c8f72addb434 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:14.537928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e284b343-9653-41dd-8dbc-c8f72addb434 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:14.538378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e284b343-9653-41dd-8dbc-c8f72addb434 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:14.539131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e284b343-9653-41dd-8dbc-c8f72addb434 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:14.539566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e284b343-9653-41dd-8dbc-c8f72addb434 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:14.674073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e284b343-9653-41dd-8dbc-c8f72addb434 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:14.683699 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e284b343-9653-41dd-8dbc-c8f72addb434 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:14.685194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e284b343-9653-41dd-8dbc-c8f72addb434 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:14.686367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e284b343-9653-41dd-8dbc-c8f72addb434 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.160223 Jul 14 16:04:14.686920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 952/1800] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:14 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:15.088116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-35768111-4a8d-46f1-b7f5-6187673dc389 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:15.088724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-35768111-4a8d-46f1-b7f5-6187673dc389 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:15.095186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35768111-4a8d-46f1-b7f5-6187673dc389 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:15.095658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35768111-4a8d-46f1-b7f5-6187673dc389 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:15.096414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35768111-4a8d-46f1-b7f5-6187673dc389 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:15.096847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35768111-4a8d-46f1-b7f5-6187673dc389 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:15.157924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-35768111-4a8d-46f1-b7f5-6187673dc389 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:15.166254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-35768111-4a8d-46f1-b7f5-6187673dc389 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082129 Jul 14 16:04:15.166816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 849/1801] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:15 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:15.705439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-37cf63b6-713d-49fb-88c4-9e805d31cbf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:15.706085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-37cf63b6-713d-49fb-88c4-9e805d31cbf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:15.713370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37cf63b6-713d-49fb-88c4-9e805d31cbf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:15.713817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37cf63b6-713d-49fb-88c4-9e805d31cbf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:15.714574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37cf63b6-713d-49fb-88c4-9e805d31cbf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:15.715011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37cf63b6-713d-49fb-88c4-9e805d31cbf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:15.842930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37cf63b6-713d-49fb-88c4-9e805d31cbf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:15.851309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37cf63b6-713d-49fb-88c4-9e805d31cbf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:15.852949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37cf63b6-713d-49fb-88c4-9e805d31cbf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:15.854110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-37cf63b6-713d-49fb-88c4-9e805d31cbf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.152618 Jul 14 16:04:15.854671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 953/1802] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:15 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:16.183618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-df7a44b2-4ab6-423c-bd6f-2c1b65524fc3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:16.184286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-df7a44b2-4ab6-423c-bd6f-2c1b65524fc3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:16.190814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-df7a44b2-4ab6-423c-bd6f-2c1b65524fc3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:16.191266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-df7a44b2-4ab6-423c-bd6f-2c1b65524fc3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:16.192742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-df7a44b2-4ab6-423c-bd6f-2c1b65524fc3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:16.193292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-df7a44b2-4ab6-423c-bd6f-2c1b65524fc3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:16.258610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-df7a44b2-4ab6-423c-bd6f-2c1b65524fc3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:16.267201 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-df7a44b2-4ab6-423c-bd6f-2c1b65524fc3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087427 Jul 14 16:04:16.267809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 850/1803] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:16 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:16.872596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2de9066a-f5f2-4785-8588-82c3c2c15f40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:16.873236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2de9066a-f5f2-4785-8588-82c3c2c15f40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:16.880318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2de9066a-f5f2-4785-8588-82c3c2c15f40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:16.880794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2de9066a-f5f2-4785-8588-82c3c2c15f40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:16.881554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2de9066a-f5f2-4785-8588-82c3c2c15f40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:16.881993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2de9066a-f5f2-4785-8588-82c3c2c15f40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:17.012029 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2de9066a-f5f2-4785-8588-82c3c2c15f40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:17.021125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2de9066a-f5f2-4785-8588-82c3c2c15f40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:17.022635 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2de9066a-f5f2-4785-8588-82c3c2c15f40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:17.023834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2de9066a-f5f2-4785-8588-82c3c2c15f40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.155138 Jul 14 16:04:17.024396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 954/1804] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:16 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:17.283952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-00c2aa67-5aa4-4b91-9021-0b70b1f00a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:17.284567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-00c2aa67-5aa4-4b91-9021-0b70b1f00a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:17.291514 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-00c2aa67-5aa4-4b91-9021-0b70b1f00a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:17.291988 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-00c2aa67-5aa4-4b91-9021-0b70b1f00a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:17.292742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-00c2aa67-5aa4-4b91-9021-0b70b1f00a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:17.293175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-00c2aa67-5aa4-4b91-9021-0b70b1f00a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:17.354349 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-00c2aa67-5aa4-4b91-9021-0b70b1f00a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:17.361875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-00c2aa67-5aa4-4b91-9021-0b70b1f00a0f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081713 Jul 14 16:04:17.362437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 851/1805] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:17 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:18.042695 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b0f479f2-1227-44e8-ae81-a0718de4eee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:18.043303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b0f479f2-1227-44e8-ae81-a0718de4eee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:18.049845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0f479f2-1227-44e8-ae81-a0718de4eee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:18.050289 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0f479f2-1227-44e8-ae81-a0718de4eee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:18.051033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0f479f2-1227-44e8-ae81-a0718de4eee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:18.051463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0f479f2-1227-44e8-ae81-a0718de4eee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:18.197928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0f479f2-1227-44e8-ae81-a0718de4eee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:18.208853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0f479f2-1227-44e8-ae81-a0718de4eee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:18.210407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0f479f2-1227-44e8-ae81-a0718de4eee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:18.211626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b0f479f2-1227-44e8-ae81-a0718de4eee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.173080 Jul 14 16:04:18.212203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 955/1806] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:18 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:18.379027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cb2a21c7-4138-446a-a3c3-e811b4f75191 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:18.380318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cb2a21c7-4138-446a-a3c3-e811b4f75191 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:18.387051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb2a21c7-4138-446a-a3c3-e811b4f75191 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:18.387495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb2a21c7-4138-446a-a3c3-e811b4f75191 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:18.388285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb2a21c7-4138-446a-a3c3-e811b4f75191 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:18.388723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb2a21c7-4138-446a-a3c3-e811b4f75191 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:18.458412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cb2a21c7-4138-446a-a3c3-e811b4f75191 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:18.466022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cb2a21c7-4138-446a-a3c3-e811b4f75191 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090940 Jul 14 16:04:18.466603 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 852/1807] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:18 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:19.230259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b02171c0-fef2-4da4-a6a0-ca5408534e9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:19.230840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b02171c0-fef2-4da4-a6a0-ca5408534e9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:19.237417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b02171c0-fef2-4da4-a6a0-ca5408534e9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:19.237862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b02171c0-fef2-4da4-a6a0-ca5408534e9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:19.238610 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b02171c0-fef2-4da4-a6a0-ca5408534e9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:19.239570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b02171c0-fef2-4da4-a6a0-ca5408534e9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:19.372637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b02171c0-fef2-4da4-a6a0-ca5408534e9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:19.387284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b02171c0-fef2-4da4-a6a0-ca5408534e9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:19.390183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b02171c0-fef2-4da4-a6a0-ca5408534e9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:19.392371 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b02171c0-fef2-4da4-a6a0-ca5408534e9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.165672 Jul 14 16:04:19.393422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 956/1808] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:19 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:19.484919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5ab9fb18-db45-4b6c-ba23-f9da6d33412a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:19.485532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5ab9fb18-db45-4b6c-ba23-f9da6d33412a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:19.493026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ab9fb18-db45-4b6c-ba23-f9da6d33412a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:19.493471 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ab9fb18-db45-4b6c-ba23-f9da6d33412a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:19.494233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ab9fb18-db45-4b6c-ba23-f9da6d33412a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:19.494668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ab9fb18-db45-4b6c-ba23-f9da6d33412a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:19.561476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5ab9fb18-db45-4b6c-ba23-f9da6d33412a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:19.569413 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5ab9fb18-db45-4b6c-ba23-f9da6d33412a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088322 Jul 14 16:04:19.569906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 853/1809] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:19 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:20.411211 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5aeb88c8-9d79-4906-a2c8-e28ec099ffbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:20.412901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5aeb88c8-9d79-4906-a2c8-e28ec099ffbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:20.418939 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5aeb88c8-9d79-4906-a2c8-e28ec099ffbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:20.419382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5aeb88c8-9d79-4906-a2c8-e28ec099ffbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:20.420179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5aeb88c8-9d79-4906-a2c8-e28ec099ffbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:20.420608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5aeb88c8-9d79-4906-a2c8-e28ec099ffbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:20.586604 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f7787a17-0e72-4290-888a-8a309de5d582 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:20.587202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f7787a17-0e72-4290-888a-8a309de5d582 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:20.594240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7787a17-0e72-4290-888a-8a309de5d582 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:20.594685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7787a17-0e72-4290-888a-8a309de5d582 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:20.595457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7787a17-0e72-4290-888a-8a309de5d582 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:20.595930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7787a17-0e72-4290-888a-8a309de5d582 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:20.600759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:20.666978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f7787a17-0e72-4290-888a-8a309de5d582 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:20.675077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f7787a17-0e72-4290-888a-8a309de5d582 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.092604 Jul 14 16:04:20.675997 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 854/1810] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:20 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:20.819297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5aeb88c8-9d79-4906-a2c8-e28ec099ffbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:20.827764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5aeb88c8-9d79-4906-a2c8-e28ec099ffbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:20.829253 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5aeb88c8-9d79-4906-a2c8-e28ec099ffbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:20.830402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5aeb88c8-9d79-4906-a2c8-e28ec099ffbc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.423135 Jul 14 16:04:20.830959 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 957/1811] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:21.697644 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-566a7623-66f2-41e3-abff-6c92ceb2c0f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:21.698249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-566a7623-66f2-41e3-abff-6c92ceb2c0f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:21.704839 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-566a7623-66f2-41e3-abff-6c92ceb2c0f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:21.705294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-566a7623-66f2-41e3-abff-6c92ceb2c0f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:21.706062 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-566a7623-66f2-41e3-abff-6c92ceb2c0f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:21.706506 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-566a7623-66f2-41e3-abff-6c92ceb2c0f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:21.768580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-566a7623-66f2-41e3-abff-6c92ceb2c0f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:21.776971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-566a7623-66f2-41e3-abff-6c92ceb2c0f4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083280 Jul 14 16:04:21.777542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 855/1812] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:21 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:21.849116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9d36a094-12fb-4d1e-be98-a48b2d91f972 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:21.849737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9d36a094-12fb-4d1e-be98-a48b2d91f972 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:21.856241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d36a094-12fb-4d1e-be98-a48b2d91f972 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:21.856684 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d36a094-12fb-4d1e-be98-a48b2d91f972 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:21.857434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d36a094-12fb-4d1e-be98-a48b2d91f972 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:21.857862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9d36a094-12fb-4d1e-be98-a48b2d91f972 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:21.993543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9d36a094-12fb-4d1e-be98-a48b2d91f972 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:22.002010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9d36a094-12fb-4d1e-be98-a48b2d91f972 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:22.003513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9d36a094-12fb-4d1e-be98-a48b2d91f972 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:22.004845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9d36a094-12fb-4d1e-be98-a48b2d91f972 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.160116 Jul 14 16:04:22.005399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 958/1813] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:21 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:22.795235 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f4494566-55bc-43ad-871c-a06bc3db89cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:22.795901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f4494566-55bc-43ad-871c-a06bc3db89cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:22.803149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4494566-55bc-43ad-871c-a06bc3db89cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:22.803661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4494566-55bc-43ad-871c-a06bc3db89cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:22.804437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4494566-55bc-43ad-871c-a06bc3db89cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:22.804881 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4494566-55bc-43ad-871c-a06bc3db89cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:22.870109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f4494566-55bc-43ad-871c-a06bc3db89cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:22.877822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f4494566-55bc-43ad-871c-a06bc3db89cf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086524 Jul 14 16:04:22.878388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 856/1814] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:22 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:23.022373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d03cde1b-eec6-4b92-a14e-c32e0c4c2226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:23.022981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d03cde1b-eec6-4b92-a14e-c32e0c4c2226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:23.029532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d03cde1b-eec6-4b92-a14e-c32e0c4c2226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:23.029983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d03cde1b-eec6-4b92-a14e-c32e0c4c2226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:23.030749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d03cde1b-eec6-4b92-a14e-c32e0c4c2226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:23.031184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d03cde1b-eec6-4b92-a14e-c32e0c4c2226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:23.310708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d03cde1b-eec6-4b92-a14e-c32e0c4c2226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:23.319457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d03cde1b-eec6-4b92-a14e-c32e0c4c2226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:23.320968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d03cde1b-eec6-4b92-a14e-c32e0c4c2226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:23.322145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d03cde1b-eec6-4b92-a14e-c32e0c4c2226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.303814 Jul 14 16:04:23.322705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 959/1815] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:23 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:23.895434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-566c7598-d6ff-4d41-a61c-64889e2a7aec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:23.896348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-566c7598-d6ff-4d41-a61c-64889e2a7aec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:23.902946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-566c7598-d6ff-4d41-a61c-64889e2a7aec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:23.903397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-566c7598-d6ff-4d41-a61c-64889e2a7aec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:23.904199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-566c7598-d6ff-4d41-a61c-64889e2a7aec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:23.904635 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-566c7598-d6ff-4d41-a61c-64889e2a7aec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:23.969395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-566c7598-d6ff-4d41-a61c-64889e2a7aec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:23.977519 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-566c7598-d6ff-4d41-a61c-64889e2a7aec tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086165 Jul 14 16:04:23.978094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 857/1816] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:23 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:24.341258 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d727e9ac-7643-4441-a4e0-a27df0f40fdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:24.341859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d727e9ac-7643-4441-a4e0-a27df0f40fdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:24.349988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d727e9ac-7643-4441-a4e0-a27df0f40fdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:24.350450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d727e9ac-7643-4441-a4e0-a27df0f40fdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:24.351212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d727e9ac-7643-4441-a4e0-a27df0f40fdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:24.351672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d727e9ac-7643-4441-a4e0-a27df0f40fdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:24.485179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d727e9ac-7643-4441-a4e0-a27df0f40fdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:24.494213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d727e9ac-7643-4441-a4e0-a27df0f40fdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:24.495853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d727e9ac-7643-4441-a4e0-a27df0f40fdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:24.497013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d727e9ac-7643-4441-a4e0-a27df0f40fdb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.159666 Jul 14 16:04:24.497557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 960/1817] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:24 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:24.994557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d5579d87-02de-4db3-85d4-8a080d07776f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:24.995168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d5579d87-02de-4db3-85d4-8a080d07776f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:25.001743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d5579d87-02de-4db3-85d4-8a080d07776f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:25.002150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d5579d87-02de-4db3-85d4-8a080d07776f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:25.002909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d5579d87-02de-4db3-85d4-8a080d07776f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:25.003374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d5579d87-02de-4db3-85d4-8a080d07776f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:25.075885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d5579d87-02de-4db3-85d4-8a080d07776f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:25.084464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d5579d87-02de-4db3-85d4-8a080d07776f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.093593 Jul 14 16:04:25.085473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 858/1818] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:24 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:25.515569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d2a8ac68-c94d-4c6e-920f-cc0d08d4af82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:25.516276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d2a8ac68-c94d-4c6e-920f-cc0d08d4af82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:25.523486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2a8ac68-c94d-4c6e-920f-cc0d08d4af82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:25.523957 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2a8ac68-c94d-4c6e-920f-cc0d08d4af82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:25.524716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2a8ac68-c94d-4c6e-920f-cc0d08d4af82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:25.525176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2a8ac68-c94d-4c6e-920f-cc0d08d4af82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:25.543734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:25.655024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d2a8ac68-c94d-4c6e-920f-cc0d08d4af82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:25.664039 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d2a8ac68-c94d-4c6e-920f-cc0d08d4af82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:25.665527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d2a8ac68-c94d-4c6e-920f-cc0d08d4af82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:25.666777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d2a8ac68-c94d-4c6e-920f-cc0d08d4af82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.155082 Jul 14 16:04:25.667319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 961/1819] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:25 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:26.103159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-83ce9a2a-3519-46f1-843b-408de51ec57a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:26.103825 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-83ce9a2a-3519-46f1-843b-408de51ec57a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:26.110540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83ce9a2a-3519-46f1-843b-408de51ec57a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:26.111237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83ce9a2a-3519-46f1-843b-408de51ec57a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:26.112060 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83ce9a2a-3519-46f1-843b-408de51ec57a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:26.112504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83ce9a2a-3519-46f1-843b-408de51ec57a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:26.175376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-83ce9a2a-3519-46f1-843b-408de51ec57a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:26.183858 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-83ce9a2a-3519-46f1-843b-408de51ec57a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084663 Jul 14 16:04:26.184476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 859/1820] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:26 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:26.685320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-00122f40-f68f-4afa-ae87-fec1e31b7d1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:26.685920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-00122f40-f68f-4afa-ae87-fec1e31b7d1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:26.692592 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-00122f40-f68f-4afa-ae87-fec1e31b7d1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:26.693038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-00122f40-f68f-4afa-ae87-fec1e31b7d1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:26.693951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-00122f40-f68f-4afa-ae87-fec1e31b7d1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:26.694383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-00122f40-f68f-4afa-ae87-fec1e31b7d1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:26.827335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-00122f40-f68f-4afa-ae87-fec1e31b7d1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:26.837442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-00122f40-f68f-4afa-ae87-fec1e31b7d1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:26.838940 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-00122f40-f68f-4afa-ae87-fec1e31b7d1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:26.840154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-00122f40-f68f-4afa-ae87-fec1e31b7d1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158791 Jul 14 16:04:26.840725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 962/1821] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:26 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:27.201168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0116a348-5c84-4756-9116-48727978f887 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:27.201759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0116a348-5c84-4756-9116-48727978f887 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:27.209652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0116a348-5c84-4756-9116-48727978f887 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:27.210099 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0116a348-5c84-4756-9116-48727978f887 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:27.210869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0116a348-5c84-4756-9116-48727978f887 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:27.211307 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0116a348-5c84-4756-9116-48727978f887 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:27.276171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0116a348-5c84-4756-9116-48727978f887 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:27.283950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0116a348-5c84-4756-9116-48727978f887 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086625 Jul 14 16:04:27.284525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 860/1822] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:27 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:27.859648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-669d7c79-bbb6-439c-a0f1-a193655a659b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:27.860263 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-669d7c79-bbb6-439c-a0f1-a193655a659b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:27.868410 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-669d7c79-bbb6-439c-a0f1-a193655a659b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:27.868859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-669d7c79-bbb6-439c-a0f1-a193655a659b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:27.869617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-669d7c79-bbb6-439c-a0f1-a193655a659b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:27.870052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-669d7c79-bbb6-439c-a0f1-a193655a659b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:28.000933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-669d7c79-bbb6-439c-a0f1-a193655a659b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:28.009411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-669d7c79-bbb6-439c-a0f1-a193655a659b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:28.010897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-669d7c79-bbb6-439c-a0f1-a193655a659b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:28.012086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-669d7c79-bbb6-439c-a0f1-a193655a659b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156406 Jul 14 16:04:28.012634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 963/1823] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:28.301886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ccb1512b-2efd-4fed-b778-003a3de68a0d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:28.302495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ccb1512b-2efd-4fed-b778-003a3de68a0d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:28.309163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ccb1512b-2efd-4fed-b778-003a3de68a0d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:28.309614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ccb1512b-2efd-4fed-b778-003a3de68a0d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:28.310430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ccb1512b-2efd-4fed-b778-003a3de68a0d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:28.310883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ccb1512b-2efd-4fed-b778-003a3de68a0d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:28.373777 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ccb1512b-2efd-4fed-b778-003a3de68a0d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:28.382469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ccb1512b-2efd-4fed-b778-003a3de68a0d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084566 Jul 14 16:04:28.383044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 861/1824] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:28 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:29.030469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-735e1d00-c96f-4774-95a5-6bb26113eeb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:29.031087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-735e1d00-c96f-4774-95a5-6bb26113eeb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:29.033500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=52 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:29.040781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-735e1d00-c96f-4774-95a5-6bb26113eeb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:29.041234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-735e1d00-c96f-4774-95a5-6bb26113eeb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:29.042013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-735e1d00-c96f-4774-95a5-6bb26113eeb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:29.042458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-735e1d00-c96f-4774-95a5-6bb26113eeb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:29.185082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-735e1d00-c96f-4774-95a5-6bb26113eeb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:29.193935 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-735e1d00-c96f-4774-95a5-6bb26113eeb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:29.195440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-735e1d00-c96f-4774-95a5-6bb26113eeb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:29.196665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-735e1d00-c96f-4774-95a5-6bb26113eeb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.170171 Jul 14 16:04:29.197234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 964/1825] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:29 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:29.400642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-436a9e57-ffa0-43b3-8bc8-6769db4ebd33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:29.401273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-436a9e57-ffa0-43b3-8bc8-6769db4ebd33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:29.407888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-436a9e57-ffa0-43b3-8bc8-6769db4ebd33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:29.408339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-436a9e57-ffa0-43b3-8bc8-6769db4ebd33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:29.409100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-436a9e57-ffa0-43b3-8bc8-6769db4ebd33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:29.409537 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-436a9e57-ffa0-43b3-8bc8-6769db4ebd33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:29.475538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-436a9e57-ffa0-43b3-8bc8-6769db4ebd33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:29.483462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-436a9e57-ffa0-43b3-8bc8-6769db4ebd33 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086713 Jul 14 16:04:29.484080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 862/1826] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:29 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:30.215063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-432c5bcb-9e1c-43c8-a590-9fe4c1c985b9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:30.215697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-432c5bcb-9e1c-43c8-a590-9fe4c1c985b9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:30.222133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-432c5bcb-9e1c-43c8-a590-9fe4c1c985b9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:30.222576 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-432c5bcb-9e1c-43c8-a590-9fe4c1c985b9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:30.223368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-432c5bcb-9e1c-43c8-a590-9fe4c1c985b9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:30.223824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-432c5bcb-9e1c-43c8-a590-9fe4c1c985b9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:30.358533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-432c5bcb-9e1c-43c8-a590-9fe4c1c985b9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:30.372863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-432c5bcb-9e1c-43c8-a590-9fe4c1c985b9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:30.374352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-432c5bcb-9e1c-43c8-a590-9fe4c1c985b9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:30.375534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-432c5bcb-9e1c-43c8-a590-9fe4c1c985b9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.164352 Jul 14 16:04:30.376121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 965/1827] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:30 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:30.501024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ea388da9-0b84-4593-9e1d-cfa1cd428806 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:30.501639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ea388da9-0b84-4593-9e1d-cfa1cd428806 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:30.508634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea388da9-0b84-4593-9e1d-cfa1cd428806 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:30.509089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea388da9-0b84-4593-9e1d-cfa1cd428806 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:30.509910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea388da9-0b84-4593-9e1d-cfa1cd428806 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:30.510300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea388da9-0b84-4593-9e1d-cfa1cd428806 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:30.579559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ea388da9-0b84-4593-9e1d-cfa1cd428806 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:30.587906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ea388da9-0b84-4593-9e1d-cfa1cd428806 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.090730 Jul 14 16:04:30.588486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 863/1828] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:30 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:31.394475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2d1b9ef6-88c6-4896-ab4b-92c747750a57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:31.395222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2d1b9ef6-88c6-4896-ab4b-92c747750a57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:31.403097 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2d1b9ef6-88c6-4896-ab4b-92c747750a57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:31.403543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2d1b9ef6-88c6-4896-ab4b-92c747750a57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:31.404350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2d1b9ef6-88c6-4896-ab4b-92c747750a57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:31.404785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2d1b9ef6-88c6-4896-ab4b-92c747750a57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:31.539697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2d1b9ef6-88c6-4896-ab4b-92c747750a57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:31.548884 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2d1b9ef6-88c6-4896-ab4b-92c747750a57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:31.550530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2d1b9ef6-88c6-4896-ab4b-92c747750a57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:31.551959 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2d1b9ef6-88c6-4896-ab4b-92c747750a57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.161431 Jul 14 16:04:31.552532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 966/1829] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:31 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:31.607385 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cc775747-33f4-4a38-9c6e-44f5785cf276 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:31.608138 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cc775747-33f4-4a38-9c6e-44f5785cf276 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:31.615896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc775747-33f4-4a38-9c6e-44f5785cf276 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:31.616356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc775747-33f4-4a38-9c6e-44f5785cf276 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:31.617124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc775747-33f4-4a38-9c6e-44f5785cf276 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:31.617561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc775747-33f4-4a38-9c6e-44f5785cf276 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:31.689592 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cc775747-33f4-4a38-9c6e-44f5785cf276 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:31.701850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cc775747-33f4-4a38-9c6e-44f5785cf276 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.098921 Jul 14 16:04:31.702552 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 864/1830] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:31 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:32.571185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0aaebec0-d081-4563-8fbe-5ae0ac6ce9d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:32.571759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0aaebec0-d081-4563-8fbe-5ae0ac6ce9d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:32.578251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0aaebec0-d081-4563-8fbe-5ae0ac6ce9d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:32.578698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0aaebec0-d081-4563-8fbe-5ae0ac6ce9d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:32.579454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0aaebec0-d081-4563-8fbe-5ae0ac6ce9d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:32.579916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0aaebec0-d081-4563-8fbe-5ae0ac6ce9d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:32.713263 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0aaebec0-d081-4563-8fbe-5ae0ac6ce9d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:32.719890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-13463b9d-4fe7-45cf-bb56-d9a829a631a2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:32.720511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-13463b9d-4fe7-45cf-bb56-d9a829a631a2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:32.721800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0aaebec0-d081-4563-8fbe-5ae0ac6ce9d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:32.723417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0aaebec0-d081-4563-8fbe-5ae0ac6ce9d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:32.724628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0aaebec0-d081-4563-8fbe-5ae0ac6ce9d1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158227 Jul 14 16:04:32.725187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 967/1831] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:32.728283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13463b9d-4fe7-45cf-bb56-d9a829a631a2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:32.728283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13463b9d-4fe7-45cf-bb56-d9a829a631a2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:32.729066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13463b9d-4fe7-45cf-bb56-d9a829a631a2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:32.729507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13463b9d-4fe7-45cf-bb56-d9a829a631a2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:32.792278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-13463b9d-4fe7-45cf-bb56-d9a829a631a2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:32.799914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-13463b9d-4fe7-45cf-bb56-d9a829a631a2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083748 Jul 14 16:04:32.800623 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 865/1832] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:32 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:33.743402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-01f510e6-3739-4c08-ad38-27623dfb3f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:33.744103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-01f510e6-3739-4c08-ad38-27623dfb3f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:33.750688 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-01f510e6-3739-4c08-ad38-27623dfb3f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:33.751137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-01f510e6-3739-4c08-ad38-27623dfb3f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:33.752002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-01f510e6-3739-4c08-ad38-27623dfb3f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:33.752668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-01f510e6-3739-4c08-ad38-27623dfb3f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:33.818488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-571f6dab-43a9-4b92-ac39-003ebcdb732d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:33.819093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-571f6dab-43a9-4b92-ac39-003ebcdb732d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:33.826169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-571f6dab-43a9-4b92-ac39-003ebcdb732d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:33.826616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-571f6dab-43a9-4b92-ac39-003ebcdb732d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:33.827403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-571f6dab-43a9-4b92-ac39-003ebcdb732d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:33.827904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-571f6dab-43a9-4b92-ac39-003ebcdb732d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:33.895890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-571f6dab-43a9-4b92-ac39-003ebcdb732d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:33.904005 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-01f510e6-3739-4c08-ad38-27623dfb3f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:33.906352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-571f6dab-43a9-4b92-ac39-003ebcdb732d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.092528 Jul 14 16:04:33.907034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 866/1833] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:33 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:33.914112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-01f510e6-3739-4c08-ad38-27623dfb3f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:33.915776 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-01f510e6-3739-4c08-ad38-27623dfb3f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:33.917043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-01f510e6-3739-4c08-ad38-27623dfb3f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.178068 Jul 14 16:04:33.917680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 968/1834] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:33 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:34.925780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-69dbe4db-5ffc-4272-8b94-add5e1c79a88 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:34.926875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-69dbe4db-5ffc-4272-8b94-add5e1c79a88 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:34.933587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-69dbe4db-5ffc-4272-8b94-add5e1c79a88 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:34.934034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-69dbe4db-5ffc-4272-8b94-add5e1c79a88 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:34.934816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-69dbe4db-5ffc-4272-8b94-add5e1c79a88 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:34.935245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-69dbe4db-5ffc-4272-8b94-add5e1c79a88 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:34.935916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c2d39d0c-13db-49b8-ab67-a8afc343963d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:34.936634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c2d39d0c-13db-49b8-ab67-a8afc343963d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:34.944060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c2d39d0c-13db-49b8-ab67-a8afc343963d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:34.944451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c2d39d0c-13db-49b8-ab67-a8afc343963d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:34.945225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c2d39d0c-13db-49b8-ab67-a8afc343963d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:34.945763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c2d39d0c-13db-49b8-ab67-a8afc343963d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:35.004566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-69dbe4db-5ffc-4272-8b94-add5e1c79a88 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:35.013221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-69dbe4db-5ffc-4272-8b94-add5e1c79a88 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.091660 Jul 14 16:04:35.013870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 867/1835] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:34 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:35.088208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c2d39d0c-13db-49b8-ab67-a8afc343963d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:35.096849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c2d39d0c-13db-49b8-ab67-a8afc343963d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:35.099466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c2d39d0c-13db-49b8-ab67-a8afc343963d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:35.100697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c2d39d0c-13db-49b8-ab67-a8afc343963d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.168785 Jul 14 16:04:35.101260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 969/1836] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:34 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:04:36.030737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-205928cd-facf-499d-a779-730a9d107584 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:36.031345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-205928cd-facf-499d-a779-730a9d107584 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:36.038815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-205928cd-facf-499d-a779-730a9d107584 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:36.039261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-205928cd-facf-499d-a779-730a9d107584 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:36.040040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-205928cd-facf-499d-a779-730a9d107584 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:36.040473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-205928cd-facf-499d-a779-730a9d107584 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:36.103652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-205928cd-facf-499d-a779-730a9d107584 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:36.111089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-205928cd-facf-499d-a779-730a9d107584 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084178 Jul 14 16:04:36.111876 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 868/1837] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:36 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:36.123372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9f42017d-8134-463e-97f0-d26c10c2c840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:36.124024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9f42017d-8134-463e-97f0-d26c10c2c840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:36.131424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f42017d-8134-463e-97f0-d26c10c2c840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:36.131890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f42017d-8134-463e-97f0-d26c10c2c840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:36.133015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f42017d-8134-463e-97f0-d26c10c2c840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:36.133448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9f42017d-8134-463e-97f0-d26c10c2c840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:36.289193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9f42017d-8134-463e-97f0-d26c10c2c840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:36.297521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9f42017d-8134-463e-97f0-d26c10c2c840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:36.299058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9f42017d-8134-463e-97f0-d26c10c2c840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:36.300252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9f42017d-8134-463e-97f0-d26c10c2c840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.184298 Jul 14 16:04:36.300805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 970/1838] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:36 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:04:37.130636 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2b366e5f-b646-443e-b005-ce1add1e6015 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:37.131250 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2b366e5f-b646-443e-b005-ce1add1e6015 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:37.133610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:37.138844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2b366e5f-b646-443e-b005-ce1add1e6015 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:37.139289 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2b366e5f-b646-443e-b005-ce1add1e6015 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:37.140155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2b366e5f-b646-443e-b005-ce1add1e6015 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:37.140591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2b366e5f-b646-443e-b005-ce1add1e6015 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:37.203388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2b366e5f-b646-443e-b005-ce1add1e6015 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:37.211720 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2b366e5f-b646-443e-b005-ce1add1e6015 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085356 Jul 14 16:04:37.212299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 869/1839] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:37 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:37.318838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cf89b03c-43c6-4b05-9114-d17e98cb552e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:37.319386 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cf89b03c-43c6-4b05-9114-d17e98cb552e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:37.326144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cf89b03c-43c6-4b05-9114-d17e98cb552e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:37.326596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cf89b03c-43c6-4b05-9114-d17e98cb552e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:37.327354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cf89b03c-43c6-4b05-9114-d17e98cb552e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:37.327820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cf89b03c-43c6-4b05-9114-d17e98cb552e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:37.469157 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cf89b03c-43c6-4b05-9114-d17e98cb552e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:37.479190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cf89b03c-43c6-4b05-9114-d17e98cb552e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:37.480744 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cf89b03c-43c6-4b05-9114-d17e98cb552e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:37.481964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cf89b03c-43c6-4b05-9114-d17e98cb552e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.167511 Jul 14 16:04:37.482522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 971/1840] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:37 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:38.229208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8ad930a8-1665-48ce-8087-5db3d49f8c1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:38.229824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8ad930a8-1665-48ce-8087-5db3d49f8c1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:38.236396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ad930a8-1665-48ce-8087-5db3d49f8c1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:38.236847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ad930a8-1665-48ce-8087-5db3d49f8c1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:38.237649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ad930a8-1665-48ce-8087-5db3d49f8c1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:38.238295 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ad930a8-1665-48ce-8087-5db3d49f8c1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:38.305620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8ad930a8-1665-48ce-8087-5db3d49f8c1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:38.309033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:38.314182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8ad930a8-1665-48ce-8087-5db3d49f8c1d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088824 Jul 14 16:04:38.314960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 870/1841] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:38 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:38.500808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fe7bd8d4-8b0b-4c11-8edf-07f872d042ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:38.501410 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fe7bd8d4-8b0b-4c11-8edf-07f872d042ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:38.508220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe7bd8d4-8b0b-4c11-8edf-07f872d042ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:38.508677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe7bd8d4-8b0b-4c11-8edf-07f872d042ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:38.509450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe7bd8d4-8b0b-4c11-8edf-07f872d042ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:38.509892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe7bd8d4-8b0b-4c11-8edf-07f872d042ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:38.643960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fe7bd8d4-8b0b-4c11-8edf-07f872d042ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:38.652886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fe7bd8d4-8b0b-4c11-8edf-07f872d042ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:38.654370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fe7bd8d4-8b0b-4c11-8edf-07f872d042ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:38.655539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fe7bd8d4-8b0b-4c11-8edf-07f872d042ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158668 Jul 14 16:04:38.656116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 972/1842] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:39.331659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-65eb736d-1ead-4124-a193-eeec05f33bd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:39.332621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-65eb736d-1ead-4124-a193-eeec05f33bd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:39.341003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65eb736d-1ead-4124-a193-eeec05f33bd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:39.341459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65eb736d-1ead-4124-a193-eeec05f33bd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:39.342234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65eb736d-1ead-4124-a193-eeec05f33bd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:39.342671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65eb736d-1ead-4124-a193-eeec05f33bd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:39.405341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-65eb736d-1ead-4124-a193-eeec05f33bd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:39.413403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-65eb736d-1ead-4124-a193-eeec05f33bd1 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086121 Jul 14 16:04:39.414116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 871/1843] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:39 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:39.674428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c911d358-9ab0-4083-b0b5-99ee2dd5ce35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:39.675066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c911d358-9ab0-4083-b0b5-99ee2dd5ce35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:39.682199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c911d358-9ab0-4083-b0b5-99ee2dd5ce35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:39.682646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c911d358-9ab0-4083-b0b5-99ee2dd5ce35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:39.683408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c911d358-9ab0-4083-b0b5-99ee2dd5ce35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:39.684006 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c911d358-9ab0-4083-b0b5-99ee2dd5ce35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:39.823053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c911d358-9ab0-4083-b0b5-99ee2dd5ce35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:39.831536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c911d358-9ab0-4083-b0b5-99ee2dd5ce35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:39.833404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c911d358-9ab0-4083-b0b5-99ee2dd5ce35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:39.834584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c911d358-9ab0-4083-b0b5-99ee2dd5ce35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.164072 Jul 14 16:04:39.835147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 973/1844] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:39 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:40.431264 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-44f17bc1-c542-45a1-822e-60eabb665f59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:40.431903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-44f17bc1-c542-45a1-822e-60eabb665f59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:40.438390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-44f17bc1-c542-45a1-822e-60eabb665f59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:40.438831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-44f17bc1-c542-45a1-822e-60eabb665f59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:40.439619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-44f17bc1-c542-45a1-822e-60eabb665f59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:40.440047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-44f17bc1-c542-45a1-822e-60eabb665f59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:40.509564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-44f17bc1-c542-45a1-822e-60eabb665f59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:40.517155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-44f17bc1-c542-45a1-822e-60eabb665f59 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.089850 Jul 14 16:04:40.517683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 872/1845] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:40 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:40.853590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c49431a8-a35b-4321-bc01-95d8a2ecc017 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:40.854178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c49431a8-a35b-4321-bc01-95d8a2ecc017 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:40.860719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c49431a8-a35b-4321-bc01-95d8a2ecc017 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:40.861167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c49431a8-a35b-4321-bc01-95d8a2ecc017 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:40.861940 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c49431a8-a35b-4321-bc01-95d8a2ecc017 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:40.862362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c49431a8-a35b-4321-bc01-95d8a2ecc017 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:41.016640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c49431a8-a35b-4321-bc01-95d8a2ecc017 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:41.031087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c49431a8-a35b-4321-bc01-95d8a2ecc017 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:41.033676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c49431a8-a35b-4321-bc01-95d8a2ecc017 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:41.036139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c49431a8-a35b-4321-bc01-95d8a2ecc017 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.185733 Jul 14 16:04:41.037452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 974/1846] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:40 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:41.534477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cd1caeef-0ee7-4178-9b20-c131a4dc683b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:41.535094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cd1caeef-0ee7-4178-9b20-c131a4dc683b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:41.541846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd1caeef-0ee7-4178-9b20-c131a4dc683b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:41.542301 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd1caeef-0ee7-4178-9b20-c131a4dc683b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:41.543083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd1caeef-0ee7-4178-9b20-c131a4dc683b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:41.543526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd1caeef-0ee7-4178-9b20-c131a4dc683b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:41.609248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cd1caeef-0ee7-4178-9b20-c131a4dc683b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:41.617810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cd1caeef-0ee7-4178-9b20-c131a4dc683b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087158 Jul 14 16:04:41.618419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 873/1847] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:41 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:42.055347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-87ed4dd6-cb2b-4f19-9d68-cf636b0f1bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:42.055999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-87ed4dd6-cb2b-4f19-9d68-cf636b0f1bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:42.062699 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-87ed4dd6-cb2b-4f19-9d68-cf636b0f1bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:42.063822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-87ed4dd6-cb2b-4f19-9d68-cf636b0f1bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:42.063940 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-87ed4dd6-cb2b-4f19-9d68-cf636b0f1bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:42.064337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-87ed4dd6-cb2b-4f19-9d68-cf636b0f1bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:42.204504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-87ed4dd6-cb2b-4f19-9d68-cf636b0f1bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:42.214548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-87ed4dd6-cb2b-4f19-9d68-cf636b0f1bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:42.216076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-87ed4dd6-cb2b-4f19-9d68-cf636b0f1bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:42.217255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-87ed4dd6-cb2b-4f19-9d68-cf636b0f1bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.166816 Jul 14 16:04:42.217808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 975/1848] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:42 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:42.634867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-82d0a83d-fd2f-4dfa-aaf2-f02da8172c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:42.635414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-82d0a83d-fd2f-4dfa-aaf2-f02da8172c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:42.642064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82d0a83d-fd2f-4dfa-aaf2-f02da8172c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:42.642551 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82d0a83d-fd2f-4dfa-aaf2-f02da8172c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:42.643328 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82d0a83d-fd2f-4dfa-aaf2-f02da8172c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:42.643809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82d0a83d-fd2f-4dfa-aaf2-f02da8172c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:42.710518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-82d0a83d-fd2f-4dfa-aaf2-f02da8172c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:42.717753 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-82d0a83d-fd2f-4dfa-aaf2-f02da8172c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086945 Jul 14 16:04:42.718324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 874/1849] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:42 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:43.236596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-621c49ed-2d87-41cf-acbe-b5f83159cf76 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:43.237198 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-621c49ed-2d87-41cf-acbe-b5f83159cf76 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:43.243843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-621c49ed-2d87-41cf-acbe-b5f83159cf76 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:43.244300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-621c49ed-2d87-41cf-acbe-b5f83159cf76 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:43.245065 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-621c49ed-2d87-41cf-acbe-b5f83159cf76 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:43.245507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-621c49ed-2d87-41cf-acbe-b5f83159cf76 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:43.381789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-621c49ed-2d87-41cf-acbe-b5f83159cf76 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:43.390260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-621c49ed-2d87-41cf-acbe-b5f83159cf76 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:43.391838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-621c49ed-2d87-41cf-acbe-b5f83159cf76 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:43.393011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-621c49ed-2d87-41cf-acbe-b5f83159cf76 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.160373 Jul 14 16:04:43.393740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 976/1850] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:43 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:43.734818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0ec09221-61cb-4517-bb1f-5e4c51b13835 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:43.735436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0ec09221-61cb-4517-bb1f-5e4c51b13835 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:43.742751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0ec09221-61cb-4517-bb1f-5e4c51b13835 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:43.743190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0ec09221-61cb-4517-bb1f-5e4c51b13835 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:43.743995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0ec09221-61cb-4517-bb1f-5e4c51b13835 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:43.744433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0ec09221-61cb-4517-bb1f-5e4c51b13835 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:43.807236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0ec09221-61cb-4517-bb1f-5e4c51b13835 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:43.814924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0ec09221-61cb-4517-bb1f-5e4c51b13835 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083939 Jul 14 16:04:43.815493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 875/1851] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:43 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:44.412576 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-737c3d6d-b979-44a2-91cf-42f34036ad75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:44.413195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-737c3d6d-b979-44a2-91cf-42f34036ad75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:44.419705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-737c3d6d-b979-44a2-91cf-42f34036ad75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:44.420158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-737c3d6d-b979-44a2-91cf-42f34036ad75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:44.420912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-737c3d6d-b979-44a2-91cf-42f34036ad75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:44.421350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-737c3d6d-b979-44a2-91cf-42f34036ad75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:44.555233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-737c3d6d-b979-44a2-91cf-42f34036ad75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:44.563636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-737c3d6d-b979-44a2-91cf-42f34036ad75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:44.565113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-737c3d6d-b979-44a2-91cf-42f34036ad75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:44.566358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-737c3d6d-b979-44a2-91cf-42f34036ad75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.159123 Jul 14 16:04:44.567202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 977/1852] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:44.833656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4aa0fc9e-907d-403d-92e9-e99ff5065545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:44.834215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4aa0fc9e-907d-403d-92e9-e99ff5065545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:44.840576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4aa0fc9e-907d-403d-92e9-e99ff5065545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:44.841022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4aa0fc9e-907d-403d-92e9-e99ff5065545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:44.841777 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4aa0fc9e-907d-403d-92e9-e99ff5065545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:44.842207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4aa0fc9e-907d-403d-92e9-e99ff5065545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:44.906477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4aa0fc9e-907d-403d-92e9-e99ff5065545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:44.914591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4aa0fc9e-907d-403d-92e9-e99ff5065545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085433 Jul 14 16:04:44.915156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 876/1853] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:44 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:45.585579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-93cc5b7f-1a4b-4783-8365-30f6eeebcd29 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:45.586218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-93cc5b7f-1a4b-4783-8365-30f6eeebcd29 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:45.592681 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93cc5b7f-1a4b-4783-8365-30f6eeebcd29 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:45.593127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93cc5b7f-1a4b-4783-8365-30f6eeebcd29 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:45.593879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93cc5b7f-1a4b-4783-8365-30f6eeebcd29 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:45.594309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93cc5b7f-1a4b-4783-8365-30f6eeebcd29 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:45.599133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:45.746360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-93cc5b7f-1a4b-4783-8365-30f6eeebcd29 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:45.754746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-93cc5b7f-1a4b-4783-8365-30f6eeebcd29 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:45.756258 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-93cc5b7f-1a4b-4783-8365-30f6eeebcd29 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:45.757417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-93cc5b7f-1a4b-4783-8365-30f6eeebcd29 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.176719 Jul 14 16:04:45.757968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 978/1854] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:45 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:45.931703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4b39c3b8-b418-48dd-80fb-bbdd156cf7cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:45.932322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4b39c3b8-b418-48dd-80fb-bbdd156cf7cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:45.939022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4b39c3b8-b418-48dd-80fb-bbdd156cf7cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:45.939470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4b39c3b8-b418-48dd-80fb-bbdd156cf7cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:45.940263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4b39c3b8-b418-48dd-80fb-bbdd156cf7cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:45.940698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4b39c3b8-b418-48dd-80fb-bbdd156cf7cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:46.008088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4b39c3b8-b418-48dd-80fb-bbdd156cf7cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:46.015556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4b39c3b8-b418-48dd-80fb-bbdd156cf7cc tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087714 Jul 14 16:04:46.016142 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 877/1855] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:45 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:46.775926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b9037480-aeeb-4b2c-923f-c0557d6d0144 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:46.776560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b9037480-aeeb-4b2c-923f-c0557d6d0144 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:46.783018 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b9037480-aeeb-4b2c-923f-c0557d6d0144 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:46.783487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b9037480-aeeb-4b2c-923f-c0557d6d0144 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:46.784257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b9037480-aeeb-4b2c-923f-c0557d6d0144 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:46.784687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b9037480-aeeb-4b2c-923f-c0557d6d0144 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:46.917894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b9037480-aeeb-4b2c-923f-c0557d6d0144 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:46.927346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b9037480-aeeb-4b2c-923f-c0557d6d0144 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:46.928876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b9037480-aeeb-4b2c-923f-c0557d6d0144 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:46.930141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b9037480-aeeb-4b2c-923f-c0557d6d0144 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158145 Jul 14 16:04:46.930693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 979/1856] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:46 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:47.032809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8b17cfaa-0e85-4807-826f-6b6beb6ee730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:47.033353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8b17cfaa-0e85-4807-826f-6b6beb6ee730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:47.040096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8b17cfaa-0e85-4807-826f-6b6beb6ee730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:47.040544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8b17cfaa-0e85-4807-826f-6b6beb6ee730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:47.041301 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8b17cfaa-0e85-4807-826f-6b6beb6ee730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:47.041736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8b17cfaa-0e85-4807-826f-6b6beb6ee730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:47.254122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8b17cfaa-0e85-4807-826f-6b6beb6ee730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:47.261504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8b17cfaa-0e85-4807-826f-6b6beb6ee730 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.232565 Jul 14 16:04:47.262059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 878/1857] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:47 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:47.949013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4da95cdd-5cfb-4311-9ad9-d1b83878b5a7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:47.949628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4da95cdd-5cfb-4311-9ad9-d1b83878b5a7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:47.956207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4da95cdd-5cfb-4311-9ad9-d1b83878b5a7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:47.956652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4da95cdd-5cfb-4311-9ad9-d1b83878b5a7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:47.957988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4da95cdd-5cfb-4311-9ad9-d1b83878b5a7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:47.958422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4da95cdd-5cfb-4311-9ad9-d1b83878b5a7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:48.086548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4da95cdd-5cfb-4311-9ad9-d1b83878b5a7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:48.094907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4da95cdd-5cfb-4311-9ad9-d1b83878b5a7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:48.096522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4da95cdd-5cfb-4311-9ad9-d1b83878b5a7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:48.098336 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4da95cdd-5cfb-4311-9ad9-d1b83878b5a7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.152637 Jul 14 16:04:48.099146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 980/1858] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:47 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:04:48.278867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a283b250-f44e-40a7-b658-f33b36ecb649 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:48.279477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a283b250-f44e-40a7-b658-f33b36ecb649 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:48.286979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a283b250-f44e-40a7-b658-f33b36ecb649 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:48.287703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a283b250-f44e-40a7-b658-f33b36ecb649 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:48.288490 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a283b250-f44e-40a7-b658-f33b36ecb649 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:48.289053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a283b250-f44e-40a7-b658-f33b36ecb649 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:48.351867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a283b250-f44e-40a7-b658-f33b36ecb649 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:48.359274 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a283b250-f44e-40a7-b658-f33b36ecb649 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084335 Jul 14 16:04:48.360237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 879/1859] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:48 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:49.117247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-28bc1617-bb23-4ced-9c47-1b9edf0c1f46 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:49.117919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-28bc1617-bb23-4ced-9c47-1b9edf0c1f46 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:49.124496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28bc1617-bb23-4ced-9c47-1b9edf0c1f46 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:49.124948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28bc1617-bb23-4ced-9c47-1b9edf0c1f46 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:49.125714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28bc1617-bb23-4ced-9c47-1b9edf0c1f46 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:49.126149 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28bc1617-bb23-4ced-9c47-1b9edf0c1f46 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:49.271516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-28bc1617-bb23-4ced-9c47-1b9edf0c1f46 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:49.280115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-28bc1617-bb23-4ced-9c47-1b9edf0c1f46 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:49.281620 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-28bc1617-bb23-4ced-9c47-1b9edf0c1f46 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:49.282804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-28bc1617-bb23-4ced-9c47-1b9edf0c1f46 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.169888 Jul 14 16:04:49.283535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 981/1860] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:49 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:49.376734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-022e1a2c-7073-48da-98a0-26de024f8a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:49.377339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-022e1a2c-7073-48da-98a0-26de024f8a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:49.384457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-022e1a2c-7073-48da-98a0-26de024f8a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:49.385056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-022e1a2c-7073-48da-98a0-26de024f8a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:49.385856 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-022e1a2c-7073-48da-98a0-26de024f8a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:49.386359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-022e1a2c-7073-48da-98a0-26de024f8a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:49.453893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-022e1a2c-7073-48da-98a0-26de024f8a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:49.462507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-022e1a2c-7073-48da-98a0-26de024f8a91 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.089529 Jul 14 16:04:49.463001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 880/1861] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:49 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:50.302849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8b84e7b9-95b3-4259-913a-d7a6a405be8a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:50.303837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8b84e7b9-95b3-4259-913a-d7a6a405be8a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:50.311817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b84e7b9-95b3-4259-913a-d7a6a405be8a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:50.312272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b84e7b9-95b3-4259-913a-d7a6a405be8a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:50.313044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b84e7b9-95b3-4259-913a-d7a6a405be8a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:50.313489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b84e7b9-95b3-4259-913a-d7a6a405be8a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:50.442747 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8b84e7b9-95b3-4259-913a-d7a6a405be8a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:50.450998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8b84e7b9-95b3-4259-913a-d7a6a405be8a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:50.452498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8b84e7b9-95b3-4259-913a-d7a6a405be8a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:50.453657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8b84e7b9-95b3-4259-913a-d7a6a405be8a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.155740 Jul 14 16:04:50.454204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 982/1862] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:50 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:50.478055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b3a5195c-2684-47d5-8e55-69acc2b134cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:50.478663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b3a5195c-2684-47d5-8e55-69acc2b134cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:50.485178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3a5195c-2684-47d5-8e55-69acc2b134cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:50.485342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3a5195c-2684-47d5-8e55-69acc2b134cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:50.486117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3a5195c-2684-47d5-8e55-69acc2b134cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:50.486576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3a5195c-2684-47d5-8e55-69acc2b134cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:50.548174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b3a5195c-2684-47d5-8e55-69acc2b134cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:50.556349 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b3a5195c-2684-47d5-8e55-69acc2b134cb tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082112 Jul 14 16:04:50.556900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 881/1863] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:50 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:51.472650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a7fa5ade-26ad-4bb4-a0e4-87fd59bc9168 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:51.473263 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a7fa5ade-26ad-4bb4-a0e4-87fd59bc9168 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:51.479709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a7fa5ade-26ad-4bb4-a0e4-87fd59bc9168 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:51.480160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a7fa5ade-26ad-4bb4-a0e4-87fd59bc9168 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:51.480918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a7fa5ade-26ad-4bb4-a0e4-87fd59bc9168 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:51.481354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a7fa5ade-26ad-4bb4-a0e4-87fd59bc9168 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:51.573771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a5128543-0014-4f84-9394-49a4c4557663 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:51.574358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a5128543-0014-4f84-9394-49a4c4557663 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:51.580788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a5128543-0014-4f84-9394-49a4c4557663 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:51.581234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a5128543-0014-4f84-9394-49a4c4557663 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:51.582157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a5128543-0014-4f84-9394-49a4c4557663 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:51.583194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a5128543-0014-4f84-9394-49a4c4557663 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:51.615659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a7fa5ade-26ad-4bb4-a0e4-87fd59bc9168 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:51.624377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a7fa5ade-26ad-4bb4-a0e4-87fd59bc9168 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:51.626016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a7fa5ade-26ad-4bb4-a0e4-87fd59bc9168 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:51.627244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a7fa5ade-26ad-4bb4-a0e4-87fd59bc9168 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158558 Jul 14 16:04:51.627851 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 983/1864] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:51 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:51.645822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a5128543-0014-4f84-9394-49a4c4557663 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:51.653264 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a5128543-0014-4f84-9394-49a4c4557663 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083330 Jul 14 16:04:51.653889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 882/1865] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:51 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:52.645942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c19f7177-894f-4c4c-9a8a-c2ec61934f5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:52.646555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c19f7177-894f-4c4c-9a8a-c2ec61934f5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:52.653096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c19f7177-894f-4c4c-9a8a-c2ec61934f5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:52.653547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c19f7177-894f-4c4c-9a8a-c2ec61934f5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:52.654305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c19f7177-894f-4c4c-9a8a-c2ec61934f5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:52.654745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c19f7177-894f-4c4c-9a8a-c2ec61934f5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:52.670956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f070e46e-726d-49ef-83c4-85dea9e1084f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:52.671563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f070e46e-726d-49ef-83c4-85dea9e1084f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:52.679338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f070e46e-726d-49ef-83c4-85dea9e1084f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:52.679839 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f070e46e-726d-49ef-83c4-85dea9e1084f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:52.680582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f070e46e-726d-49ef-83c4-85dea9e1084f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:52.681018 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f070e46e-726d-49ef-83c4-85dea9e1084f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:52.743654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f070e46e-726d-49ef-83c4-85dea9e1084f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:52.753614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f070e46e-726d-49ef-83c4-85dea9e1084f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086415 Jul 14 16:04:52.754926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 883/1866] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:52 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:52.791049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c19f7177-894f-4c4c-9a8a-c2ec61934f5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:52.799099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c19f7177-894f-4c4c-9a8a-c2ec61934f5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:52.801195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c19f7177-894f-4c4c-9a8a-c2ec61934f5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:52.802361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c19f7177-894f-4c4c-9a8a-c2ec61934f5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.160590 Jul 14 16:04:52.802920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 984/1867] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:52 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:53.770700 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c9bed6ae-2f8d-4503-bad6-6876e8dcd21f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:53.771316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c9bed6ae-2f8d-4503-bad6-6876e8dcd21f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:53.777823 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c9bed6ae-2f8d-4503-bad6-6876e8dcd21f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:53.778278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c9bed6ae-2f8d-4503-bad6-6876e8dcd21f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:53.779049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c9bed6ae-2f8d-4503-bad6-6876e8dcd21f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:53.779493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c9bed6ae-2f8d-4503-bad6-6876e8dcd21f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:53.821522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c7c6eb3d-fd9b-481a-b5f4-0fe70b62c92a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:53.822109 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c7c6eb3d-fd9b-481a-b5f4-0fe70b62c92a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:53.828583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c7c6eb3d-fd9b-481a-b5f4-0fe70b62c92a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:53.829032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c7c6eb3d-fd9b-481a-b5f4-0fe70b62c92a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:53.829791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c7c6eb3d-fd9b-481a-b5f4-0fe70b62c92a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:53.830220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c7c6eb3d-fd9b-481a-b5f4-0fe70b62c92a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:53.845018 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c9bed6ae-2f8d-4503-bad6-6876e8dcd21f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:53.853324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c9bed6ae-2f8d-4503-bad6-6876e8dcd21f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086782 Jul 14 16:04:53.853912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 884/1868] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:53 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:04:53.959392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c7c6eb3d-fd9b-481a-b5f4-0fe70b62c92a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:53.967626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c7c6eb3d-fd9b-481a-b5f4-0fe70b62c92a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:53.969154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c7c6eb3d-fd9b-481a-b5f4-0fe70b62c92a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:53.970303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c7c6eb3d-fd9b-481a-b5f4-0fe70b62c92a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.153692 Jul 14 16:04:53.970857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 985/1869] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:53 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:04:54.871075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-41762f9b-a347-4f69-88e0-9ace2bc6c0b0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:54.871714 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-41762f9b-a347-4f69-88e0-9ace2bc6c0b0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:54.878121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-41762f9b-a347-4f69-88e0-9ace2bc6c0b0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:54.879143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-41762f9b-a347-4f69-88e0-9ace2bc6c0b0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:54.880425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-41762f9b-a347-4f69-88e0-9ace2bc6c0b0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:54.880868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-41762f9b-a347-4f69-88e0-9ace2bc6c0b0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:54.957221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-41762f9b-a347-4f69-88e0-9ace2bc6c0b0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:54.964539 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-41762f9b-a347-4f69-88e0-9ace2bc6c0b0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.098021 Jul 14 16:04:54.965135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 885/1870] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:54 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:54.989662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5a37a384-8b78-4d07-b9b1-844d3eaf7b70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:54.990707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5a37a384-8b78-4d07-b9b1-844d3eaf7b70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:54.998320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a37a384-8b78-4d07-b9b1-844d3eaf7b70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:54.998775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a37a384-8b78-4d07-b9b1-844d3eaf7b70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:54.999543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a37a384-8b78-4d07-b9b1-844d3eaf7b70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:55.000129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a37a384-8b78-4d07-b9b1-844d3eaf7b70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:55.147718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5a37a384-8b78-4d07-b9b1-844d3eaf7b70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:55.157630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5a37a384-8b78-4d07-b9b1-844d3eaf7b70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:55.159152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5a37a384-8b78-4d07-b9b1-844d3eaf7b70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:55.160461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5a37a384-8b78-4d07-b9b1-844d3eaf7b70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.176206 Jul 14 16:04:55.161117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 986/1871] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:54 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:55.982136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-55200d10-2edc-4cb7-944a-4a6722f10d70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:55.982745 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-55200d10-2edc-4cb7-944a-4a6722f10d70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:55.989698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55200d10-2edc-4cb7-944a-4a6722f10d70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:55.990148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55200d10-2edc-4cb7-944a-4a6722f10d70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:55.990923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55200d10-2edc-4cb7-944a-4a6722f10d70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:55.991360 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55200d10-2edc-4cb7-944a-4a6722f10d70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:56.053638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-55200d10-2edc-4cb7-944a-4a6722f10d70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:56.061167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-55200d10-2edc-4cb7-944a-4a6722f10d70 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082885 Jul 14 16:04:56.061733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 886/1872] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:55 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:56.184530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e4129b35-110b-4726-9c0b-68e3e219b060 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:56.185133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e4129b35-110b-4726-9c0b-68e3e219b060 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:56.192312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4129b35-110b-4726-9c0b-68e3e219b060 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:56.192312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4129b35-110b-4726-9c0b-68e3e219b060 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:56.193390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4129b35-110b-4726-9c0b-68e3e219b060 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:56.193818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4129b35-110b-4726-9c0b-68e3e219b060 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:56.322607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e4129b35-110b-4726-9c0b-68e3e219b060 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:56.330935 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e4129b35-110b-4726-9c0b-68e3e219b060 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:56.333198 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e4129b35-110b-4726-9c0b-68e3e219b060 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:56.334396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e4129b35-110b-4726-9c0b-68e3e219b060 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.153767 Jul 14 16:04:56.334952 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 987/1873] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:56 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:57.077200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8ce7d97b-61b2-4658-821f-59bfd6658230 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:57.077804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8ce7d97b-61b2-4658-821f-59bfd6658230 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:57.084366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ce7d97b-61b2-4658-821f-59bfd6658230 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.084807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ce7d97b-61b2-4658-821f-59bfd6658230 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.085563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ce7d97b-61b2-4658-821f-59bfd6658230 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.085999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ce7d97b-61b2-4658-821f-59bfd6658230 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.103715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:57.147240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8ce7d97b-61b2-4658-821f-59bfd6658230 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:57.154670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8ce7d97b-61b2-4658-821f-59bfd6658230 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081271 Jul 14 16:04:57.155228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 887/1874] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:57 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:57.353784 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fbba35b3-548f-48c5-8922-b84286ea373c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:57.354328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fbba35b3-548f-48c5-8922-b84286ea373c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:57.360865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fbba35b3-548f-48c5-8922-b84286ea373c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.361316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fbba35b3-548f-48c5-8922-b84286ea373c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.362074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fbba35b3-548f-48c5-8922-b84286ea373c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:57.362541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fbba35b3-548f-48c5-8922-b84286ea373c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:57.494905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fbba35b3-548f-48c5-8922-b84286ea373c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:57.503174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fbba35b3-548f-48c5-8922-b84286ea373c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:57.504892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fbba35b3-548f-48c5-8922-b84286ea373c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:57.506049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fbba35b3-548f-48c5-8922-b84286ea373c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156315 Jul 14 16:04:57.506610 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 988/1875] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:57 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:58.171724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b3445cd7-e352-4de5-805d-c5b241ce7a89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:58.172341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b3445cd7-e352-4de5-805d-c5b241ce7a89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:58.179791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3445cd7-e352-4de5-805d-c5b241ce7a89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:58.180243 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3445cd7-e352-4de5-805d-c5b241ce7a89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:58.181006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3445cd7-e352-4de5-805d-c5b241ce7a89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:58.181444 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3445cd7-e352-4de5-805d-c5b241ce7a89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:58.246236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b3445cd7-e352-4de5-805d-c5b241ce7a89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:58.254339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b3445cd7-e352-4de5-805d-c5b241ce7a89 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085937 Jul 14 16:04:58.255203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 888/1876] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:58 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:58.524752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fcbc9bf9-7d9e-4ad8-9b25-4bf8d4fadd5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:58.525317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fcbc9bf9-7d9e-4ad8-9b25-4bf8d4fadd5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:58.531952 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcbc9bf9-7d9e-4ad8-9b25-4bf8d4fadd5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:58.532404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcbc9bf9-7d9e-4ad8-9b25-4bf8d4fadd5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:58.533164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcbc9bf9-7d9e-4ad8-9b25-4bf8d4fadd5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:58.533599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcbc9bf9-7d9e-4ad8-9b25-4bf8d4fadd5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:58.666935 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcbc9bf9-7d9e-4ad8-9b25-4bf8d4fadd5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:58.675369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcbc9bf9-7d9e-4ad8-9b25-4bf8d4fadd5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:58.677587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcbc9bf9-7d9e-4ad8-9b25-4bf8d4fadd5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:58.678758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fcbc9bf9-7d9e-4ad8-9b25-4bf8d4fadd5c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158009 Jul 14 16:04:58.679317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 989/1877] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:58 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:04:59.276879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c2e2e472-c79d-4e9d-a3e2-81a5fe417dbf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:59.277406 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c2e2e472-c79d-4e9d-a3e2-81a5fe417dbf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:59.283990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2e2e472-c79d-4e9d-a3e2-81a5fe417dbf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:59.284449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2e2e472-c79d-4e9d-a3e2-81a5fe417dbf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:59.285449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2e2e472-c79d-4e9d-a3e2-81a5fe417dbf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:59.285939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2e2e472-c79d-4e9d-a3e2-81a5fe417dbf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:59.348330 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c2e2e472-c79d-4e9d-a3e2-81a5fe417dbf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:59.355841 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c2e2e472-c79d-4e9d-a3e2-81a5fe417dbf tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082945 Jul 14 16:04:59.356399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 889/1878] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:04:59 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:04:59.696936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8b91ee97-ebb2-4244-a01e-74bb5667a8ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:04:59.697551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8b91ee97-ebb2-4244-a01e-74bb5667a8ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:04:59.699865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=52 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:04:59.705306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b91ee97-ebb2-4244-a01e-74bb5667a8ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:59.705751 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b91ee97-ebb2-4244-a01e-74bb5667a8ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:59.706501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b91ee97-ebb2-4244-a01e-74bb5667a8ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:04:59.707483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b91ee97-ebb2-4244-a01e-74bb5667a8ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:04:59.837376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8b91ee97-ebb2-4244-a01e-74bb5667a8ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:59.845690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8b91ee97-ebb2-4244-a01e-74bb5667a8ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:59.847176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8b91ee97-ebb2-4244-a01e-74bb5667a8ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:04:59.849002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8b91ee97-ebb2-4244-a01e-74bb5667a8ad tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156038 Jul 14 16:04:59.849565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 990/1879] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:04:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:00.373153 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-65cbb875-4518-4052-9913-890f2a0479ab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:00.373750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-65cbb875-4518-4052-9913-890f2a0479ab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:00.380738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65cbb875-4518-4052-9913-890f2a0479ab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:00.381186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65cbb875-4518-4052-9913-890f2a0479ab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:00.381959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65cbb875-4518-4052-9913-890f2a0479ab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:00.382425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-65cbb875-4518-4052-9913-890f2a0479ab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:00.447222 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-65cbb875-4518-4052-9913-890f2a0479ab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:00.455163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-65cbb875-4518-4052-9913-890f2a0479ab tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086163 Jul 14 16:05:00.455749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 890/1880] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:00 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:00.867051 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-005db755-07ad-4456-897e-9b2ecfa2f23e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:00.867676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-005db755-07ad-4456-897e-9b2ecfa2f23e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:00.874513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-005db755-07ad-4456-897e-9b2ecfa2f23e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:00.874968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-005db755-07ad-4456-897e-9b2ecfa2f23e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:00.875767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-005db755-07ad-4456-897e-9b2ecfa2f23e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:00.876206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-005db755-07ad-4456-897e-9b2ecfa2f23e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:01.013333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-005db755-07ad-4456-897e-9b2ecfa2f23e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:01.021785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-005db755-07ad-4456-897e-9b2ecfa2f23e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:01.023261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-005db755-07ad-4456-897e-9b2ecfa2f23e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:01.024434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-005db755-07ad-4456-897e-9b2ecfa2f23e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.161340 Jul 14 16:05:01.024986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 991/1881] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:00 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:01.473246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-35e23757-0e5d-4139-9083-242caec74c8f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:01.473986 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-35e23757-0e5d-4139-9083-242caec74c8f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:01.480547 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35e23757-0e5d-4139-9083-242caec74c8f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:01.480995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35e23757-0e5d-4139-9083-242caec74c8f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:01.481766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35e23757-0e5d-4139-9083-242caec74c8f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:01.482203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35e23757-0e5d-4139-9083-242caec74c8f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:01.549727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-35e23757-0e5d-4139-9083-242caec74c8f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:01.557804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-35e23757-0e5d-4139-9083-242caec74c8f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.089122 Jul 14 16:05:01.558377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 891/1882] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:01 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:02.042570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a4b98dcb-5d02-4e4b-b8e2-f29070e3daa8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:02.043182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a4b98dcb-5d02-4e4b-b8e2-f29070e3daa8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:02.049668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a4b98dcb-5d02-4e4b-b8e2-f29070e3daa8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:02.050115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a4b98dcb-5d02-4e4b-b8e2-f29070e3daa8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:02.051460 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a4b98dcb-5d02-4e4b-b8e2-f29070e3daa8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:02.051925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a4b98dcb-5d02-4e4b-b8e2-f29070e3daa8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:02.185696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a4b98dcb-5d02-4e4b-b8e2-f29070e3daa8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:02.194415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a4b98dcb-5d02-4e4b-b8e2-f29070e3daa8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:02.196064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a4b98dcb-5d02-4e4b-b8e2-f29070e3daa8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:02.197238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a4b98dcb-5d02-4e4b-b8e2-f29070e3daa8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158575 Jul 14 16:05:02.197800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 992/1883] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:02.574811 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-92393890-35ed-4dca-b08a-332815d4b244 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:02.575356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-92393890-35ed-4dca-b08a-332815d4b244 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:02.581950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92393890-35ed-4dca-b08a-332815d4b244 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:02.582396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92393890-35ed-4dca-b08a-332815d4b244 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:02.583151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92393890-35ed-4dca-b08a-332815d4b244 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:02.583588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92393890-35ed-4dca-b08a-332815d4b244 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:02.647993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-92393890-35ed-4dca-b08a-332815d4b244 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:02.655449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-92393890-35ed-4dca-b08a-332815d4b244 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084646 Jul 14 16:05:02.656048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 892/1884] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:02 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:03.214586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d2d8bb7f-0a1d-4ff4-a91b-44fb50118169 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:03.215177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d2d8bb7f-0a1d-4ff4-a91b-44fb50118169 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:03.221177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2d8bb7f-0a1d-4ff4-a91b-44fb50118169 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.221628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2d8bb7f-0a1d-4ff4-a91b-44fb50118169 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.223053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2d8bb7f-0a1d-4ff4-a91b-44fb50118169 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.223495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2d8bb7f-0a1d-4ff4-a91b-44fb50118169 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.409257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d2d8bb7f-0a1d-4ff4-a91b-44fb50118169 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:03.418591 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d2d8bb7f-0a1d-4ff4-a91b-44fb50118169 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:03.420147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d2d8bb7f-0a1d-4ff4-a91b-44fb50118169 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:03.421320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d2d8bb7f-0a1d-4ff4-a91b-44fb50118169 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.210871 Jul 14 16:05:03.421880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 993/1885] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:03.671765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-66298d8d-694f-41b6-aa26-d5feb9ca571c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:03.672454 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-66298d8d-694f-41b6-aa26-d5feb9ca571c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:03.680153 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66298d8d-694f-41b6-aa26-d5feb9ca571c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.680607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66298d8d-694f-41b6-aa26-d5feb9ca571c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.681383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66298d8d-694f-41b6-aa26-d5feb9ca571c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:03.681822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66298d8d-694f-41b6-aa26-d5feb9ca571c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:03.804780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-66298d8d-694f-41b6-aa26-d5feb9ca571c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:03.812278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-66298d8d-694f-41b6-aa26-d5feb9ca571c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.144403 Jul 14 16:05:03.812849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 893/1886] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:03 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:03.848932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:05:03.849098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:05:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:05:04.439521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4b9f5a3e-c468-4e44-93b1-3ca171c2678d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:04.440160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4b9f5a3e-c468-4e44-93b1-3ca171c2678d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:04.447056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b9f5a3e-c468-4e44-93b1-3ca171c2678d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.447506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b9f5a3e-c468-4e44-93b1-3ca171c2678d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.448298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b9f5a3e-c468-4e44-93b1-3ca171c2678d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.448736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4b9f5a3e-c468-4e44-93b1-3ca171c2678d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.582604 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4b9f5a3e-c468-4e44-93b1-3ca171c2678d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:04.586022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:04.592219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4b9f5a3e-c468-4e44-93b1-3ca171c2678d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:04.593712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4b9f5a3e-c468-4e44-93b1-3ca171c2678d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:04.594882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4b9f5a3e-c468-4e44-93b1-3ca171c2678d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.159328 Jul 14 16:05:04.595448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 994/1887] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:04.830139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-743a9773-cbff-4579-94a4-556daf96ba11 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:04.830690 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-743a9773-cbff-4579-94a4-556daf96ba11 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:04.838353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-743a9773-cbff-4579-94a4-556daf96ba11 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.838804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-743a9773-cbff-4579-94a4-556daf96ba11 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.839566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-743a9773-cbff-4579-94a4-556daf96ba11 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:04.840030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-743a9773-cbff-4579-94a4-556daf96ba11 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:04.902124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-743a9773-cbff-4579-94a4-556daf96ba11 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:04.909560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-743a9773-cbff-4579-94a4-556daf96ba11 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083461 Jul 14 16:05:04.910811 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 894/1888] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:04 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:05.614818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a901c584-1815-4ac1-b713-acca690373f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:05.615354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a901c584-1815-4ac1-b713-acca690373f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:05.621960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a901c584-1815-4ac1-b713-acca690373f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:05.622401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a901c584-1815-4ac1-b713-acca690373f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:05.623148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a901c584-1815-4ac1-b713-acca690373f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:05.623587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a901c584-1815-4ac1-b713-acca690373f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:05.755137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a901c584-1815-4ac1-b713-acca690373f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:05.763657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a901c584-1815-4ac1-b713-acca690373f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:05.765171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a901c584-1815-4ac1-b713-acca690373f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:05.766347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a901c584-1815-4ac1-b713-acca690373f4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156425 Jul 14 16:05:05.766903 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 995/1889] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:05 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:05.928355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7deaef18-983d-4489-bf0b-bc6e3dbdd8e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:05.928968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7deaef18-983d-4489-bf0b-bc6e3dbdd8e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:05.935411 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7deaef18-983d-4489-bf0b-bc6e3dbdd8e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:05.935892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7deaef18-983d-4489-bf0b-bc6e3dbdd8e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:05.936661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7deaef18-983d-4489-bf0b-bc6e3dbdd8e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:05.937100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7deaef18-983d-4489-bf0b-bc6e3dbdd8e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:05.998616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7deaef18-983d-4489-bf0b-bc6e3dbdd8e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:06.006683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7deaef18-983d-4489-bf0b-bc6e3dbdd8e8 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082972 Jul 14 16:05:06.007248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 895/1890] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:05 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:06.784486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-08192cfa-c936-4976-849e-915bfa2c0efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:06.785441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-08192cfa-c936-4976-849e-915bfa2c0efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:06.791839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08192cfa-c936-4976-849e-915bfa2c0efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:06.792284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08192cfa-c936-4976-849e-915bfa2c0efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:06.793032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08192cfa-c936-4976-849e-915bfa2c0efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:06.793463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08192cfa-c936-4976-849e-915bfa2c0efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:06.930427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-08192cfa-c936-4976-849e-915bfa2c0efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:06.938979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-08192cfa-c936-4976-849e-915bfa2c0efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:06.940708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-08192cfa-c936-4976-849e-915bfa2c0efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:06.942511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-08192cfa-c936-4976-849e-915bfa2c0efc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.161825 Jul 14 16:05:06.943080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 996/1891] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:06 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:07.024437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9f94e029-f7bd-47ef-bf6b-1e9f405d870b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:07.025053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9f94e029-f7bd-47ef-bf6b-1e9f405d870b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:07.031669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f94e029-f7bd-47ef-bf6b-1e9f405d870b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:07.032125 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f94e029-f7bd-47ef-bf6b-1e9f405d870b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:07.032892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f94e029-f7bd-47ef-bf6b-1e9f405d870b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:07.033331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f94e029-f7bd-47ef-bf6b-1e9f405d870b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:07.097019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9f94e029-f7bd-47ef-bf6b-1e9f405d870b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:07.104953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9f94e029-f7bd-47ef-bf6b-1e9f405d870b tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084490 Jul 14 16:05:07.105516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 896/1892] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:07 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:07.961627 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cc0ab575-f896-455e-a94d-07b8942ccb4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:07.962265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cc0ab575-f896-455e-a94d-07b8942ccb4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:07.968768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc0ab575-f896-455e-a94d-07b8942ccb4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:07.969211 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc0ab575-f896-455e-a94d-07b8942ccb4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:07.969956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc0ab575-f896-455e-a94d-07b8942ccb4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:07.970384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cc0ab575-f896-455e-a94d-07b8942ccb4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:08.100209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cc0ab575-f896-455e-a94d-07b8942ccb4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:08.108503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cc0ab575-f896-455e-a94d-07b8942ccb4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:08.109991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cc0ab575-f896-455e-a94d-07b8942ccb4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:08.111152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cc0ab575-f896-455e-a94d-07b8942ccb4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.153519 Jul 14 16:05:08.111734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 997/1893] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:07 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:08.122188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7240b08a-b8c7-4924-a6dd-1b75dc9b207f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:08.122808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7240b08a-b8c7-4924-a6dd-1b75dc9b207f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:08.125140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=56 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:08.131872 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7240b08a-b8c7-4924-a6dd-1b75dc9b207f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:08.132332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7240b08a-b8c7-4924-a6dd-1b75dc9b207f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:08.133111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7240b08a-b8c7-4924-a6dd-1b75dc9b207f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:08.133561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7240b08a-b8c7-4924-a6dd-1b75dc9b207f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:08.197343 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7240b08a-b8c7-4924-a6dd-1b75dc9b207f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:08.204786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7240b08a-b8c7-4924-a6dd-1b75dc9b207f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086504 Jul 14 16:05:08.205401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 897/1894] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:08 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:09.129856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3c1a25a3-06e0-4adc-b1aa-456f1f8c7b5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:09.130457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3c1a25a3-06e0-4adc-b1aa-456f1f8c7b5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:09.137012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3c1a25a3-06e0-4adc-b1aa-456f1f8c7b5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:09.137459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3c1a25a3-06e0-4adc-b1aa-456f1f8c7b5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:09.138203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3c1a25a3-06e0-4adc-b1aa-456f1f8c7b5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:09.138633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3c1a25a3-06e0-4adc-b1aa-456f1f8c7b5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:09.223049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1b2d372e-d51e-4154-8515-6b75bca74a2d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:09.224038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1b2d372e-d51e-4154-8515-6b75bca74a2d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:09.230649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1b2d372e-d51e-4154-8515-6b75bca74a2d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:09.231071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1b2d372e-d51e-4154-8515-6b75bca74a2d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:09.231877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1b2d372e-d51e-4154-8515-6b75bca74a2d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:09.232315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1b2d372e-d51e-4154-8515-6b75bca74a2d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:09.275163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3c1a25a3-06e0-4adc-b1aa-456f1f8c7b5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:09.286229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3c1a25a3-06e0-4adc-b1aa-456f1f8c7b5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:09.288515 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3c1a25a3-06e0-4adc-b1aa-456f1f8c7b5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:09.289699 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3c1a25a3-06e0-4adc-b1aa-456f1f8c7b5a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.163910 Jul 14 16:05:09.290263 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 998/1895] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:09 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:09.299040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1b2d372e-d51e-4154-8515-6b75bca74a2d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:09.307287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1b2d372e-d51e-4154-8515-6b75bca74a2d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088823 Jul 14 16:05:09.307879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 898/1896] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:09 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:10.307945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e6c41fc-0a50-40d6-8942-83de60bc4dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:10.308547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e6c41fc-0a50-40d6-8942-83de60bc4dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:10.315155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e6c41fc-0a50-40d6-8942-83de60bc4dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:10.315613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e6c41fc-0a50-40d6-8942-83de60bc4dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:10.317614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e6c41fc-0a50-40d6-8942-83de60bc4dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:10.318081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e6c41fc-0a50-40d6-8942-83de60bc4dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:10.324179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-27b65982-1191-40f5-b9cc-9c83cf8cbb46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:10.324784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-27b65982-1191-40f5-b9cc-9c83cf8cbb46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:10.331128 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-27b65982-1191-40f5-b9cc-9c83cf8cbb46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:10.331651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-27b65982-1191-40f5-b9cc-9c83cf8cbb46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:10.332422 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-27b65982-1191-40f5-b9cc-9c83cf8cbb46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:10.332852 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-27b65982-1191-40f5-b9cc-9c83cf8cbb46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:10.395311 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-27b65982-1191-40f5-b9cc-9c83cf8cbb46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:10.403241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-27b65982-1191-40f5-b9cc-9c83cf8cbb46 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082791 Jul 14 16:05:10.404661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 899/1897] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:10 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:10.449999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e6c41fc-0a50-40d6-8942-83de60bc4dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:10.458623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e6c41fc-0a50-40d6-8942-83de60bc4dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:10.460134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e6c41fc-0a50-40d6-8942-83de60bc4dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:10.461326 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e6c41fc-0a50-40d6-8942-83de60bc4dc2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.157468 Jul 14 16:05:10.461880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 999/1898] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:10 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:11.422464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dab23913-ae2a-47d2-a55b-62423ecb9df3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:11.423083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dab23913-ae2a-47d2-a55b-62423ecb9df3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:11.429740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dab23913-ae2a-47d2-a55b-62423ecb9df3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:11.430192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dab23913-ae2a-47d2-a55b-62423ecb9df3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:11.430962 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dab23913-ae2a-47d2-a55b-62423ecb9df3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:11.431412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dab23913-ae2a-47d2-a55b-62423ecb9df3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:11.480084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-032ec7fb-dc80-4f98-beb3-2fcf962aee63 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:11.480797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-032ec7fb-dc80-4f98-beb3-2fcf962aee63 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:11.488227 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-032ec7fb-dc80-4f98-beb3-2fcf962aee63 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:11.488819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-032ec7fb-dc80-4f98-beb3-2fcf962aee63 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:11.489604 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-032ec7fb-dc80-4f98-beb3-2fcf962aee63 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:11.490043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-032ec7fb-dc80-4f98-beb3-2fcf962aee63 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:11.496997 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-dab23913-ae2a-47d2-a55b-62423ecb9df3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:11.505308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dab23913-ae2a-47d2-a55b-62423ecb9df3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086758 Jul 14 16:05:11.505880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 900/1899] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:11 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:11.623522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-032ec7fb-dc80-4f98-beb3-2fcf962aee63 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:11.632568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-032ec7fb-dc80-4f98-beb3-2fcf962aee63 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:11.634069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-032ec7fb-dc80-4f98-beb3-2fcf962aee63 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:11.635265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-032ec7fb-dc80-4f98-beb3-2fcf962aee63 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.159134 Jul 14 16:05:11.635852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1000/1900] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:11 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:05:12.522085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-62cab620-11e9-4b33-ac3f-cc21a41b70c7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:12.522681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-62cab620-11e9-4b33-ac3f-cc21a41b70c7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:12.529100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62cab620-11e9-4b33-ac3f-cc21a41b70c7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:12.529551 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62cab620-11e9-4b33-ac3f-cc21a41b70c7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:12.530305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62cab620-11e9-4b33-ac3f-cc21a41b70c7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:12.530736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62cab620-11e9-4b33-ac3f-cc21a41b70c7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:12.593229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-62cab620-11e9-4b33-ac3f-cc21a41b70c7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:12.601609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-62cab620-11e9-4b33-ac3f-cc21a41b70c7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083490 Jul 14 16:05:12.602188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 901/1901] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:12 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:12.653397 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c390e6ec-dafb-4a59-b86a-1c0d45c5f733 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:12.654011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c390e6ec-dafb-4a59-b86a-1c0d45c5f733 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:12.661193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c390e6ec-dafb-4a59-b86a-1c0d45c5f733 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:12.661642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c390e6ec-dafb-4a59-b86a-1c0d45c5f733 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:12.662409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c390e6ec-dafb-4a59-b86a-1c0d45c5f733 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:12.663110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c390e6ec-dafb-4a59-b86a-1c0d45c5f733 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:12.791858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c390e6ec-dafb-4a59-b86a-1c0d45c5f733 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:12.800117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c390e6ec-dafb-4a59-b86a-1c0d45c5f733 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:12.802194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c390e6ec-dafb-4a59-b86a-1c0d45c5f733 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:12.803367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c390e6ec-dafb-4a59-b86a-1c0d45c5f733 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.153901 Jul 14 16:05:12.803944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1001/1902] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:12 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:13.619259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9ac86754-38cf-4b22-b787-a72f480209d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:13.619842 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9ac86754-38cf-4b22-b787-a72f480209d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:13.626302 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9ac86754-38cf-4b22-b787-a72f480209d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:13.626749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9ac86754-38cf-4b22-b787-a72f480209d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:13.627573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9ac86754-38cf-4b22-b787-a72f480209d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:13.628034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9ac86754-38cf-4b22-b787-a72f480209d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:13.690527 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9ac86754-38cf-4b22-b787-a72f480209d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:13.698943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9ac86754-38cf-4b22-b787-a72f480209d5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083514 Jul 14 16:05:13.699521 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 902/1903] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:13 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:13.822782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-96d46f0d-4497-478d-a436-1fdb2d4f3b8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:13.823391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-96d46f0d-4497-478d-a436-1fdb2d4f3b8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:13.829879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96d46f0d-4497-478d-a436-1fdb2d4f3b8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:13.830330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96d46f0d-4497-478d-a436-1fdb2d4f3b8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:13.831085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96d46f0d-4497-478d-a436-1fdb2d4f3b8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:13.832633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96d46f0d-4497-478d-a436-1fdb2d4f3b8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:13.962692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-96d46f0d-4497-478d-a436-1fdb2d4f3b8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:13.971172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-96d46f0d-4497-478d-a436-1fdb2d4f3b8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:13.973533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-96d46f0d-4497-478d-a436-1fdb2d4f3b8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:13.974706 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-96d46f0d-4497-478d-a436-1fdb2d4f3b8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.155975 Jul 14 16:05:13.975272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1002/1904] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:13 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:14.718900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-278711a6-ce87-41e7-974a-973b95cd2007 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:14.719524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-278711a6-ce87-41e7-974a-973b95cd2007 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:14.726170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-278711a6-ce87-41e7-974a-973b95cd2007 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:14.726628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-278711a6-ce87-41e7-974a-973b95cd2007 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:14.727394 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-278711a6-ce87-41e7-974a-973b95cd2007 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:14.727871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-278711a6-ce87-41e7-974a-973b95cd2007 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:14.799419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-278711a6-ce87-41e7-974a-973b95cd2007 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:14.807664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-278711a6-ce87-41e7-974a-973b95cd2007 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.092646 Jul 14 16:05:14.808221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 903/1905] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:14 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:14.995742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ad02767e-5333-4c22-99c2-f43f9d615ac7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:14.996634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ad02767e-5333-4c22-99c2-f43f9d615ac7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:15.004370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad02767e-5333-4c22-99c2-f43f9d615ac7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:15.004835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad02767e-5333-4c22-99c2-f43f9d615ac7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:15.005602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad02767e-5333-4c22-99c2-f43f9d615ac7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:15.006041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad02767e-5333-4c22-99c2-f43f9d615ac7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:15.135305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ad02767e-5333-4c22-99c2-f43f9d615ac7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:15.143774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ad02767e-5333-4c22-99c2-f43f9d615ac7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:15.145464 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ad02767e-5333-4c22-99c2-f43f9d615ac7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:15.146640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ad02767e-5333-4c22-99c2-f43f9d615ac7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.157320 Jul 14 16:05:15.147199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1003/1906] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:14 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:15.825654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-edffcdfa-b631-4c89-bb2a-8d2c43b0d667 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:15.826275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-edffcdfa-b631-4c89-bb2a-8d2c43b0d667 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:15.832908 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-edffcdfa-b631-4c89-bb2a-8d2c43b0d667 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:15.833366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-edffcdfa-b631-4c89-bb2a-8d2c43b0d667 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:15.834139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-edffcdfa-b631-4c89-bb2a-8d2c43b0d667 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:15.834582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-edffcdfa-b631-4c89-bb2a-8d2c43b0d667 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:15.838509 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:15.900309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-edffcdfa-b631-4c89-bb2a-8d2c43b0d667 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:15.907685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-edffcdfa-b631-4c89-bb2a-8d2c43b0d667 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085890 Jul 14 16:05:15.908267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 904/1907] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:15 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:16.166536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-29857692-b6f8-4934-b2db-50027c9994a1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:16.167156 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-29857692-b6f8-4934-b2db-50027c9994a1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:16.174116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29857692-b6f8-4934-b2db-50027c9994a1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:16.174620 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29857692-b6f8-4934-b2db-50027c9994a1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:16.176124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29857692-b6f8-4934-b2db-50027c9994a1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:16.176663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29857692-b6f8-4934-b2db-50027c9994a1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:16.318224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-29857692-b6f8-4934-b2db-50027c9994a1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:16.327866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-29857692-b6f8-4934-b2db-50027c9994a1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:16.329368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-29857692-b6f8-4934-b2db-50027c9994a1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:16.330544 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-29857692-b6f8-4934-b2db-50027c9994a1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.168293 Jul 14 16:05:16.331107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1004/1908] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:16 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:16.926653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fdd2716f-7ca9-4815-8278-5378ff6de909 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:16.927241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fdd2716f-7ca9-4815-8278-5378ff6de909 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:16.933644 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdd2716f-7ca9-4815-8278-5378ff6de909 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:16.934092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdd2716f-7ca9-4815-8278-5378ff6de909 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:16.934845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdd2716f-7ca9-4815-8278-5378ff6de909 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:16.935277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fdd2716f-7ca9-4815-8278-5378ff6de909 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:17.002419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fdd2716f-7ca9-4815-8278-5378ff6de909 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:17.010791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fdd2716f-7ca9-4815-8278-5378ff6de909 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088697 Jul 14 16:05:17.011334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 905/1909] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:16 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:17.349868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c9ff06ce-4764-417f-8064-2cfe70f1f7ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:17.350432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c9ff06ce-4764-417f-8064-2cfe70f1f7ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:17.357425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c9ff06ce-4764-417f-8064-2cfe70f1f7ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:17.357890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c9ff06ce-4764-417f-8064-2cfe70f1f7ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:17.358668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c9ff06ce-4764-417f-8064-2cfe70f1f7ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:17.359107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c9ff06ce-4764-417f-8064-2cfe70f1f7ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:17.495212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c9ff06ce-4764-417f-8064-2cfe70f1f7ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:17.503609 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c9ff06ce-4764-417f-8064-2cfe70f1f7ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:17.505122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c9ff06ce-4764-417f-8064-2cfe70f1f7ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:17.506290 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c9ff06ce-4764-417f-8064-2cfe70f1f7ba tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.161173 Jul 14 16:05:17.506849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1005/1910] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:17 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:18.027838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9e39a90f-1334-4d37-bc8d-cd83dfda09e2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:18.028457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9e39a90f-1334-4d37-bc8d-cd83dfda09e2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:18.034915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e39a90f-1334-4d37-bc8d-cd83dfda09e2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:18.035834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e39a90f-1334-4d37-bc8d-cd83dfda09e2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:18.036608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e39a90f-1334-4d37-bc8d-cd83dfda09e2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:18.037051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e39a90f-1334-4d37-bc8d-cd83dfda09e2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:18.098575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9e39a90f-1334-4d37-bc8d-cd83dfda09e2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:18.105971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9e39a90f-1334-4d37-bc8d-cd83dfda09e2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082101 Jul 14 16:05:18.106534 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 906/1911] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:18 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:18.524678 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f5f1c763-ff07-4690-bd0f-3074699f4204 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:18.525293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f5f1c763-ff07-4690-bd0f-3074699f4204 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:18.531822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5f1c763-ff07-4690-bd0f-3074699f4204 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:18.532273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5f1c763-ff07-4690-bd0f-3074699f4204 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:18.533028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5f1c763-ff07-4690-bd0f-3074699f4204 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:18.533462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5f1c763-ff07-4690-bd0f-3074699f4204 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:18.665526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f5f1c763-ff07-4690-bd0f-3074699f4204 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:18.673967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f5f1c763-ff07-4690-bd0f-3074699f4204 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:18.676586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f5f1c763-ff07-4690-bd0f-3074699f4204 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:18.678670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f5f1c763-ff07-4690-bd0f-3074699f4204 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.157640 Jul 14 16:05:18.679246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1006/1912] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:18 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:19.122788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b9a5d25a-a8e5-4d5d-ba57-abee4e6dfe20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:19.123398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b9a5d25a-a8e5-4d5d-ba57-abee4e6dfe20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:19.129888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b9a5d25a-a8e5-4d5d-ba57-abee4e6dfe20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:19.130335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b9a5d25a-a8e5-4d5d-ba57-abee4e6dfe20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:19.131090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b9a5d25a-a8e5-4d5d-ba57-abee4e6dfe20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:19.131527 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b9a5d25a-a8e5-4d5d-ba57-abee4e6dfe20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:19.193511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b9a5d25a-a8e5-4d5d-ba57-abee4e6dfe20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:19.201255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b9a5d25a-a8e5-4d5d-ba57-abee4e6dfe20 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082380 Jul 14 16:05:19.201826 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 907/1913] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:19 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:19.697787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c31b4658-c30e-499d-a73a-d24609e0767b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:19.698390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c31b4658-c30e-499d-a73a-d24609e0767b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:19.704911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c31b4658-c30e-499d-a73a-d24609e0767b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:19.705357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c31b4658-c30e-499d-a73a-d24609e0767b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:19.706617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c31b4658-c30e-499d-a73a-d24609e0767b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:19.707077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c31b4658-c30e-499d-a73a-d24609e0767b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:19.838808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c31b4658-c30e-499d-a73a-d24609e0767b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:19.847813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c31b4658-c30e-499d-a73a-d24609e0767b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:19.849322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c31b4658-c30e-499d-a73a-d24609e0767b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:19.850485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c31b4658-c30e-499d-a73a-d24609e0767b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156641 Jul 14 16:05:19.851044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1007/1914] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:19 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:20.218664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-159c0575-4527-437a-8ecc-7f24123d4f6f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:20.219308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-159c0575-4527-437a-8ecc-7f24123d4f6f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:20.225961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-159c0575-4527-437a-8ecc-7f24123d4f6f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:20.226416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-159c0575-4527-437a-8ecc-7f24123d4f6f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:20.227207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-159c0575-4527-437a-8ecc-7f24123d4f6f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:20.227671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-159c0575-4527-437a-8ecc-7f24123d4f6f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:20.291279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-159c0575-4527-437a-8ecc-7f24123d4f6f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:20.298680 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-159c0575-4527-437a-8ecc-7f24123d4f6f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083903 Jul 14 16:05:20.299228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 908/1915] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:20 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:20.870353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-497a7108-bdfb-4102-a927-d98d2ef60e59 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:20.870996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-497a7108-bdfb-4102-a927-d98d2ef60e59 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:20.877518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-497a7108-bdfb-4102-a927-d98d2ef60e59 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:20.877966 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-497a7108-bdfb-4102-a927-d98d2ef60e59 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:20.878809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-497a7108-bdfb-4102-a927-d98d2ef60e59 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:20.879250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-497a7108-bdfb-4102-a927-d98d2ef60e59 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:21.009702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-497a7108-bdfb-4102-a927-d98d2ef60e59 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:21.018136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-497a7108-bdfb-4102-a927-d98d2ef60e59 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:21.019750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-497a7108-bdfb-4102-a927-d98d2ef60e59 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:21.020923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-497a7108-bdfb-4102-a927-d98d2ef60e59 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.155516 Jul 14 16:05:21.021486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1008/1916] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:05:21.316285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7a7518ef-34ce-435e-a78c-04850be313d9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:21.317306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7a7518ef-34ce-435e-a78c-04850be313d9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:21.323549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a7518ef-34ce-435e-a78c-04850be313d9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:21.324030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a7518ef-34ce-435e-a78c-04850be313d9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:21.324784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a7518ef-34ce-435e-a78c-04850be313d9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:21.325220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a7518ef-34ce-435e-a78c-04850be313d9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:21.386953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7a7518ef-34ce-435e-a78c-04850be313d9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:21.394722 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7a7518ef-34ce-435e-a78c-04850be313d9 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082957 Jul 14 16:05:21.395279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 909/1917] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:21 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:22.039174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7619a872-82a7-49d7-b9f6-d1356b100a45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:22.039798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7619a872-82a7-49d7-b9f6-d1356b100a45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:22.046197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7619a872-82a7-49d7-b9f6-d1356b100a45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:22.046640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7619a872-82a7-49d7-b9f6-d1356b100a45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:22.047385 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7619a872-82a7-49d7-b9f6-d1356b100a45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:22.047850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7619a872-82a7-49d7-b9f6-d1356b100a45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:22.177216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7619a872-82a7-49d7-b9f6-d1356b100a45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:22.185498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7619a872-82a7-49d7-b9f6-d1356b100a45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:22.186973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7619a872-82a7-49d7-b9f6-d1356b100a45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:22.188153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7619a872-82a7-49d7-b9f6-d1356b100a45 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.153091 Jul 14 16:05:22.188701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1009/1918] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:22 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:22.412138 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-60252bef-0372-422f-9def-50bc5754a666 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:22.413012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-60252bef-0372-422f-9def-50bc5754a666 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:22.419522 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-60252bef-0372-422f-9def-50bc5754a666 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:22.420010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-60252bef-0372-422f-9def-50bc5754a666 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:22.420808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-60252bef-0372-422f-9def-50bc5754a666 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:22.421252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-60252bef-0372-422f-9def-50bc5754a666 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:22.492017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-60252bef-0372-422f-9def-50bc5754a666 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:22.499501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-60252bef-0372-422f-9def-50bc5754a666 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.091981 Jul 14 16:05:22.500109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 910/1919] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:22 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:23.206407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-59a700c2-7aaa-4b26-9b67-13b29001111c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:23.207087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-59a700c2-7aaa-4b26-9b67-13b29001111c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:23.213551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59a700c2-7aaa-4b26-9b67-13b29001111c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:23.214000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59a700c2-7aaa-4b26-9b67-13b29001111c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:23.214763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59a700c2-7aaa-4b26-9b67-13b29001111c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:23.215199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59a700c2-7aaa-4b26-9b67-13b29001111c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:23.346610 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-59a700c2-7aaa-4b26-9b67-13b29001111c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:23.355922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-59a700c2-7aaa-4b26-9b67-13b29001111c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:23.357394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-59a700c2-7aaa-4b26-9b67-13b29001111c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:23.358575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-59a700c2-7aaa-4b26-9b67-13b29001111c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156100 Jul 14 16:05:23.359128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1010/1920] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:23 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:23.516224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e2197754-98a7-40a5-b047-206dda236545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:23.516836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e2197754-98a7-40a5-b047-206dda236545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:23.524285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e2197754-98a7-40a5-b047-206dda236545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:23.524733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e2197754-98a7-40a5-b047-206dda236545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:23.525500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e2197754-98a7-40a5-b047-206dda236545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:23.525936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e2197754-98a7-40a5-b047-206dda236545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:23.586633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e2197754-98a7-40a5-b047-206dda236545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:23.594101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e2197754-98a7-40a5-b047-206dda236545 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081744 Jul 14 16:05:23.594662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 911/1921] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:23 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:24.377337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7505a135-d6fd-4fe5-bd58-6a513ec8bd79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:24.378575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7505a135-d6fd-4fe5-bd58-6a513ec8bd79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:24.385114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7505a135-d6fd-4fe5-bd58-6a513ec8bd79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:24.385565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7505a135-d6fd-4fe5-bd58-6a513ec8bd79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:24.386323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7505a135-d6fd-4fe5-bd58-6a513ec8bd79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:24.386760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7505a135-d6fd-4fe5-bd58-6a513ec8bd79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:24.406165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:24.518942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7505a135-d6fd-4fe5-bd58-6a513ec8bd79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:24.527442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7505a135-d6fd-4fe5-bd58-6a513ec8bd79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:24.529034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7505a135-d6fd-4fe5-bd58-6a513ec8bd79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:24.530182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7505a135-d6fd-4fe5-bd58-6a513ec8bd79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156758 Jul 14 16:05:24.530731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1011/1922] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:24 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:24.612157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b567334f-a772-4321-b790-a5fa5f10affd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:24.613509 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b567334f-a772-4321-b790-a5fa5f10affd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:24.620069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b567334f-a772-4321-b790-a5fa5f10affd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:24.620531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b567334f-a772-4321-b790-a5fa5f10affd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:24.621296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b567334f-a772-4321-b790-a5fa5f10affd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:24.621754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b567334f-a772-4321-b790-a5fa5f10affd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:24.686088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b567334f-a772-4321-b790-a5fa5f10affd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:24.693778 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b567334f-a772-4321-b790-a5fa5f10affd tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085742 Jul 14 16:05:24.694342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 912/1923] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:24 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:25.548578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d6c1608b-60fc-4cae-8d9e-1fcc35fc3577 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:25.549173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d6c1608b-60fc-4cae-8d9e-1fcc35fc3577 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:25.556537 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6c1608b-60fc-4cae-8d9e-1fcc35fc3577 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:25.556981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6c1608b-60fc-4cae-8d9e-1fcc35fc3577 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:25.557726 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6c1608b-60fc-4cae-8d9e-1fcc35fc3577 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:25.558153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6c1608b-60fc-4cae-8d9e-1fcc35fc3577 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:25.690770 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d6c1608b-60fc-4cae-8d9e-1fcc35fc3577 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:25.699195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d6c1608b-60fc-4cae-8d9e-1fcc35fc3577 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:25.700724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d6c1608b-60fc-4cae-8d9e-1fcc35fc3577 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:25.701890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d6c1608b-60fc-4cae-8d9e-1fcc35fc3577 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.157228 Jul 14 16:05:25.702441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1012/1924] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:25 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:25.711346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0fc589df-d7ac-44e9-9696-e3c0525f1883 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:25.712026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0fc589df-d7ac-44e9-9696-e3c0525f1883 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:25.717960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0fc589df-d7ac-44e9-9696-e3c0525f1883 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:25.718414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0fc589df-d7ac-44e9-9696-e3c0525f1883 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:25.719187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0fc589df-d7ac-44e9-9696-e3c0525f1883 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:25.719656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0fc589df-d7ac-44e9-9696-e3c0525f1883 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:25.781929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0fc589df-d7ac-44e9-9696-e3c0525f1883 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:25.790326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0fc589df-d7ac-44e9-9696-e3c0525f1883 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084068 Jul 14 16:05:25.790892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 913/1925] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:25 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:26.720593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b681f394-abda-490e-a9dd-bcc5e61e6a82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:26.721236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b681f394-abda-490e-a9dd-bcc5e61e6a82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:26.728563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b681f394-abda-490e-a9dd-bcc5e61e6a82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:26.729040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b681f394-abda-490e-a9dd-bcc5e61e6a82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:26.729811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b681f394-abda-490e-a9dd-bcc5e61e6a82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:26.730254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b681f394-abda-490e-a9dd-bcc5e61e6a82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:26.806805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-55a9dd70-d7e8-430d-935e-2ef8ffac7092 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:26.807649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-55a9dd70-d7e8-430d-935e-2ef8ffac7092 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:26.814041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55a9dd70-d7e8-430d-935e-2ef8ffac7092 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:26.814488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55a9dd70-d7e8-430d-935e-2ef8ffac7092 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:26.815251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55a9dd70-d7e8-430d-935e-2ef8ffac7092 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:26.815734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55a9dd70-d7e8-430d-935e-2ef8ffac7092 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:26.863772 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b681f394-abda-490e-a9dd-bcc5e61e6a82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:26.872161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b681f394-abda-490e-a9dd-bcc5e61e6a82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:26.873639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b681f394-abda-490e-a9dd-bcc5e61e6a82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:26.874802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b681f394-abda-490e-a9dd-bcc5e61e6a82 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158210 Jul 14 16:05:26.875361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1013/1926] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:26 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:26.876385 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-55a9dd70-d7e8-430d-935e-2ef8ffac7092 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:26.884578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-55a9dd70-d7e8-430d-935e-2ef8ffac7092 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081586 Jul 14 16:05:26.885150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 914/1927] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:26 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:27.894584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-af617e2a-36c9-4e50-b0ec-34b00370bed5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:27.895180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-af617e2a-36c9-4e50-b0ec-34b00370bed5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:27.901032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-88e96ec3-a0f0-40d0-b1c4-53493e7f55da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:27.901642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-88e96ec3-a0f0-40d0-b1c4-53493e7f55da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:27.901774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-af617e2a-36c9-4e50-b0ec-34b00370bed5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:27.902180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-af617e2a-36c9-4e50-b0ec-34b00370bed5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:27.902946 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-af617e2a-36c9-4e50-b0ec-34b00370bed5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:27.903381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-af617e2a-36c9-4e50-b0ec-34b00370bed5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:27.907703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-88e96ec3-a0f0-40d0-b1c4-53493e7f55da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:27.908154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-88e96ec3-a0f0-40d0-b1c4-53493e7f55da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:27.908917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-88e96ec3-a0f0-40d0-b1c4-53493e7f55da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:27.909548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-88e96ec3-a0f0-40d0-b1c4-53493e7f55da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:27.971259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-88e96ec3-a0f0-40d0-b1c4-53493e7f55da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:27.978906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-88e96ec3-a0f0-40d0-b1c4-53493e7f55da tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081720 Jul 14 16:05:27.979475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 915/1928] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:27 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:28.038270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-af617e2a-36c9-4e50-b0ec-34b00370bed5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:28.046655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-af617e2a-36c9-4e50-b0ec-34b00370bed5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:28.048185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-af617e2a-36c9-4e50-b0ec-34b00370bed5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:28.049378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-af617e2a-36c9-4e50-b0ec-34b00370bed5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.159380 Jul 14 16:05:28.050930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1014/1929] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:28.996609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-85e26ed2-3fd6-4b48-aef5-b81527bab280 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:28.997226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-85e26ed2-3fd6-4b48-aef5-b81527bab280 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:29.004004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85e26ed2-3fd6-4b48-aef5-b81527bab280 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:29.004454 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85e26ed2-3fd6-4b48-aef5-b81527bab280 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:29.005226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85e26ed2-3fd6-4b48-aef5-b81527bab280 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:29.005662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85e26ed2-3fd6-4b48-aef5-b81527bab280 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:29.070010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-85e26ed2-3fd6-4b48-aef5-b81527bab280 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:29.070564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b8d7be91-5110-4aba-97f1-9ead69f08eef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:29.071194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b8d7be91-5110-4aba-97f1-9ead69f08eef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:29.077639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-85e26ed2-3fd6-4b48-aef5-b81527bab280 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084932 Jul 14 16:05:29.077807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8d7be91-5110-4aba-97f1-9ead69f08eef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:29.078198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 916/1930] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:28 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:29.078812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8d7be91-5110-4aba-97f1-9ead69f08eef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:29.079703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8d7be91-5110-4aba-97f1-9ead69f08eef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:29.080173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b8d7be91-5110-4aba-97f1-9ead69f08eef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:29.210207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b8d7be91-5110-4aba-97f1-9ead69f08eef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:29.218549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b8d7be91-5110-4aba-97f1-9ead69f08eef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:29.220053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b8d7be91-5110-4aba-97f1-9ead69f08eef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:29.221220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b8d7be91-5110-4aba-97f1-9ead69f08eef tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156454 Jul 14 16:05:29.221904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1015/1931] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:29 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:30.095142 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-045fb261-8053-4c70-9547-ebd84af1e736 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:30.095793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-045fb261-8053-4c70-9547-ebd84af1e736 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:30.103032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-045fb261-8053-4c70-9547-ebd84af1e736 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:30.103475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-045fb261-8053-4c70-9547-ebd84af1e736 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:30.104271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-045fb261-8053-4c70-9547-ebd84af1e736 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:30.104708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-045fb261-8053-4c70-9547-ebd84af1e736 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:30.167285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-045fb261-8053-4c70-9547-ebd84af1e736 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:30.174664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-045fb261-8053-4c70-9547-ebd84af1e736 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083617 Jul 14 16:05:30.175963 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 917/1932] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:30 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:30.239736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-75d75934-516d-41e7-8b27-9993782cba26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:30.240412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-75d75934-516d-41e7-8b27-9993782cba26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:30.242827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=52 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:30.248426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-75d75934-516d-41e7-8b27-9993782cba26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:30.248819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-75d75934-516d-41e7-8b27-9993782cba26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:30.249586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-75d75934-516d-41e7-8b27-9993782cba26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:30.250028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-75d75934-516d-41e7-8b27-9993782cba26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:30.379286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-75d75934-516d-41e7-8b27-9993782cba26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:30.387686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-75d75934-516d-41e7-8b27-9993782cba26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:30.389170 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-75d75934-516d-41e7-8b27-9993782cba26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:30.390318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-75d75934-516d-41e7-8b27-9993782cba26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.154664 Jul 14 16:05:30.390869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1016/1933] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:30 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:31.193179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-601df65b-d960-405c-a041-e83e537a71f7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:31.193795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-601df65b-d960-405c-a041-e83e537a71f7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:31.200321 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-601df65b-d960-405c-a041-e83e537a71f7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:31.200755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-601df65b-d960-405c-a041-e83e537a71f7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:31.201513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-601df65b-d960-405c-a041-e83e537a71f7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:31.201953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-601df65b-d960-405c-a041-e83e537a71f7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:31.263424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-601df65b-d960-405c-a041-e83e537a71f7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:31.272224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-601df65b-d960-405c-a041-e83e537a71f7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083951 Jul 14 16:05:31.272797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 918/1934] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:31 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:31.409068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6f9b3613-04df-4c24-abfa-400193f2e5ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:31.409968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6f9b3613-04df-4c24-abfa-400193f2e5ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:31.416447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6f9b3613-04df-4c24-abfa-400193f2e5ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:31.416899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6f9b3613-04df-4c24-abfa-400193f2e5ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:31.417658 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6f9b3613-04df-4c24-abfa-400193f2e5ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:31.418100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6f9b3613-04df-4c24-abfa-400193f2e5ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:31.552102 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6f9b3613-04df-4c24-abfa-400193f2e5ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:31.560443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6f9b3613-04df-4c24-abfa-400193f2e5ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:31.561916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6f9b3613-04df-4c24-abfa-400193f2e5ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:31.563065 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6f9b3613-04df-4c24-abfa-400193f2e5ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158063 Jul 14 16:05:31.563635 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1017/1935] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:31 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:32.290265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8e62b5d2-2df0-4835-91ad-8f0a102e4c7c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:32.290815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8e62b5d2-2df0-4835-91ad-8f0a102e4c7c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:32.297508 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e62b5d2-2df0-4835-91ad-8f0a102e4c7c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:32.297952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e62b5d2-2df0-4835-91ad-8f0a102e4c7c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:32.298720 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e62b5d2-2df0-4835-91ad-8f0a102e4c7c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:32.299158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e62b5d2-2df0-4835-91ad-8f0a102e4c7c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:32.360182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8e62b5d2-2df0-4835-91ad-8f0a102e4c7c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:32.368475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8e62b5d2-2df0-4835-91ad-8f0a102e4c7c tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082482 Jul 14 16:05:32.369032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 919/1936] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:32 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:32.583332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-93796a41-6431-45a2-91dd-8977b9feeb97 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:32.583950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-93796a41-6431-45a2-91dd-8977b9feeb97 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:32.590456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93796a41-6431-45a2-91dd-8977b9feeb97 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:32.590908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93796a41-6431-45a2-91dd-8977b9feeb97 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:32.591752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93796a41-6431-45a2-91dd-8977b9feeb97 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:32.592197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93796a41-6431-45a2-91dd-8977b9feeb97 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:32.722560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-93796a41-6431-45a2-91dd-8977b9feeb97 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:32.730881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-93796a41-6431-45a2-91dd-8977b9feeb97 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:32.732400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-93796a41-6431-45a2-91dd-8977b9feeb97 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:32.733558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-93796a41-6431-45a2-91dd-8977b9feeb97 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.154916 Jul 14 16:05:32.734107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1018/1937] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:33.385093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a69570cf-0b61-4fd4-b4c7-46eb318f2184 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:33.385642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a69570cf-0b61-4fd4-b4c7-46eb318f2184 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:33.392179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a69570cf-0b61-4fd4-b4c7-46eb318f2184 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:33.392635 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a69570cf-0b61-4fd4-b4c7-46eb318f2184 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:33.393919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a69570cf-0b61-4fd4-b4c7-46eb318f2184 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:33.394352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a69570cf-0b61-4fd4-b4c7-46eb318f2184 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:33.457746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a69570cf-0b61-4fd4-b4c7-46eb318f2184 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:33.461117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:33.465864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a69570cf-0b61-4fd4-b4c7-46eb318f2184 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084682 Jul 14 16:05:33.466426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 920/1938] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:33 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:33.754504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-93038ecd-34f2-42fd-b515-d43f58cb7bff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:33.755095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-93038ecd-34f2-42fd-b515-d43f58cb7bff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:33.761140 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93038ecd-34f2-42fd-b515-d43f58cb7bff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:33.761599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93038ecd-34f2-42fd-b515-d43f58cb7bff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:33.762329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93038ecd-34f2-42fd-b515-d43f58cb7bff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:33.762758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-93038ecd-34f2-42fd-b515-d43f58cb7bff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:33.894324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-93038ecd-34f2-42fd-b515-d43f58cb7bff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:33.902648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-93038ecd-34f2-42fd-b515-d43f58cb7bff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:33.904169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-93038ecd-34f2-42fd-b515-d43f58cb7bff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:33.905356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-93038ecd-34f2-42fd-b515-d43f58cb7bff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.155644 Jul 14 16:05:33.905913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1019/1939] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:33 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:05:34.483590 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dc21a102-3c13-4f09-893e-d590e556b2b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:34.484217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dc21a102-3c13-4f09-893e-d590e556b2b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:34.490770 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc21a102-3c13-4f09-893e-d590e556b2b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:34.491213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc21a102-3c13-4f09-893e-d590e556b2b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:34.492001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc21a102-3c13-4f09-893e-d590e556b2b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:34.492437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dc21a102-3c13-4f09-893e-d590e556b2b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:34.553361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-dc21a102-3c13-4f09-893e-d590e556b2b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:34.560812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dc21a102-3c13-4f09-893e-d590e556b2b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081273 Jul 14 16:05:34.561371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 921/1940] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:34 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:34.924019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1842b2d1-e0cd-471c-9990-8a9f04dd24c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:34.925119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1842b2d1-e0cd-471c-9990-8a9f04dd24c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:34.931584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1842b2d1-e0cd-471c-9990-8a9f04dd24c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:34.932057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1842b2d1-e0cd-471c-9990-8a9f04dd24c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:34.932808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1842b2d1-e0cd-471c-9990-8a9f04dd24c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:34.933239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1842b2d1-e0cd-471c-9990-8a9f04dd24c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:35.062498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1842b2d1-e0cd-471c-9990-8a9f04dd24c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:35.071224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1842b2d1-e0cd-471c-9990-8a9f04dd24c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:35.072749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1842b2d1-e0cd-471c-9990-8a9f04dd24c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:35.073991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1842b2d1-e0cd-471c-9990-8a9f04dd24c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.154042 Jul 14 16:05:35.074554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1020/1941] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:34 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:35.581696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4391b1e9-6462-41e4-8f65-31d0478d5e08 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:35.582322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4391b1e9-6462-41e4-8f65-31d0478d5e08 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:35.588820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4391b1e9-6462-41e4-8f65-31d0478d5e08 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:35.589265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4391b1e9-6462-41e4-8f65-31d0478d5e08 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:35.590134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4391b1e9-6462-41e4-8f65-31d0478d5e08 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:35.590558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4391b1e9-6462-41e4-8f65-31d0478d5e08 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:35.651082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4391b1e9-6462-41e4-8f65-31d0478d5e08 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:35.658691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4391b1e9-6462-41e4-8f65-31d0478d5e08 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081398 Jul 14 16:05:35.659926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 922/1942] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:35 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:36.092074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-062178a0-2c83-4fcc-89f6-3a299c4d685f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:36.092676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-062178a0-2c83-4fcc-89f6-3a299c4d685f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:36.099280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-062178a0-2c83-4fcc-89f6-3a299c4d685f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:36.099762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-062178a0-2c83-4fcc-89f6-3a299c4d685f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:36.100512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-062178a0-2c83-4fcc-89f6-3a299c4d685f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:36.100943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-062178a0-2c83-4fcc-89f6-3a299c4d685f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:36.227788 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-062178a0-2c83-4fcc-89f6-3a299c4d685f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:36.240188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-062178a0-2c83-4fcc-89f6-3a299c4d685f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:36.242884 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-062178a0-2c83-4fcc-89f6-3a299c4d685f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:36.244568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-062178a0-2c83-4fcc-89f6-3a299c4d685f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156356 Jul 14 16:05:36.245127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1021/1943] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:36 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:36.677926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9249f03d-9e7a-43fa-b04f-b8daa95931d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:36.678862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9249f03d-9e7a-43fa-b04f-b8daa95931d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:36.688189 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9249f03d-9e7a-43fa-b04f-b8daa95931d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:36.688635 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9249f03d-9e7a-43fa-b04f-b8daa95931d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:36.689395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9249f03d-9e7a-43fa-b04f-b8daa95931d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:36.689826 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9249f03d-9e7a-43fa-b04f-b8daa95931d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:36.753153 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9249f03d-9e7a-43fa-b04f-b8daa95931d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:36.760763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9249f03d-9e7a-43fa-b04f-b8daa95931d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087883 Jul 14 16:05:36.761326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 923/1944] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:36 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:37.269024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0809abf1-54f7-4fc9-b2bf-da4762e227b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:37.269579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0809abf1-54f7-4fc9-b2bf-da4762e227b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:37.276185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0809abf1-54f7-4fc9-b2bf-da4762e227b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:37.276637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0809abf1-54f7-4fc9-b2bf-da4762e227b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:37.277407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0809abf1-54f7-4fc9-b2bf-da4762e227b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:37.277844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0809abf1-54f7-4fc9-b2bf-da4762e227b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:37.411033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0809abf1-54f7-4fc9-b2bf-da4762e227b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:37.419634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0809abf1-54f7-4fc9-b2bf-da4762e227b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:37.421146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0809abf1-54f7-4fc9-b2bf-da4762e227b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:37.422375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0809abf1-54f7-4fc9-b2bf-da4762e227b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.157422 Jul 14 16:05:37.422930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1022/1945] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:37 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:37.778556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fd2dda90-1284-4eba-ab9f-e18024fc822d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:37.779169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fd2dda90-1284-4eba-ab9f-e18024fc822d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:37.786866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd2dda90-1284-4eba-ab9f-e18024fc822d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:37.787317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd2dda90-1284-4eba-ab9f-e18024fc822d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:37.788372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd2dda90-1284-4eba-ab9f-e18024fc822d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:37.788810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd2dda90-1284-4eba-ab9f-e18024fc822d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:37.852612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fd2dda90-1284-4eba-ab9f-e18024fc822d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:37.859973 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fd2dda90-1284-4eba-ab9f-e18024fc822d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085410 Jul 14 16:05:37.860530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 924/1946] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:37 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:38.441949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6a2e071b-c545-4fb3-96c2-4e662590b457 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:38.442547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6a2e071b-c545-4fb3-96c2-4e662590b457 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:38.449093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a2e071b-c545-4fb3-96c2-4e662590b457 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:38.449540 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a2e071b-c545-4fb3-96c2-4e662590b457 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:38.450280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a2e071b-c545-4fb3-96c2-4e662590b457 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:38.450704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a2e071b-c545-4fb3-96c2-4e662590b457 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:38.582224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6a2e071b-c545-4fb3-96c2-4e662590b457 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:38.590586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6a2e071b-c545-4fb3-96c2-4e662590b457 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:38.592116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6a2e071b-c545-4fb3-96c2-4e662590b457 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:38.593276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6a2e071b-c545-4fb3-96c2-4e662590b457 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.155882 Jul 14 16:05:38.593839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1023/1947] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:38.877062 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-817f42c0-f381-4c77-8765-7b33067ff4d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:38.877775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-817f42c0-f381-4c77-8765-7b33067ff4d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:38.879998 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=56 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:38.885172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-817f42c0-f381-4c77-8765-7b33067ff4d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:38.885624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-817f42c0-f381-4c77-8765-7b33067ff4d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:38.886378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-817f42c0-f381-4c77-8765-7b33067ff4d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:38.886812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-817f42c0-f381-4c77-8765-7b33067ff4d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:38.951998 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-817f42c0-f381-4c77-8765-7b33067ff4d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:38.959465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-817f42c0-f381-4c77-8765-7b33067ff4d0 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086342 Jul 14 16:05:38.960059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 925/1948] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:38 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:39.611350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5ae1cbc0-dbae-49ff-bcb7-d13754aede05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:39.612091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5ae1cbc0-dbae-49ff-bcb7-d13754aede05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:39.618584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ae1cbc0-dbae-49ff-bcb7-d13754aede05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:39.619028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ae1cbc0-dbae-49ff-bcb7-d13754aede05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:39.619825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ae1cbc0-dbae-49ff-bcb7-d13754aede05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:39.620255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ae1cbc0-dbae-49ff-bcb7-d13754aede05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:39.753148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5ae1cbc0-dbae-49ff-bcb7-d13754aede05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:39.762047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5ae1cbc0-dbae-49ff-bcb7-d13754aede05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:39.763535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5ae1cbc0-dbae-49ff-bcb7-d13754aede05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:39.764727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5ae1cbc0-dbae-49ff-bcb7-d13754aede05 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.157267 Jul 14 16:05:39.765283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1024/1949] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:39 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:39.977302 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bb7cb1ff-39c6-46ae-9f65-dc8ce4d343e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:39.977848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bb7cb1ff-39c6-46ae-9f65-dc8ce4d343e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:39.984495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb7cb1ff-39c6-46ae-9f65-dc8ce4d343e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:39.984960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb7cb1ff-39c6-46ae-9f65-dc8ce4d343e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:39.985765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb7cb1ff-39c6-46ae-9f65-dc8ce4d343e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:39.986225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb7cb1ff-39c6-46ae-9f65-dc8ce4d343e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:40.058588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bb7cb1ff-39c6-46ae-9f65-dc8ce4d343e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:40.066987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bb7cb1ff-39c6-46ae-9f65-dc8ce4d343e6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.093701 Jul 14 16:05:40.067567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 926/1950] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:39 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:40.785458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-35318332-1782-4659-afbb-73383597f8b1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:40.786075 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-35318332-1782-4659-afbb-73383597f8b1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:40.792917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-35318332-1782-4659-afbb-73383597f8b1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:40.793367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-35318332-1782-4659-afbb-73383597f8b1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:40.794157 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-35318332-1782-4659-afbb-73383597f8b1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:40.794592 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-35318332-1782-4659-afbb-73383597f8b1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:40.924288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-35318332-1782-4659-afbb-73383597f8b1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:40.932975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-35318332-1782-4659-afbb-73383597f8b1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:40.934595 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-35318332-1782-4659-afbb-73383597f8b1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:40.935822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-35318332-1782-4659-afbb-73383597f8b1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.155898 Jul 14 16:05:40.936387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1025/1951] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:40 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:41.084206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-32a0c599-653e-4618-aeab-bcb81a24c231 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:41.084750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-32a0c599-653e-4618-aeab-bcb81a24c231 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:41.090924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32a0c599-653e-4618-aeab-bcb81a24c231 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:41.091404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32a0c599-653e-4618-aeab-bcb81a24c231 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:41.092200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32a0c599-653e-4618-aeab-bcb81a24c231 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:41.092631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32a0c599-653e-4618-aeab-bcb81a24c231 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:41.154056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-32a0c599-653e-4618-aeab-bcb81a24c231 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:41.161577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-32a0c599-653e-4618-aeab-bcb81a24c231 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081855 Jul 14 16:05:41.162141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 927/1952] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:41 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:41.954279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8117144a-ff4b-4873-98a1-a278f8ee3e0e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:41.954885 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8117144a-ff4b-4873-98a1-a278f8ee3e0e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:41.961869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8117144a-ff4b-4873-98a1-a278f8ee3e0e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:41.962318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8117144a-ff4b-4873-98a1-a278f8ee3e0e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:41.963107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8117144a-ff4b-4873-98a1-a278f8ee3e0e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:41.963541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8117144a-ff4b-4873-98a1-a278f8ee3e0e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:42.109820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8117144a-ff4b-4873-98a1-a278f8ee3e0e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:42.119373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8117144a-ff4b-4873-98a1-a278f8ee3e0e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:42.120942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8117144a-ff4b-4873-98a1-a278f8ee3e0e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:42.122148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8117144a-ff4b-4873-98a1-a278f8ee3e0e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.171767 Jul 14 16:05:42.122701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1026/1953] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:41 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:42.179110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-035412f7-9d68-4bd3-9ad6-8ff9ad393412 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:42.179672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-035412f7-9d68-4bd3-9ad6-8ff9ad393412 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:42.186180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-035412f7-9d68-4bd3-9ad6-8ff9ad393412 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:42.186627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-035412f7-9d68-4bd3-9ad6-8ff9ad393412 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:42.187390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-035412f7-9d68-4bd3-9ad6-8ff9ad393412 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:42.187852 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-035412f7-9d68-4bd3-9ad6-8ff9ad393412 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:42.255143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-035412f7-9d68-4bd3-9ad6-8ff9ad393412 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:42.263182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-035412f7-9d68-4bd3-9ad6-8ff9ad393412 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088768 Jul 14 16:05:42.263796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 928/1954] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:42 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:43.141490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-04ff8c23-a6cb-44cd-93e6-38f229fcb5bc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:43.142130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-04ff8c23-a6cb-44cd-93e6-38f229fcb5bc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:43.149041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-04ff8c23-a6cb-44cd-93e6-38f229fcb5bc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:43.149490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-04ff8c23-a6cb-44cd-93e6-38f229fcb5bc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:43.150248 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-04ff8c23-a6cb-44cd-93e6-38f229fcb5bc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:43.150683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-04ff8c23-a6cb-44cd-93e6-38f229fcb5bc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:43.280632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2feee87c-1fdf-4e0e-a8e8-06662a87136f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:43.281319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2feee87c-1fdf-4e0e-a8e8-06662a87136f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:43.283302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-04ff8c23-a6cb-44cd-93e6-38f229fcb5bc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:43.289079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2feee87c-1fdf-4e0e-a8e8-06662a87136f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:43.289533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2feee87c-1fdf-4e0e-a8e8-06662a87136f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:43.290312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2feee87c-1fdf-4e0e-a8e8-06662a87136f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:43.290750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2feee87c-1fdf-4e0e-a8e8-06662a87136f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:43.292174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-04ff8c23-a6cb-44cd-93e6-38f229fcb5bc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:43.293680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-04ff8c23-a6cb-44cd-93e6-38f229fcb5bc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:43.294846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-04ff8c23-a6cb-44cd-93e6-38f229fcb5bc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.157438 Jul 14 16:05:43.295406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1027/1955] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:43 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:43.354750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2feee87c-1fdf-4e0e-a8e8-06662a87136f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:43.363040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2feee87c-1fdf-4e0e-a8e8-06662a87136f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085640 Jul 14 16:05:43.363648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 929/1956] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:43 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:44.313524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-37b1a464-59f8-4618-9680-d2063b059b7c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:44.314139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-37b1a464-59f8-4618-9680-d2063b059b7c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:44.321267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37b1a464-59f8-4618-9680-d2063b059b7c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:44.321719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37b1a464-59f8-4618-9680-d2063b059b7c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:44.322510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37b1a464-59f8-4618-9680-d2063b059b7c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:44.322951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37b1a464-59f8-4618-9680-d2063b059b7c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:44.326858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:44.382277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-82085052-aa5e-459f-965b-e9c2a80c41c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:44.382898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-82085052-aa5e-459f-965b-e9c2a80c41c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:44.389597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82085052-aa5e-459f-965b-e9c2a80c41c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:44.390052 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82085052-aa5e-459f-965b-e9c2a80c41c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:44.390861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82085052-aa5e-459f-965b-e9c2a80c41c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:44.391305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82085052-aa5e-459f-965b-e9c2a80c41c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:44.455340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-82085052-aa5e-459f-965b-e9c2a80c41c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:44.456730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37b1a464-59f8-4618-9680-d2063b059b7c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:44.464169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-82085052-aa5e-459f-965b-e9c2a80c41c5 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086447 Jul 14 16:05:44.464746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 930/1957] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:44 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:05:44.465180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37b1a464-59f8-4618-9680-d2063b059b7c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:44.466700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37b1a464-59f8-4618-9680-d2063b059b7c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:44.467874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-37b1a464-59f8-4618-9680-d2063b059b7c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158250 Jul 14 16:05:44.468419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1028/1958] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:05:45.480946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0aade59e-174b-41ba-8c4c-6f8237c5d58e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:45.481588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0aade59e-174b-41ba-8c4c-6f8237c5d58e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:45.485686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9eaab93a-b09a-4ce2-afa4-f1508ff6cee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:45.486305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9eaab93a-b09a-4ce2-afa4-f1508ff6cee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:45.489254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0aade59e-174b-41ba-8c4c-6f8237c5d58e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:45.490089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0aade59e-174b-41ba-8c4c-6f8237c5d58e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:45.491000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0aade59e-174b-41ba-8c4c-6f8237c5d58e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:45.491437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0aade59e-174b-41ba-8c4c-6f8237c5d58e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:45.500651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9eaab93a-b09a-4ce2-afa4-f1508ff6cee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:45.501107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9eaab93a-b09a-4ce2-afa4-f1508ff6cee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:45.501890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9eaab93a-b09a-4ce2-afa4-f1508ff6cee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:45.502331 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9eaab93a-b09a-4ce2-afa4-f1508ff6cee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:45.556045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0aade59e-174b-41ba-8c4c-6f8237c5d58e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:45.563546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0aade59e-174b-41ba-8c4c-6f8237c5d58e tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086461 Jul 14 16:05:45.564145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 931/1959] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:45 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:45.636076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9eaab93a-b09a-4ce2-afa4-f1508ff6cee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:45.644440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9eaab93a-b09a-4ce2-afa4-f1508ff6cee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:45.645931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9eaab93a-b09a-4ce2-afa4-f1508ff6cee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:45.647069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9eaab93a-b09a-4ce2-afa4-f1508ff6cee5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.165274 Jul 14 16:05:45.647638 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1029/1960] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:45 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:05:46.581990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a9527433-bc48-4c33-bf37-2498cce6f2c2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:46.582598 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a9527433-bc48-4c33-bf37-2498cce6f2c2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:46.589215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a9527433-bc48-4c33-bf37-2498cce6f2c2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:46.589672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a9527433-bc48-4c33-bf37-2498cce6f2c2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:46.590443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a9527433-bc48-4c33-bf37-2498cce6f2c2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:46.590885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a9527433-bc48-4c33-bf37-2498cce6f2c2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:46.654813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a9527433-bc48-4c33-bf37-2498cce6f2c2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:46.662400 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a9527433-bc48-4c33-bf37-2498cce6f2c2 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085057 Jul 14 16:05:46.663209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 932/1961] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:46 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:46.666041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b94be165-b46d-4d85-9b84-6335f8222568 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:46.666779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b94be165-b46d-4d85-9b84-6335f8222568 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:46.674382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b94be165-b46d-4d85-9b84-6335f8222568 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:46.674903 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b94be165-b46d-4d85-9b84-6335f8222568 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:46.675874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b94be165-b46d-4d85-9b84-6335f8222568 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:46.676308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b94be165-b46d-4d85-9b84-6335f8222568 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:46.806155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b94be165-b46d-4d85-9b84-6335f8222568 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:46.814505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b94be165-b46d-4d85-9b84-6335f8222568 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:46.816640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b94be165-b46d-4d85-9b84-6335f8222568 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:46.817892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b94be165-b46d-4d85-9b84-6335f8222568 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.155905 Jul 14 16:05:46.818464 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1030/1962] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:46 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:47.681189 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8a4484b4-fe59-40f2-a8fd-839447890554 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:47.681812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8a4484b4-fe59-40f2-a8fd-839447890554 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:47.688364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a4484b4-fe59-40f2-a8fd-839447890554 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:47.688816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a4484b4-fe59-40f2-a8fd-839447890554 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:47.689577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a4484b4-fe59-40f2-a8fd-839447890554 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:47.690029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a4484b4-fe59-40f2-a8fd-839447890554 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:47.751083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8a4484b4-fe59-40f2-a8fd-839447890554 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:47.758672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8a4484b4-fe59-40f2-a8fd-839447890554 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.081361 Jul 14 16:05:47.759239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 933/1963] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:47 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:47.836890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-89b30604-6205-4e94-9fdc-4dd956d697a0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:47.837439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-89b30604-6205-4e94-9fdc-4dd956d697a0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:47.843822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89b30604-6205-4e94-9fdc-4dd956d697a0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:47.844268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89b30604-6205-4e94-9fdc-4dd956d697a0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:47.845009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89b30604-6205-4e94-9fdc-4dd956d697a0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:47.845438 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89b30604-6205-4e94-9fdc-4dd956d697a0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:47.975922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-89b30604-6205-4e94-9fdc-4dd956d697a0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:47.984212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-89b30604-6205-4e94-9fdc-4dd956d697a0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:47.985685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-89b30604-6205-4e94-9fdc-4dd956d697a0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:47.987149 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-89b30604-6205-4e94-9fdc-4dd956d697a0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.153988 Jul 14 16:05:47.987737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1031/1964] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:47 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:48.775836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a1ae6bcc-4f31-4d18-bb0f-1ea69e4174be tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:48.776486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a1ae6bcc-4f31-4d18-bb0f-1ea69e4174be tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:48.783245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a1ae6bcc-4f31-4d18-bb0f-1ea69e4174be tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:48.783852 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a1ae6bcc-4f31-4d18-bb0f-1ea69e4174be tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:48.784609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a1ae6bcc-4f31-4d18-bb0f-1ea69e4174be tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:48.785054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a1ae6bcc-4f31-4d18-bb0f-1ea69e4174be tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:48.848342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a1ae6bcc-4f31-4d18-bb0f-1ea69e4174be tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:48.855747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a1ae6bcc-4f31-4d18-bb0f-1ea69e4174be tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084008 Jul 14 16:05:48.856300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 934/1965] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:48 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:49.006221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e009700-8ca1-489e-992e-377b364e2e26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:49.006861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e009700-8ca1-489e-992e-377b364e2e26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:49.013366 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e009700-8ca1-489e-992e-377b364e2e26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:49.013813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e009700-8ca1-489e-992e-377b364e2e26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:49.014564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e009700-8ca1-489e-992e-377b364e2e26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:49.015001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e009700-8ca1-489e-992e-377b364e2e26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:49.153774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e009700-8ca1-489e-992e-377b364e2e26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:49.162777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e009700-8ca1-489e-992e-377b364e2e26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:49.164558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e009700-8ca1-489e-992e-377b364e2e26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:49.165721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e009700-8ca1-489e-992e-377b364e2e26 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.164409 Jul 14 16:05:49.166279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1032/1966] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:49 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:49.871866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9bf60d0b-ddd9-4244-a9cc-00358bc4225d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:49.872503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9bf60d0b-ddd9-4244-a9cc-00358bc4225d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:49.879052 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9bf60d0b-ddd9-4244-a9cc-00358bc4225d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:49.879499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9bf60d0b-ddd9-4244-a9cc-00358bc4225d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:49.880284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9bf60d0b-ddd9-4244-a9cc-00358bc4225d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:49.880717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9bf60d0b-ddd9-4244-a9cc-00358bc4225d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:49.941468 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9bf60d0b-ddd9-4244-a9cc-00358bc4225d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:49.948902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9bf60d0b-ddd9-4244-a9cc-00358bc4225d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.080939 Jul 14 16:05:49.949460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 935/1967] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:49 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:50.184613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-45015590-2c76-447e-ab76-48afb43f4bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:50.185205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-45015590-2c76-447e-ab76-48afb43f4bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:50.192821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45015590-2c76-447e-ab76-48afb43f4bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:50.193263 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45015590-2c76-447e-ab76-48afb43f4bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:50.194035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45015590-2c76-447e-ab76-48afb43f4bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:50.194472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45015590-2c76-447e-ab76-48afb43f4bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:50.422206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-45015590-2c76-447e-ab76-48afb43f4bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:50.431119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-45015590-2c76-447e-ab76-48afb43f4bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:50.432650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-45015590-2c76-447e-ab76-48afb43f4bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:50.433814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-45015590-2c76-447e-ab76-48afb43f4bb4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.253165 Jul 14 16:05:50.434375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1033/1968] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:50 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:50.965204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8a60e5b2-bb97-4954-8759-d27462de5e40 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:50.965747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8a60e5b2-bb97-4954-8759-d27462de5e40 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:50.972697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a60e5b2-bb97-4954-8759-d27462de5e40 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:50.973143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a60e5b2-bb97-4954-8759-d27462de5e40 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:50.973901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a60e5b2-bb97-4954-8759-d27462de5e40 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:50.974336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a60e5b2-bb97-4954-8759-d27462de5e40 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:51.041637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8a60e5b2-bb97-4954-8759-d27462de5e40 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:51.049147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8a60e5b2-bb97-4954-8759-d27462de5e40 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087882 Jul 14 16:05:51.050992 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 936/1969] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:50 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:51.457593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-02b6cc8c-efdf-4c5e-8036-67c11a60982c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:51.458247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-02b6cc8c-efdf-4c5e-8036-67c11a60982c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:51.464927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-02b6cc8c-efdf-4c5e-8036-67c11a60982c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:51.465552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-02b6cc8c-efdf-4c5e-8036-67c11a60982c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:51.467275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-02b6cc8c-efdf-4c5e-8036-67c11a60982c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:51.467650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-02b6cc8c-efdf-4c5e-8036-67c11a60982c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:51.599063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-02b6cc8c-efdf-4c5e-8036-67c11a60982c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:51.608360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-02b6cc8c-efdf-4c5e-8036-67c11a60982c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:51.610388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-02b6cc8c-efdf-4c5e-8036-67c11a60982c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:51.611786 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-02b6cc8c-efdf-4c5e-8036-67c11a60982c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.161257 Jul 14 16:05:51.612341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1034/1970] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:51 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:52.069161 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-eb5bdb7a-6331-4541-972f-cd499ea8c0b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:52.069780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-eb5bdb7a-6331-4541-972f-cd499ea8c0b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:52.076280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eb5bdb7a-6331-4541-972f-cd499ea8c0b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:52.076735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eb5bdb7a-6331-4541-972f-cd499ea8c0b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:52.077515 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eb5bdb7a-6331-4541-972f-cd499ea8c0b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:52.077936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eb5bdb7a-6331-4541-972f-cd499ea8c0b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:52.098318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:05:52.142580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-eb5bdb7a-6331-4541-972f-cd499ea8c0b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:52.150785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-eb5bdb7a-6331-4541-972f-cd499ea8c0b7 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086517 Jul 14 16:05:52.151369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 937/1971] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:52 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:52.630106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dd4720cc-982b-4f4b-8565-3327eb495d9e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:52.630673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dd4720cc-982b-4f4b-8565-3327eb495d9e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:52.637145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dd4720cc-982b-4f4b-8565-3327eb495d9e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:52.637585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dd4720cc-982b-4f4b-8565-3327eb495d9e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:52.638329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dd4720cc-982b-4f4b-8565-3327eb495d9e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:52.638782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dd4720cc-982b-4f4b-8565-3327eb495d9e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:52.771981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dd4720cc-982b-4f4b-8565-3327eb495d9e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:52.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dd4720cc-982b-4f4b-8565-3327eb495d9e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:52.781785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dd4720cc-982b-4f4b-8565-3327eb495d9e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:52.782943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dd4720cc-982b-4f4b-8565-3327eb495d9e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156943 Jul 14 16:05:52.783771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1035/1972] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:52 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:53.168762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2506b5f6-31e4-4326-ba22-eb5aff03032d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:53.169379 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2506b5f6-31e4-4326-ba22-eb5aff03032d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:53.176325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2506b5f6-31e4-4326-ba22-eb5aff03032d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:53.176939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2506b5f6-31e4-4326-ba22-eb5aff03032d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:53.178029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2506b5f6-31e4-4326-ba22-eb5aff03032d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:53.178508 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2506b5f6-31e4-4326-ba22-eb5aff03032d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:53.240738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2506b5f6-31e4-4326-ba22-eb5aff03032d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:53.248185 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2506b5f6-31e4-4326-ba22-eb5aff03032d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.083691 Jul 14 16:05:53.248697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 938/1973] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:53 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:53.802881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-980d6a6e-8ddc-4010-87fc-aca7a50086ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:53.803481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-980d6a6e-8ddc-4010-87fc-aca7a50086ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:53.809974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-980d6a6e-8ddc-4010-87fc-aca7a50086ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:53.810417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-980d6a6e-8ddc-4010-87fc-aca7a50086ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:53.811160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-980d6a6e-8ddc-4010-87fc-aca7a50086ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:53.811590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-980d6a6e-8ddc-4010-87fc-aca7a50086ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:53.950629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-980d6a6e-8ddc-4010-87fc-aca7a50086ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:53.960240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-980d6a6e-8ddc-4010-87fc-aca7a50086ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:53.961717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-980d6a6e-8ddc-4010-87fc-aca7a50086ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:53.962873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-980d6a6e-8ddc-4010-87fc-aca7a50086ab tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.164963 Jul 14 16:05:53.963423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1036/1974] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:53 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:54.266066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7e48a221-b518-4020-bc72-13fe8048cc66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:54.266636 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7e48a221-b518-4020-bc72-13fe8048cc66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:54.274275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e48a221-b518-4020-bc72-13fe8048cc66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:54.274733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e48a221-b518-4020-bc72-13fe8048cc66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:54.275546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e48a221-b518-4020-bc72-13fe8048cc66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:54.276015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e48a221-b518-4020-bc72-13fe8048cc66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:54.339823 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7e48a221-b518-4020-bc72-13fe8048cc66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:54.347875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7e48a221-b518-4020-bc72-13fe8048cc66 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085750 Jul 14 16:05:54.348451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 939/1975] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:54 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:54.982217 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3535ad94-5d54-45e9-90db-abdb167def42 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:54.982820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3535ad94-5d54-45e9-90db-abdb167def42 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:54.989701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3535ad94-5d54-45e9-90db-abdb167def42 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:54.990141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3535ad94-5d54-45e9-90db-abdb167def42 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:54.990908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3535ad94-5d54-45e9-90db-abdb167def42 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:54.991341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3535ad94-5d54-45e9-90db-abdb167def42 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:55.119984 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3535ad94-5d54-45e9-90db-abdb167def42 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:55.128495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3535ad94-5d54-45e9-90db-abdb167def42 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:55.129998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3535ad94-5d54-45e9-90db-abdb167def42 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:55.131165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3535ad94-5d54-45e9-90db-abdb167def42 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.152817 Jul 14 16:05:55.131748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1037/1976] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:54 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:55.364429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-63a86f5e-e15b-4811-907f-14173407cba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:55.364995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-63a86f5e-e15b-4811-907f-14173407cba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:55.371327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-63a86f5e-e15b-4811-907f-14173407cba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:55.371808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-63a86f5e-e15b-4811-907f-14173407cba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:55.372559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-63a86f5e-e15b-4811-907f-14173407cba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:55.372994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-63a86f5e-e15b-4811-907f-14173407cba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:55.437772 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-63a86f5e-e15b-4811-907f-14173407cba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:55.445906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-63a86f5e-e15b-4811-907f-14173407cba4 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.085381 Jul 14 16:05:55.446513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 940/1977] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:55 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:56.148816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-586f85e9-9787-4ae7-b85c-b8491a076142 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:56.149427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-586f85e9-9787-4ae7-b85c-b8491a076142 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:56.155883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-586f85e9-9787-4ae7-b85c-b8491a076142 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:56.156332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-586f85e9-9787-4ae7-b85c-b8491a076142 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:56.157081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-586f85e9-9787-4ae7-b85c-b8491a076142 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:56.157522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-586f85e9-9787-4ae7-b85c-b8491a076142 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:56.290880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-586f85e9-9787-4ae7-b85c-b8491a076142 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:56.299706 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-586f85e9-9787-4ae7-b85c-b8491a076142 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:56.301238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-586f85e9-9787-4ae7-b85c-b8491a076142 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:56.302516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-586f85e9-9787-4ae7-b85c-b8491a076142 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.157660 Jul 14 16:05:56.303091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1038/1978] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:56 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:56.462757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-88814569-e429-4783-9722-760e608b0017 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:56.463371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-88814569-e429-4783-9722-760e608b0017 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:56.469809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-88814569-e429-4783-9722-760e608b0017 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:56.470254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-88814569-e429-4783-9722-760e608b0017 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:56.471069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-88814569-e429-4783-9722-760e608b0017 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:56.471761 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-88814569-e429-4783-9722-760e608b0017 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:56.538573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-88814569-e429-4783-9722-760e608b0017 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:56.545973 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-88814569-e429-4783-9722-760e608b0017 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087184 Jul 14 16:05:56.546564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 941/1979] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:56 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:57.321392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-51a36d0f-d55e-4b51-9320-a317f5ba10e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:57.322055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-51a36d0f-d55e-4b51-9320-a317f5ba10e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:57.329606 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51a36d0f-d55e-4b51-9320-a317f5ba10e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:57.330929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51a36d0f-d55e-4b51-9320-a317f5ba10e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:57.332340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51a36d0f-d55e-4b51-9320-a317f5ba10e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:57.332890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-51a36d0f-d55e-4b51-9320-a317f5ba10e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:57.463441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-51a36d0f-d55e-4b51-9320-a317f5ba10e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:57.472760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-51a36d0f-d55e-4b51-9320-a317f5ba10e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:57.474436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-51a36d0f-d55e-4b51-9320-a317f5ba10e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:57.475624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-51a36d0f-d55e-4b51-9320-a317f5ba10e1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158340 Jul 14 16:05:57.476201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1039/1980] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:57 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:05:57.562237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a672b4a3-0c50-4c26-a1c4-ab72cc88796a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:57.562857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a672b4a3-0c50-4c26-a1c4-ab72cc88796a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:57.569661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a672b4a3-0c50-4c26-a1c4-ab72cc88796a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:57.569990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a672b4a3-0c50-4c26-a1c4-ab72cc88796a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:57.570760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a672b4a3-0c50-4c26-a1c4-ab72cc88796a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:57.571200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a672b4a3-0c50-4c26-a1c4-ab72cc88796a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:57.633000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a672b4a3-0c50-4c26-a1c4-ab72cc88796a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:57.640457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a672b4a3-0c50-4c26-a1c4-ab72cc88796a tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082087 Jul 14 16:05:57.641029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 942/1981] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:57 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:58.493930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ef4eb776-9db2-4f78-8b69-0f3c3c179632 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:58.494539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ef4eb776-9db2-4f78-8b69-0f3c3c179632 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:58.501016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef4eb776-9db2-4f78-8b69-0f3c3c179632 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:58.501459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef4eb776-9db2-4f78-8b69-0f3c3c179632 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:58.502218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef4eb776-9db2-4f78-8b69-0f3c3c179632 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:58.502963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef4eb776-9db2-4f78-8b69-0f3c3c179632 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:58.635145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ef4eb776-9db2-4f78-8b69-0f3c3c179632 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:58.643899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ef4eb776-9db2-4f78-8b69-0f3c3c179632 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:58.645380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ef4eb776-9db2-4f78-8b69-0f3c3c179632 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:58.646533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ef4eb776-9db2-4f78-8b69-0f3c3c179632 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156533 Jul 14 16:05:58.647081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1040/1982] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:58 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:58.657893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-99b9d29f-5fb6-49f9-b145-8df30d13a4b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:58.659197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-99b9d29f-5fb6-49f9-b145-8df30d13a4b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:58.665925 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-99b9d29f-5fb6-49f9-b145-8df30d13a4b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:58.666393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-99b9d29f-5fb6-49f9-b145-8df30d13a4b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:58.667131 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-99b9d29f-5fb6-49f9-b145-8df30d13a4b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:58.667565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-99b9d29f-5fb6-49f9-b145-8df30d13a4b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:58.733598 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-99b9d29f-5fb6-49f9-b145-8df30d13a4b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:58.741347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-99b9d29f-5fb6-49f9-b145-8df30d13a4b3 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087349 Jul 14 16:05:58.741916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 943/1983] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:58 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:05:59.664173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e263c816-a031-464c-a77d-2414c327e117 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:59.664766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e263c816-a031-464c-a77d-2414c327e117 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:59.671188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e263c816-a031-464c-a77d-2414c327e117 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:59.671655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e263c816-a031-464c-a77d-2414c327e117 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:59.672402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e263c816-a031-464c-a77d-2414c327e117 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:59.672833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e263c816-a031-464c-a77d-2414c327e117 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:59.758663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-47e23f16-69aa-44a1-aa88-a4542695884f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:05:59.759418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-47e23f16-69aa-44a1-aa88-a4542695884f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:05:59.766078 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-47e23f16-69aa-44a1-aa88-a4542695884f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:59.766625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-47e23f16-69aa-44a1-aa88-a4542695884f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:59.767477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-47e23f16-69aa-44a1-aa88-a4542695884f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:05:59.769251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-47e23f16-69aa-44a1-aa88-a4542695884f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:05:59.802993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e263c816-a031-464c-a77d-2414c327e117 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:59.811725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e263c816-a031-464c-a77d-2414c327e117 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:59.813247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e263c816-a031-464c-a77d-2414c327e117 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:59.815264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e263c816-a031-464c-a77d-2414c327e117 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.154460 Jul 14 16:05:59.816784 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1041/1984] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:05:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:05:59.835997 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-47e23f16-69aa-44a1-aa88-a4542695884f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:05:59.843451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-47e23f16-69aa-44a1-aa88-a4542695884f tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.088646 Jul 14 16:05:59.844043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 944/1985] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:05:59 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:00.834896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4624a60a-9a44-4028-b265-50c23de42652 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:00.835509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4624a60a-9a44-4028-b265-50c23de42652 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:00.837895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=52 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:00.843276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4624a60a-9a44-4028-b265-50c23de42652 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:00.843755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4624a60a-9a44-4028-b265-50c23de42652 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:00.844518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4624a60a-9a44-4028-b265-50c23de42652 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:00.844955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4624a60a-9a44-4028-b265-50c23de42652 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:00.860885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-07d72066-2726-461a-bfe8-2e98b9434c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:00.862015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-07d72066-2726-461a-bfe8-2e98b9434c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:00.868414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07d72066-2726-461a-bfe8-2e98b9434c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:00.868858 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07d72066-2726-461a-bfe8-2e98b9434c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:00.869618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07d72066-2726-461a-bfe8-2e98b9434c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:00.870046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07d72066-2726-461a-bfe8-2e98b9434c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:00.931899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-07d72066-2726-461a-bfe8-2e98b9434c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:00.939304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-07d72066-2726-461a-bfe8-2e98b9434c52 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.082253 Jul 14 16:06:00.941945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 945/1986] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:00 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:00.980154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4624a60a-9a44-4028-b265-50c23de42652 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:00.989228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4624a60a-9a44-4028-b265-50c23de42652 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:00.990717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4624a60a-9a44-4028-b265-50c23de42652 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:00.991926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4624a60a-9a44-4028-b265-50c23de42652 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.161418 Jul 14 16:06:00.992669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1042/1987] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:00 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:01.957786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3d0a65a9-ca8a-4ab6-b27e-0542412ea187 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:01.958407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3d0a65a9-ca8a-4ab6-b27e-0542412ea187 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:01.964890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3d0a65a9-ca8a-4ab6-b27e-0542412ea187 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:01.965343 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3d0a65a9-ca8a-4ab6-b27e-0542412ea187 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:01.966111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3d0a65a9-ca8a-4ab6-b27e-0542412ea187 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:01.966553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3d0a65a9-ca8a-4ab6-b27e-0542412ea187 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:02.010962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e69e4e44-20be-48eb-a107-a3d0d8b75ae0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:02.011624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e69e4e44-20be-48eb-a107-a3d0d8b75ae0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:02.019373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e69e4e44-20be-48eb-a107-a3d0d8b75ae0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:02.019859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e69e4e44-20be-48eb-a107-a3d0d8b75ae0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:02.020642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e69e4e44-20be-48eb-a107-a3d0d8b75ae0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:02.021083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e69e4e44-20be-48eb-a107-a3d0d8b75ae0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:02.034416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3d0a65a9-ca8a-4ab6-b27e-0542412ea187 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:02.044369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3d0a65a9-ca8a-4ab6-b27e-0542412ea187 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.091145 Jul 14 16:06:02.044957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 946/1988] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:01 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:02.157664 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e69e4e44-20be-48eb-a107-a3d0d8b75ae0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:02.166875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e69e4e44-20be-48eb-a107-a3d0d8b75ae0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:02.168454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e69e4e44-20be-48eb-a107-a3d0d8b75ae0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:02.169630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e69e4e44-20be-48eb-a107-a3d0d8b75ae0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.162715 Jul 14 16:06:02.170195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1043/1989] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:06:03.063316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-469f3b28-4ebc-4483-8cf1-dd4b13cbce4d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:03.064016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-469f3b28-4ebc-4483-8cf1-dd4b13cbce4d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:03.070462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-469f3b28-4ebc-4483-8cf1-dd4b13cbce4d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:03.070922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-469f3b28-4ebc-4483-8cf1-dd4b13cbce4d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:03.071713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-469f3b28-4ebc-4483-8cf1-dd4b13cbce4d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:03.072160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-469f3b28-4ebc-4483-8cf1-dd4b13cbce4d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:03.133730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-469f3b28-4ebc-4483-8cf1-dd4b13cbce4d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:03.145549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-469f3b28-4ebc-4483-8cf1-dd4b13cbce4d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.086070 Jul 14 16:06:03.146130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 947/1990] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:03 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:03.191633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1f371667-ecf4-4a93-9955-64aa2a180666 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:03.192245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1f371667-ecf4-4a93-9955-64aa2a180666 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:03.198762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f371667-ecf4-4a93-9955-64aa2a180666 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:03.199196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f371667-ecf4-4a93-9955-64aa2a180666 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:03.199998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f371667-ecf4-4a93-9955-64aa2a180666 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:03.200426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f371667-ecf4-4a93-9955-64aa2a180666 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:03.345003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1f371667-ecf4-4a93-9955-64aa2a180666 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:03.349032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:03.355046 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1f371667-ecf4-4a93-9955-64aa2a180666 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:03.356558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1f371667-ecf4-4a93-9955-64aa2a180666 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:03.357725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1f371667-ecf4-4a93-9955-64aa2a180666 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.171122 Jul 14 16:06:03.358288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1044/1991] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:06:04.162541 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-71434730-5774-4422-90ca-9493ddcf179d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:04.163156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-71434730-5774-4422-90ca-9493ddcf179d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:04.170281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71434730-5774-4422-90ca-9493ddcf179d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:04.170737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71434730-5774-4422-90ca-9493ddcf179d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:04.171546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71434730-5774-4422-90ca-9493ddcf179d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:04.172093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71434730-5774-4422-90ca-9493ddcf179d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:04.238518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-71434730-5774-4422-90ca-9493ddcf179d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:04.246347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-71434730-5774-4422-90ca-9493ddcf179d tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087765 Jul 14 16:06:04.246990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 948/1992] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:04 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:04.379473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7eb3abc0-a03b-4c93-9d63-c922b6eba221 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:04.380183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7eb3abc0-a03b-4c93-9d63-c922b6eba221 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:04.386759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7eb3abc0-a03b-4c93-9d63-c922b6eba221 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:04.387212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7eb3abc0-a03b-4c93-9d63-c922b6eba221 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:04.388011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7eb3abc0-a03b-4c93-9d63-c922b6eba221 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:04.388447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7eb3abc0-a03b-4c93-9d63-c922b6eba221 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:04.530698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7eb3abc0-a03b-4c93-9d63-c922b6eba221 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:04.540149 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7eb3abc0-a03b-4c93-9d63-c922b6eba221 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:04.541641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7eb3abc0-a03b-4c93-9d63-c922b6eba221 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:04.542811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7eb3abc0-a03b-4c93-9d63-c922b6eba221 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.167885 Jul 14 16:06:04.543376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1045/1993] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:05.264787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-21e27f6d-9094-44cc-a63f-6d3e38dcd888 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:05.264787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-21e27f6d-9094-44cc-a63f-6d3e38dcd888 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:05.272989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21e27f6d-9094-44cc-a63f-6d3e38dcd888 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:05.273878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21e27f6d-9094-44cc-a63f-6d3e38dcd888 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:05.273878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21e27f6d-9094-44cc-a63f-6d3e38dcd888 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:05.274263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-21e27f6d-9094-44cc-a63f-6d3e38dcd888 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:05.336898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-21e27f6d-9094-44cc-a63f-6d3e38dcd888 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:05.344611 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-21e27f6d-9094-44cc-a63f-6d3e38dcd888 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.084470 Jul 14 16:06:05.345198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 949/1994] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:05 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:05.562149 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-26086a98-df2f-4e49-a504-15c90046b0aa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:05.562708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-26086a98-df2f-4e49-a504-15c90046b0aa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:05.569836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26086a98-df2f-4e49-a504-15c90046b0aa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:05.570275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26086a98-df2f-4e49-a504-15c90046b0aa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:05.571023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26086a98-df2f-4e49-a504-15c90046b0aa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:05.571455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26086a98-df2f-4e49-a504-15c90046b0aa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:05.699625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-26086a98-df2f-4e49-a504-15c90046b0aa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:05.708996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-26086a98-df2f-4e49-a504-15c90046b0aa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:05.710496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-26086a98-df2f-4e49-a504-15c90046b0aa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:05.711713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-26086a98-df2f-4e49-a504-15c90046b0aa tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.153532 Jul 14 16:06:05.712270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1046/1995] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:05 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:06.363789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-64332b7c-cb16-40ee-834f-69b9b0ca3b95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:06.364414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-64332b7c-cb16-40ee-834f-69b9b0ca3b95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] [instance: fde2fb02-e844-471d-b2bc-81fc89534875] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:06.371489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-64332b7c-cb16-40ee-834f-69b9b0ca3b95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:06.371969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-64332b7c-cb16-40ee-834f-69b9b0ca3b95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:06.372761 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-64332b7c-cb16-40ee-834f-69b9b0ca3b95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:06.373206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-64332b7c-cb16-40ee-834f-69b9b0ca3b95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:06.436809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-64332b7c-cb16-40ee-834f-69b9b0ca3b95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dbeb3476ffee4611896156633c84265c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '16f5da37d8ec473dafd80531f7f60c89', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:06.446058 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-64332b7c-cb16-40ee-834f-69b9b0ca3b95 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875" status: 200 len: 1219 microversion: 2.1 time: 0.087343 Jul 14 16:06:06.446687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 950/1996] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:06 2022] GET /compute/v2.1/servers/fde2fb02-e844-471d-b2bc-81fc89534875 => generated 1219 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:06.620377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-66914c3e-f551-43ae-8655-1c4062b3dae6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] Calling method '.version_select at 0x7f357c04bdc0>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:06.643514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-66914c3e-f551-43ae-8655-1c4062b3dae6 tempest-TestShelveInstance-1027556824 tempest-TestShelveInstance-1027556824-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1048475031" status: 202 len: 0 microversion: 2.1 time: 0.028147 Jul 14 16:06:06.644112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1047/1997] 10.222.0.99 () {58 vars in 1253 bytes} [Thu Jul 14 16:06:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1048475031 => generated 0 bytes in 30 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:06:06.730076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4e2cdcf8-64dd-45b2-a5f3-607c5949f0f1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:06.730716 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4e2cdcf8-64dd-45b2-a5f3-607c5949f0f1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:06.737605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e2cdcf8-64dd-45b2-a5f3-607c5949f0f1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:06.738181 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e2cdcf8-64dd-45b2-a5f3-607c5949f0f1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:06.738980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e2cdcf8-64dd-45b2-a5f3-607c5949f0f1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:06.739417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e2cdcf8-64dd-45b2-a5f3-607c5949f0f1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:06.904860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4e2cdcf8-64dd-45b2-a5f3-607c5949f0f1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:06.918233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4e2cdcf8-64dd-45b2-a5f3-607c5949f0f1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:06.919776 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4e2cdcf8-64dd-45b2-a5f3-607c5949f0f1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:06.921004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4e2cdcf8-64dd-45b2-a5f3-607c5949f0f1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.194817 Jul 14 16:06:06.921570 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 951/1998] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:06 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:07.940679 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2f51274d-d449-40aa-978f-4b51a162e4d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:07.942096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2f51274d-d449-40aa-978f-4b51a162e4d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:07.950254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f51274d-d449-40aa-978f-4b51a162e4d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:07.950704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f51274d-d449-40aa-978f-4b51a162e4d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:07.951464 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f51274d-d449-40aa-978f-4b51a162e4d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:07.951928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f51274d-d449-40aa-978f-4b51a162e4d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:08.105271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2f51274d-d449-40aa-978f-4b51a162e4d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:08.116294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2f51274d-d449-40aa-978f-4b51a162e4d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:08.118069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2f51274d-d449-40aa-978f-4b51a162e4d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:08.119483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2f51274d-d449-40aa-978f-4b51a162e4d3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.184441 Jul 14 16:06:08.135485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1048/1999] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:07 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:08.254621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6ce159f9-0d9a-49e5-8802-ca8f9efefbca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:08.255219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6ce159f9-0d9a-49e5-8802-ca8f9efefbca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:08.264397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ce159f9-0d9a-49e5-8802-ca8f9efefbca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:08.265157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ce159f9-0d9a-49e5-8802-ca8f9efefbca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:08.266192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ce159f9-0d9a-49e5-8802-ca8f9efefbca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:08.267125 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ce159f9-0d9a-49e5-8802-ca8f9efefbca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:08.303134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6ce159f9-0d9a-49e5-8802-ca8f9efefbca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:06:08.371771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:08.447836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6ce159f9-0d9a-49e5-8802-ca8f9efefbca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 204 len: 0 microversion: 2.1 time: 0.200048 Jul 14 16:06:08.449785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 952/2000] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:06:08 2022] DELETE /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:06:08.464354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ddafd5b3-a99b-4aee-8fba-6339e51491f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:08.464991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ddafd5b3-a99b-4aee-8fba-6339e51491f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:08.475418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddafd5b3-a99b-4aee-8fba-6339e51491f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:08.475926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddafd5b3-a99b-4aee-8fba-6339e51491f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:08.477270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddafd5b3-a99b-4aee-8fba-6339e51491f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:08.477725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddafd5b3-a99b-4aee-8fba-6339e51491f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:08.818754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ddafd5b3-a99b-4aee-8fba-6339e51491f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:08.827497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ddafd5b3-a99b-4aee-8fba-6339e51491f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.373564 Jul 14 16:06:08.829497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1049/2001] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:08 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:08.972664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d4988960-fb2c-47b9-9167-8e66ce142cfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] Calling method '.version_select at 0x7f357c0c85e0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:08.985210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=61,nova_api:UPDATE=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:09.005044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d4988960-fb2c-47b9-9167-8e66ce142cfc tempest-TestVolumeBootPattern-1564107289 tempest-TestVolumeBootPattern-1564107289-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-443020232" status: 202 len: 0 microversion: 2.1 time: 0.037279 Jul 14 16:06:09.005818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 953/2002] 10.222.0.99 () {58 vars in 1259 bytes} [Thu Jul 14 16:06:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-443020232 => generated 0 bytes in 39 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:06:09.148427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-acf2580f-90b9-4627-9f94-bc6d692d7f75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:09.152825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-acf2580f-90b9-4627-9f94-bc6d692d7f75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:09.167852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acf2580f-90b9-4627-9f94-bc6d692d7f75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:09.171841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acf2580f-90b9-4627-9f94-bc6d692d7f75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:09.173060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acf2580f-90b9-4627-9f94-bc6d692d7f75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:09.174247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-acf2580f-90b9-4627-9f94-bc6d692d7f75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:09.450294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-acf2580f-90b9-4627-9f94-bc6d692d7f75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:09.459657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-acf2580f-90b9-4627-9f94-bc6d692d7f75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:09.461556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-acf2580f-90b9-4627-9f94-bc6d692d7f75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:09.463001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-acf2580f-90b9-4627-9f94-bc6d692d7f75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.320781 Jul 14 16:06:09.463983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1050/2003] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:09 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:09.849984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fab82ff9-b624-4644-9cc4-3fb07fc2bc3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:09.850652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fab82ff9-b624-4644-9cc4-3fb07fc2bc3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:09.860140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fab82ff9-b624-4644-9cc4-3fb07fc2bc3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:09.860678 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fab82ff9-b624-4644-9cc4-3fb07fc2bc3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:09.862186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fab82ff9-b624-4644-9cc4-3fb07fc2bc3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:09.862694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fab82ff9-b624-4644-9cc4-3fb07fc2bc3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:10.103783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fab82ff9-b624-4644-9cc4-3fb07fc2bc3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:10.113438 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fab82ff9-b624-4644-9cc4-3fb07fc2bc3b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.268076 Jul 14 16:06:10.114036 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 954/2004] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:09 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:10.483051 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1a7459ba-dd5c-4b10-8596-32b657993bf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:10.484311 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1a7459ba-dd5c-4b10-8596-32b657993bf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:10.495567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a7459ba-dd5c-4b10-8596-32b657993bf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:10.496871 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a7459ba-dd5c-4b10-8596-32b657993bf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:10.498630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a7459ba-dd5c-4b10-8596-32b657993bf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:10.499455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1a7459ba-dd5c-4b10-8596-32b657993bf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:10.864958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1a7459ba-dd5c-4b10-8596-32b657993bf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:10.880672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1a7459ba-dd5c-4b10-8596-32b657993bf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:10.882218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1a7459ba-dd5c-4b10-8596-32b657993bf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:10.883414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1a7459ba-dd5c-4b10-8596-32b657993bf4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.405250 Jul 14 16:06:10.894973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1051/2005] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:10 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:11.137857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b0e3fd04-d981-419e-9a19-484df4f2cb4d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:11.138489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b0e3fd04-d981-419e-9a19-484df4f2cb4d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:11.147195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0e3fd04-d981-419e-9a19-484df4f2cb4d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:11.147808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0e3fd04-d981-419e-9a19-484df4f2cb4d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:11.148861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0e3fd04-d981-419e-9a19-484df4f2cb4d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:11.149531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b0e3fd04-d981-419e-9a19-484df4f2cb4d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:11.396983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b0e3fd04-d981-419e-9a19-484df4f2cb4d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:11.405287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b0e3fd04-d981-419e-9a19-484df4f2cb4d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.275983 Jul 14 16:06:11.418503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 955/2006] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:11 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:11.903672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-11466993-05f9-4a60-a1cd-1807c9db3a38 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:11.906276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-11466993-05f9-4a60-a1cd-1807c9db3a38 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:11.914546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11466993-05f9-4a60-a1cd-1807c9db3a38 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:11.915001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11466993-05f9-4a60-a1cd-1807c9db3a38 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:11.915810 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11466993-05f9-4a60-a1cd-1807c9db3a38 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:11.916247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11466993-05f9-4a60-a1cd-1807c9db3a38 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:12.149949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-11466993-05f9-4a60-a1cd-1807c9db3a38 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:12.160835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-11466993-05f9-4a60-a1cd-1807c9db3a38 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:12.162570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-11466993-05f9-4a60-a1cd-1807c9db3a38 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:12.163998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-11466993-05f9-4a60-a1cd-1807c9db3a38 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.265087 Jul 14 16:06:12.164776 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1052/2007] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:11 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:12.426003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fe4361f3-5f1d-4065-ab5f-34a359993ded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:12.426936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fe4361f3-5f1d-4065-ab5f-34a359993ded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:12.438053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe4361f3-5f1d-4065-ab5f-34a359993ded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:12.441591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe4361f3-5f1d-4065-ab5f-34a359993ded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:12.442544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe4361f3-5f1d-4065-ab5f-34a359993ded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:12.443056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fe4361f3-5f1d-4065-ab5f-34a359993ded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:12.747998 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fe4361f3-5f1d-4065-ab5f-34a359993ded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:12.756615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fe4361f3-5f1d-4065-ab5f-34a359993ded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.334799 Jul 14 16:06:12.757328 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 956/2008] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:12 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:13.182694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6971a7b8-7f32-496c-b591-1bf1efa06c70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:13.183426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6971a7b8-7f32-496c-b591-1bf1efa06c70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:13.191535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6971a7b8-7f32-496c-b591-1bf1efa06c70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:13.192359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6971a7b8-7f32-496c-b591-1bf1efa06c70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:13.193359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6971a7b8-7f32-496c-b591-1bf1efa06c70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:13.194016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6971a7b8-7f32-496c-b591-1bf1efa06c70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:13.369019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6971a7b8-7f32-496c-b591-1bf1efa06c70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:13.379413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6971a7b8-7f32-496c-b591-1bf1efa06c70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:13.382044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6971a7b8-7f32-496c-b591-1bf1efa06c70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:13.384968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6971a7b8-7f32-496c-b591-1bf1efa06c70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.205816 Jul 14 16:06:13.386934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1053/2009] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:13 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:13.776964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-436bc2e4-2cc2-4647-814a-7d41ecc3871b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:13.780331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-436bc2e4-2cc2-4647-814a-7d41ecc3871b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:13.792993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-436bc2e4-2cc2-4647-814a-7d41ecc3871b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:13.793719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-436bc2e4-2cc2-4647-814a-7d41ecc3871b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:13.796766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-436bc2e4-2cc2-4647-814a-7d41ecc3871b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:13.797422 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-436bc2e4-2cc2-4647-814a-7d41ecc3871b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:14.009813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-436bc2e4-2cc2-4647-814a-7d41ecc3871b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:14.019624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-436bc2e4-2cc2-4647-814a-7d41ecc3871b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.247711 Jul 14 16:06:14.020349 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 957/2010] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:13 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:14.405627 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9a65cde9-51f5-460a-b1b2-feb2e9a76524 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:14.407007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9a65cde9-51f5-460a-b1b2-feb2e9a76524 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:14.421010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a65cde9-51f5-460a-b1b2-feb2e9a76524 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:14.421750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a65cde9-51f5-460a-b1b2-feb2e9a76524 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:14.422532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a65cde9-51f5-460a-b1b2-feb2e9a76524 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:14.422990 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a65cde9-51f5-460a-b1b2-feb2e9a76524 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:14.667925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9a65cde9-51f5-460a-b1b2-feb2e9a76524 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:14.686053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9a65cde9-51f5-460a-b1b2-feb2e9a76524 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:14.688936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9a65cde9-51f5-460a-b1b2-feb2e9a76524 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:14.693199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9a65cde9-51f5-460a-b1b2-feb2e9a76524 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.291014 Jul 14 16:06:14.713016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1054/2011] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:14 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:15.040212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1c1a567e-22e8-4ee8-b355-f8a5e471ab2e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:15.041276 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1c1a567e-22e8-4ee8-b355-f8a5e471ab2e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:15.057482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1c1a567e-22e8-4ee8-b355-f8a5e471ab2e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:15.062056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1c1a567e-22e8-4ee8-b355-f8a5e471ab2e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:15.063004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1c1a567e-22e8-4ee8-b355-f8a5e471ab2e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:15.063885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1c1a567e-22e8-4ee8-b355-f8a5e471ab2e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:15.344834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1c1a567e-22e8-4ee8-b355-f8a5e471ab2e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:15.360283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1c1a567e-22e8-4ee8-b355-f8a5e471ab2e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.326963 Jul 14 16:06:15.371641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 958/2012] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:15 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:15.723995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-737a373f-7135-4ac7-a009-3aa9be99e3e4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:15.725618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-737a373f-7135-4ac7-a009-3aa9be99e3e4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:15.753663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-737a373f-7135-4ac7-a009-3aa9be99e3e4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:15.754901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-737a373f-7135-4ac7-a009-3aa9be99e3e4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:15.757607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-737a373f-7135-4ac7-a009-3aa9be99e3e4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:15.758867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-737a373f-7135-4ac7-a009-3aa9be99e3e4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:16.004948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-737a373f-7135-4ac7-a009-3aa9be99e3e4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:16.021066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-737a373f-7135-4ac7-a009-3aa9be99e3e4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:16.024666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-737a373f-7135-4ac7-a009-3aa9be99e3e4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:16.026228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-737a373f-7135-4ac7-a009-3aa9be99e3e4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.309671 Jul 14 16:06:16.046622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1055/2013] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:15 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:16.383182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9e736acc-a33b-4175-b9ab-d74c7948501e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:16.384488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9e736acc-a33b-4175-b9ab-d74c7948501e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:16.396525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e736acc-a33b-4175-b9ab-d74c7948501e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:16.397617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e736acc-a33b-4175-b9ab-d74c7948501e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:16.398836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e736acc-a33b-4175-b9ab-d74c7948501e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:16.399578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e736acc-a33b-4175-b9ab-d74c7948501e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:16.649462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9e736acc-a33b-4175-b9ab-d74c7948501e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:16.659705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9e736acc-a33b-4175-b9ab-d74c7948501e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.283828 Jul 14 16:06:16.660729 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 959/2014] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:16 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:17.047392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3e7ceeb4-a009-45d3-b9cb-73384b81283a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:17.048299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3e7ceeb4-a009-45d3-b9cb-73384b81283a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:17.070452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3e7ceeb4-a009-45d3-b9cb-73384b81283a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:17.071323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3e7ceeb4-a009-45d3-b9cb-73384b81283a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:17.072426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3e7ceeb4-a009-45d3-b9cb-73384b81283a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:17.074741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3e7ceeb4-a009-45d3-b9cb-73384b81283a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:17.399762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3e7ceeb4-a009-45d3-b9cb-73384b81283a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:17.423100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3e7ceeb4-a009-45d3-b9cb-73384b81283a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:17.425119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3e7ceeb4-a009-45d3-b9cb-73384b81283a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:17.426339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3e7ceeb4-a009-45d3-b9cb-73384b81283a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.383254 Jul 14 16:06:17.428946 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1056/2015] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:17 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:17.679177 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-379cfa23-d423-4589-b79c-e15de5f3b965 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:17.679957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-379cfa23-d423-4589-b79c-e15de5f3b965 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:17.686466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-379cfa23-d423-4589-b79c-e15de5f3b965 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:17.686957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-379cfa23-d423-4589-b79c-e15de5f3b965 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:17.687755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-379cfa23-d423-4589-b79c-e15de5f3b965 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:17.688192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-379cfa23-d423-4589-b79c-e15de5f3b965 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:17.840021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-379cfa23-d423-4589-b79c-e15de5f3b965 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:17.856965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-379cfa23-d423-4589-b79c-e15de5f3b965 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.181307 Jul 14 16:06:17.858155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 960/2016] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:17 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:18.450748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-79ecc9c3-29d5-49ca-ba79-26400d990840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:18.451246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-79ecc9c3-29d5-49ca-ba79-26400d990840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:18.464098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79ecc9c3-29d5-49ca-ba79-26400d990840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:18.464565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79ecc9c3-29d5-49ca-ba79-26400d990840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:18.465349 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79ecc9c3-29d5-49ca-ba79-26400d990840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:18.465791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79ecc9c3-29d5-49ca-ba79-26400d990840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:18.613686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-79ecc9c3-29d5-49ca-ba79-26400d990840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:18.622588 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-79ecc9c3-29d5-49ca-ba79-26400d990840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:18.624098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-79ecc9c3-29d5-49ca-ba79-26400d990840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:18.625268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-79ecc9c3-29d5-49ca-ba79-26400d990840 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.180284 Jul 14 16:06:18.625829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1057/2017] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:18 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:18.882319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d62c563b-38e8-4860-97b7-411007615467 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:18.883517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d62c563b-38e8-4860-97b7-411007615467 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:18.890317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d62c563b-38e8-4860-97b7-411007615467 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:18.890759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d62c563b-38e8-4860-97b7-411007615467 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:18.891758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d62c563b-38e8-4860-97b7-411007615467 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:18.892198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d62c563b-38e8-4860-97b7-411007615467 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:19.043754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d62c563b-38e8-4860-97b7-411007615467 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:19.053981 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d62c563b-38e8-4860-97b7-411007615467 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.175319 Jul 14 16:06:19.054744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 961/2018] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:18 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:19.645555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8a1264d8-e1d6-4d30-9d8c-2936bf8dcaae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:19.646177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8a1264d8-e1d6-4d30-9d8c-2936bf8dcaae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:19.652804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8a1264d8-e1d6-4d30-9d8c-2936bf8dcaae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:19.653277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8a1264d8-e1d6-4d30-9d8c-2936bf8dcaae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:19.654043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8a1264d8-e1d6-4d30-9d8c-2936bf8dcaae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:19.654475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8a1264d8-e1d6-4d30-9d8c-2936bf8dcaae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:19.785112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8a1264d8-e1d6-4d30-9d8c-2936bf8dcaae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:19.793814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8a1264d8-e1d6-4d30-9d8c-2936bf8dcaae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:19.795297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8a1264d8-e1d6-4d30-9d8c-2936bf8dcaae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:19.796489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8a1264d8-e1d6-4d30-9d8c-2936bf8dcaae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.155804 Jul 14 16:06:19.797053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1058/2019] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:19 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:20.073553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5c8e0f8a-459e-4cc8-8a1e-d61d12e58812 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:20.074163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5c8e0f8a-459e-4cc8-8a1e-d61d12e58812 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:20.081767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5c8e0f8a-459e-4cc8-8a1e-d61d12e58812 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:20.082214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5c8e0f8a-459e-4cc8-8a1e-d61d12e58812 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:20.082968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5c8e0f8a-459e-4cc8-8a1e-d61d12e58812 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:20.083404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5c8e0f8a-459e-4cc8-8a1e-d61d12e58812 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:20.215901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5c8e0f8a-459e-4cc8-8a1e-d61d12e58812 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:20.224122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5c8e0f8a-459e-4cc8-8a1e-d61d12e58812 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155282 Jul 14 16:06:20.224692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 962/2020] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:20 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:20.815177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-20aa420b-2575-470b-9526-7e2f5a632ecb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:20.815802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-20aa420b-2575-470b-9526-7e2f5a632ecb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:20.822294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20aa420b-2575-470b-9526-7e2f5a632ecb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:20.822747 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20aa420b-2575-470b-9526-7e2f5a632ecb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:20.823538 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20aa420b-2575-470b-9526-7e2f5a632ecb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:20.824003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20aa420b-2575-470b-9526-7e2f5a632ecb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:20.957227 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-20aa420b-2575-470b-9526-7e2f5a632ecb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:20.965821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-20aa420b-2575-470b-9526-7e2f5a632ecb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:20.967302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-20aa420b-2575-470b-9526-7e2f5a632ecb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:20.968486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-20aa420b-2575-470b-9526-7e2f5a632ecb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.157280 Jul 14 16:06:20.969037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1059/2021] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:21.241181 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1e2f2b4e-8d37-4036-b0b3-32f95b5c9c81 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:21.241804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1e2f2b4e-8d37-4036-b0b3-32f95b5c9c81 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:21.248356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1e2f2b4e-8d37-4036-b0b3-32f95b5c9c81 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:21.248812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1e2f2b4e-8d37-4036-b0b3-32f95b5c9c81 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:21.249594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1e2f2b4e-8d37-4036-b0b3-32f95b5c9c81 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:21.250025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1e2f2b4e-8d37-4036-b0b3-32f95b5c9c81 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:21.386513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1e2f2b4e-8d37-4036-b0b3-32f95b5c9c81 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:21.395362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1e2f2b4e-8d37-4036-b0b3-32f95b5c9c81 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158131 Jul 14 16:06:21.395977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 963/2022] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:21 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:21.988318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-72fe7861-f170-47c5-a88a-8d8c00b7d5c4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:21.989101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-72fe7861-f170-47c5-a88a-8d8c00b7d5c4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:21.995567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-72fe7861-f170-47c5-a88a-8d8c00b7d5c4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:21.996042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-72fe7861-f170-47c5-a88a-8d8c00b7d5c4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:21.996804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-72fe7861-f170-47c5-a88a-8d8c00b7d5c4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:21.997222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-72fe7861-f170-47c5-a88a-8d8c00b7d5c4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:22.126453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-72fe7861-f170-47c5-a88a-8d8c00b7d5c4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:22.135289 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-72fe7861-f170-47c5-a88a-8d8c00b7d5c4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:22.136803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-72fe7861-f170-47c5-a88a-8d8c00b7d5c4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:22.137953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-72fe7861-f170-47c5-a88a-8d8c00b7d5c4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.154623 Jul 14 16:06:22.138507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1060/2023] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:21 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:06:22.415362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b5e6ef5a-8f0c-4a86-af2e-134182592879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:22.415997 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b5e6ef5a-8f0c-4a86-af2e-134182592879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:22.422704 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5e6ef5a-8f0c-4a86-af2e-134182592879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:22.423157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5e6ef5a-8f0c-4a86-af2e-134182592879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:22.424513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5e6ef5a-8f0c-4a86-af2e-134182592879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:22.424960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5e6ef5a-8f0c-4a86-af2e-134182592879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:22.559887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b5e6ef5a-8f0c-4a86-af2e-134182592879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:22.568276 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b5e6ef5a-8f0c-4a86-af2e-134182592879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157060 Jul 14 16:06:22.568854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 964/2024] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:22 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:23.156821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f1e05e32-a9e4-446d-8f8a-212fea56f881 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:23.157431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f1e05e32-a9e4-446d-8f8a-212fea56f881 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:23.165728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f1e05e32-a9e4-446d-8f8a-212fea56f881 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:23.166384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f1e05e32-a9e4-446d-8f8a-212fea56f881 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:23.167520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f1e05e32-a9e4-446d-8f8a-212fea56f881 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:23.168204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f1e05e32-a9e4-446d-8f8a-212fea56f881 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:23.324198 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f1e05e32-a9e4-446d-8f8a-212fea56f881 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:23.333089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f1e05e32-a9e4-446d-8f8a-212fea56f881 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:23.334583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f1e05e32-a9e4-446d-8f8a-212fea56f881 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:23.335791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f1e05e32-a9e4-446d-8f8a-212fea56f881 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.182909 Jul 14 16:06:23.336348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1061/2025] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:23 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:06:23.586018 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f4d0db1b-9f91-497f-84aa-408d8019f194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:23.586589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f4d0db1b-9f91-497f-84aa-408d8019f194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:23.593432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4d0db1b-9f91-497f-84aa-408d8019f194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:23.593882 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4d0db1b-9f91-497f-84aa-408d8019f194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:23.594662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4d0db1b-9f91-497f-84aa-408d8019f194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:23.595100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f4d0db1b-9f91-497f-84aa-408d8019f194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:23.734878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f4d0db1b-9f91-497f-84aa-408d8019f194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:23.743482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f4d0db1b-9f91-497f-84aa-408d8019f194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161543 Jul 14 16:06:23.744076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 965/2026] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:23 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:24.354113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3889564f-2556-4c08-aba9-fa048ea921e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:24.354718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3889564f-2556-4c08-aba9-fa048ea921e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:24.361472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3889564f-2556-4c08-aba9-fa048ea921e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:24.361910 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3889564f-2556-4c08-aba9-fa048ea921e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:24.362725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3889564f-2556-4c08-aba9-fa048ea921e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:24.363113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3889564f-2556-4c08-aba9-fa048ea921e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:24.382996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:24.499253 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3889564f-2556-4c08-aba9-fa048ea921e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:24.508670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3889564f-2556-4c08-aba9-fa048ea921e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:24.510175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3889564f-2556-4c08-aba9-fa048ea921e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:24.511350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3889564f-2556-4c08-aba9-fa048ea921e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.161164 Jul 14 16:06:24.511938 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1062/2027] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:24 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:24.760588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3ba83ecc-ba06-47ea-b754-8906d80e46ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:24.761236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3ba83ecc-ba06-47ea-b754-8906d80e46ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:24.768624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3ba83ecc-ba06-47ea-b754-8906d80e46ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:24.769334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3ba83ecc-ba06-47ea-b754-8906d80e46ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:24.770211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3ba83ecc-ba06-47ea-b754-8906d80e46ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:24.770752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3ba83ecc-ba06-47ea-b754-8906d80e46ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:24.906240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3ba83ecc-ba06-47ea-b754-8906d80e46ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:24.916182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3ba83ecc-ba06-47ea-b754-8906d80e46ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.159461 Jul 14 16:06:24.916757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 966/2028] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:24 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:25.530121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e7ad60d9-32f2-4f49-9a97-5b0ff2ae88e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:25.530725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e7ad60d9-32f2-4f49-9a97-5b0ff2ae88e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:25.538156 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e7ad60d9-32f2-4f49-9a97-5b0ff2ae88e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:25.538864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e7ad60d9-32f2-4f49-9a97-5b0ff2ae88e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:25.539650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e7ad60d9-32f2-4f49-9a97-5b0ff2ae88e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:25.540101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e7ad60d9-32f2-4f49-9a97-5b0ff2ae88e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:25.673213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e7ad60d9-32f2-4f49-9a97-5b0ff2ae88e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:25.682583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e7ad60d9-32f2-4f49-9a97-5b0ff2ae88e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:25.684103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e7ad60d9-32f2-4f49-9a97-5b0ff2ae88e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:25.685336 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e7ad60d9-32f2-4f49-9a97-5b0ff2ae88e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.159247 Jul 14 16:06:25.685908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1063/2029] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:25 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:25.938138 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-97792437-d48e-4669-a729-836b37dcb698 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:25.938752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-97792437-d48e-4669-a729-836b37dcb698 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:25.945917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97792437-d48e-4669-a729-836b37dcb698 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:25.946369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97792437-d48e-4669-a729-836b37dcb698 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:25.947143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97792437-d48e-4669-a729-836b37dcb698 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:25.947579 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97792437-d48e-4669-a729-836b37dcb698 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:26.079658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-97792437-d48e-4669-a729-836b37dcb698 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:26.087710 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-97792437-d48e-4669-a729-836b37dcb698 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153473 Jul 14 16:06:26.088284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 967/2030] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:25 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:26.704251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-82183ef3-aa71-435b-a7ea-8265a5960322 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:26.704992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-82183ef3-aa71-435b-a7ea-8265a5960322 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:26.711839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-82183ef3-aa71-435b-a7ea-8265a5960322 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:26.712318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-82183ef3-aa71-435b-a7ea-8265a5960322 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:26.713066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-82183ef3-aa71-435b-a7ea-8265a5960322 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:26.713510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-82183ef3-aa71-435b-a7ea-8265a5960322 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:26.852279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-82183ef3-aa71-435b-a7ea-8265a5960322 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:26.861556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-82183ef3-aa71-435b-a7ea-8265a5960322 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:26.863733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-82183ef3-aa71-435b-a7ea-8265a5960322 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:26.864918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-82183ef3-aa71-435b-a7ea-8265a5960322 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.164733 Jul 14 16:06:26.865484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1064/2031] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:26 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:27.105751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-603ef345-1530-4cbe-8911-c2804c4a0aaa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:27.106367 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-603ef345-1530-4cbe-8911-c2804c4a0aaa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:27.113280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-603ef345-1530-4cbe-8911-c2804c4a0aaa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:27.113734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-603ef345-1530-4cbe-8911-c2804c4a0aaa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:27.114523 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-603ef345-1530-4cbe-8911-c2804c4a0aaa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:27.114969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-603ef345-1530-4cbe-8911-c2804c4a0aaa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:27.258447 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-603ef345-1530-4cbe-8911-c2804c4a0aaa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:27.266465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-603ef345-1530-4cbe-8911-c2804c4a0aaa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.164595 Jul 14 16:06:27.267041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 968/2032] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:27 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:27.883915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9132366e-d433-40aa-b26f-a93d2b6ec562 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:27.884531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9132366e-d433-40aa-b26f-a93d2b6ec562 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:27.890959 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9132366e-d433-40aa-b26f-a93d2b6ec562 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:27.891413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9132366e-d433-40aa-b26f-a93d2b6ec562 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:27.892821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9132366e-d433-40aa-b26f-a93d2b6ec562 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:27.893264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9132366e-d433-40aa-b26f-a93d2b6ec562 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:28.024479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9132366e-d433-40aa-b26f-a93d2b6ec562 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:28.032968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9132366e-d433-40aa-b26f-a93d2b6ec562 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:28.034480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9132366e-d433-40aa-b26f-a93d2b6ec562 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:28.035673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9132366e-d433-40aa-b26f-a93d2b6ec562 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.155741 Jul 14 16:06:28.036238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1065/2033] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:28.286092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-92a0dc07-d4f1-48ee-a818-513c7861f4a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:28.286666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-92a0dc07-d4f1-48ee-a818-513c7861f4a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:28.293532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92a0dc07-d4f1-48ee-a818-513c7861f4a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:28.293984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92a0dc07-d4f1-48ee-a818-513c7861f4a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:28.294778 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92a0dc07-d4f1-48ee-a818-513c7861f4a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:28.295217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92a0dc07-d4f1-48ee-a818-513c7861f4a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:28.435497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-92a0dc07-d4f1-48ee-a818-513c7861f4a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:28.443470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-92a0dc07-d4f1-48ee-a818-513c7861f4a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161570 Jul 14 16:06:28.444065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 969/2034] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:28 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:29.054756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0367c068-1675-43f1-aeb1-fccdc021013b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:29.055494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0367c068-1675-43f1-aeb1-fccdc021013b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:29.062152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0367c068-1675-43f1-aeb1-fccdc021013b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:29.062599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0367c068-1675-43f1-aeb1-fccdc021013b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:29.063459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0367c068-1675-43f1-aeb1-fccdc021013b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:29.063961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0367c068-1675-43f1-aeb1-fccdc021013b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:29.207313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0367c068-1675-43f1-aeb1-fccdc021013b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:29.216481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0367c068-1675-43f1-aeb1-fccdc021013b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:29.217977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0367c068-1675-43f1-aeb1-fccdc021013b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:29.219161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0367c068-1675-43f1-aeb1-fccdc021013b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.168460 Jul 14 16:06:29.219960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1066/2035] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:29 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:06:29.461173 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6f60719a-e389-44db-a1b3-5d7d109f497b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:29.462639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6f60719a-e389-44db-a1b3-5d7d109f497b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:29.470550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f60719a-e389-44db-a1b3-5d7d109f497b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:29.471154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f60719a-e389-44db-a1b3-5d7d109f497b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:29.471965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f60719a-e389-44db-a1b3-5d7d109f497b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:29.472407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f60719a-e389-44db-a1b3-5d7d109f497b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:29.477491 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:29.617930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6f60719a-e389-44db-a1b3-5d7d109f497b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:29.632884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6f60719a-e389-44db-a1b3-5d7d109f497b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.175641 Jul 14 16:06:29.633805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 970/2036] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:29 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:30.238986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-03652d21-8372-4a1e-b600-9f805a5a9706 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:30.239625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-03652d21-8372-4a1e-b600-9f805a5a9706 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:30.246154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03652d21-8372-4a1e-b600-9f805a5a9706 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:30.246658 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03652d21-8372-4a1e-b600-9f805a5a9706 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:30.247364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03652d21-8372-4a1e-b600-9f805a5a9706 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:30.247832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03652d21-8372-4a1e-b600-9f805a5a9706 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:30.379317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-03652d21-8372-4a1e-b600-9f805a5a9706 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:30.387794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-03652d21-8372-4a1e-b600-9f805a5a9706 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:30.389273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-03652d21-8372-4a1e-b600-9f805a5a9706 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:30.390426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-03652d21-8372-4a1e-b600-9f805a5a9706 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.156012 Jul 14 16:06:30.391035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1067/2037] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:30 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:30.651391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fecdfe01-ccb0-46b1-9619-7ea409ba58aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:30.652065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fecdfe01-ccb0-46b1-9619-7ea409ba58aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:30.659297 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fecdfe01-ccb0-46b1-9619-7ea409ba58aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:30.659799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fecdfe01-ccb0-46b1-9619-7ea409ba58aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:30.660588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fecdfe01-ccb0-46b1-9619-7ea409ba58aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:30.661041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fecdfe01-ccb0-46b1-9619-7ea409ba58aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:30.800887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fecdfe01-ccb0-46b1-9619-7ea409ba58aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:30.808912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fecdfe01-ccb0-46b1-9619-7ea409ba58aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161499 Jul 14 16:06:30.809492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 971/2038] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:30 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:31.409897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-469c58e0-63b8-47da-a5ee-ab153012c09a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:31.410513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-469c58e0-63b8-47da-a5ee-ab153012c09a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:31.412812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:31.418346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-469c58e0-63b8-47da-a5ee-ab153012c09a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:31.418791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-469c58e0-63b8-47da-a5ee-ab153012c09a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:31.419543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-469c58e0-63b8-47da-a5ee-ab153012c09a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:31.419997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-469c58e0-63b8-47da-a5ee-ab153012c09a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:31.561299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-469c58e0-63b8-47da-a5ee-ab153012c09a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:31.570069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-469c58e0-63b8-47da-a5ee-ab153012c09a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:31.571555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-469c58e0-63b8-47da-a5ee-ab153012c09a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:31.572747 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-469c58e0-63b8-47da-a5ee-ab153012c09a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.167361 Jul 14 16:06:31.573316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1068/2039] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:31 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:31.826726 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8f0edea6-4225-48f9-a081-cabf297fffe2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:31.827330 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8f0edea6-4225-48f9-a081-cabf297fffe2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:31.835016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f0edea6-4225-48f9-a081-cabf297fffe2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:31.835464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f0edea6-4225-48f9-a081-cabf297fffe2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:31.836271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f0edea6-4225-48f9-a081-cabf297fffe2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:31.836759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f0edea6-4225-48f9-a081-cabf297fffe2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:31.980576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8f0edea6-4225-48f9-a081-cabf297fffe2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:31.989292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8f0edea6-4225-48f9-a081-cabf297fffe2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.166468 Jul 14 16:06:31.989875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 972/2040] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:31 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:32.592808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-40329183-25a1-4e0f-8095-68caa937f281 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:32.593506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-40329183-25a1-4e0f-8095-68caa937f281 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:32.601407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40329183-25a1-4e0f-8095-68caa937f281 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:32.601888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40329183-25a1-4e0f-8095-68caa937f281 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:32.602646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40329183-25a1-4e0f-8095-68caa937f281 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:32.603070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40329183-25a1-4e0f-8095-68caa937f281 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:32.737993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-40329183-25a1-4e0f-8095-68caa937f281 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:32.746691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-40329183-25a1-4e0f-8095-68caa937f281 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:32.748224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-40329183-25a1-4e0f-8095-68caa937f281 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:32.749385 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-40329183-25a1-4e0f-8095-68caa937f281 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.161053 Jul 14 16:06:32.749942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1069/2041] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:33.007146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5f364339-429a-4606-88e1-faeaf91822b3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:33.007851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5f364339-429a-4606-88e1-faeaf91822b3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:33.014460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5f364339-429a-4606-88e1-faeaf91822b3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:33.014906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5f364339-429a-4606-88e1-faeaf91822b3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:33.015711 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5f364339-429a-4606-88e1-faeaf91822b3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:33.016170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5f364339-429a-4606-88e1-faeaf91822b3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:33.154574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5f364339-429a-4606-88e1-faeaf91822b3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:33.163445 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5f364339-429a-4606-88e1-faeaf91822b3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160389 Jul 14 16:06:33.164320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 973/2042] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:33 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:33.770608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-43dc6082-6d5b-4e63-9410-fcde31db4500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:33.771201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-43dc6082-6d5b-4e63-9410-fcde31db4500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:33.778477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-43dc6082-6d5b-4e63-9410-fcde31db4500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:33.778929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-43dc6082-6d5b-4e63-9410-fcde31db4500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:33.779721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-43dc6082-6d5b-4e63-9410-fcde31db4500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:33.780166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-43dc6082-6d5b-4e63-9410-fcde31db4500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:33.913566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-43dc6082-6d5b-4e63-9410-fcde31db4500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:33.922745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-43dc6082-6d5b-4e63-9410-fcde31db4500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:33.924458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-43dc6082-6d5b-4e63-9410-fcde31db4500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:33.925624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-43dc6082-6d5b-4e63-9410-fcde31db4500 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.160670 Jul 14 16:06:33.926187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1070/2043] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:33 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:34.181111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fb85f716-a859-41d8-82de-3f103f3e465f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:34.181733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fb85f716-a859-41d8-82de-3f103f3e465f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:34.188286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb85f716-a859-41d8-82de-3f103f3e465f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:34.188761 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb85f716-a859-41d8-82de-3f103f3e465f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:34.190253 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb85f716-a859-41d8-82de-3f103f3e465f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:34.190689 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb85f716-a859-41d8-82de-3f103f3e465f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:34.328001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fb85f716-a859-41d8-82de-3f103f3e465f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:34.337696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fb85f716-a859-41d8-82de-3f103f3e465f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160370 Jul 14 16:06:34.338279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 974/2044] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:34 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:34.944218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-449ec794-0861-4d64-8983-76faee8ce62d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:34.944818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-449ec794-0861-4d64-8983-76faee8ce62d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:34.951255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-449ec794-0861-4d64-8983-76faee8ce62d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:34.951736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-449ec794-0861-4d64-8983-76faee8ce62d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:34.952489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-449ec794-0861-4d64-8983-76faee8ce62d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:34.952924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-449ec794-0861-4d64-8983-76faee8ce62d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:35.335220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-449ec794-0861-4d64-8983-76faee8ce62d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:35.344109 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-449ec794-0861-4d64-8983-76faee8ce62d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:35.346114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-449ec794-0861-4d64-8983-76faee8ce62d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:35.347434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-449ec794-0861-4d64-8983-76faee8ce62d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.407167 Jul 14 16:06:35.348035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1071/2045] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:34 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:35.354147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-83d436b8-052f-4afd-86dc-35706351639f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:35.354754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-83d436b8-052f-4afd-86dc-35706351639f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:35.362149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83d436b8-052f-4afd-86dc-35706351639f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:35.362597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83d436b8-052f-4afd-86dc-35706351639f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:35.363370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83d436b8-052f-4afd-86dc-35706351639f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:35.363838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83d436b8-052f-4afd-86dc-35706351639f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:35.505406 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-83d436b8-052f-4afd-86dc-35706351639f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:35.513972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-83d436b8-052f-4afd-86dc-35706351639f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.163608 Jul 14 16:06:35.514544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 975/2046] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:35 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:36.373812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-983e164b-67b6-47e0-a94e-addfab699f8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:36.374410 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-983e164b-67b6-47e0-a94e-addfab699f8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:36.381893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-983e164b-67b6-47e0-a94e-addfab699f8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:36.382341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-983e164b-67b6-47e0-a94e-addfab699f8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:36.383167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-983e164b-67b6-47e0-a94e-addfab699f8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:36.383611 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-983e164b-67b6-47e0-a94e-addfab699f8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:36.521267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-983e164b-67b6-47e0-a94e-addfab699f8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:36.529844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-983e164b-67b6-47e0-a94e-addfab699f8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:36.530673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-60ed6cf3-dcd4-4176-97b4-3a90ba5da9e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:36.531328 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-60ed6cf3-dcd4-4176-97b4-3a90ba5da9e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:36.531454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-983e164b-67b6-47e0-a94e-addfab699f8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:36.532534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-983e164b-67b6-47e0-a94e-addfab699f8e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.170510 Jul 14 16:06:36.533799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1072/2047] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:36 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:36.538606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-60ed6cf3-dcd4-4176-97b4-3a90ba5da9e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:36.539313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-60ed6cf3-dcd4-4176-97b4-3a90ba5da9e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:36.540130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-60ed6cf3-dcd4-4176-97b4-3a90ba5da9e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:36.540595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-60ed6cf3-dcd4-4176-97b4-3a90ba5da9e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:36.679937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-60ed6cf3-dcd4-4176-97b4-3a90ba5da9e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:36.688269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-60ed6cf3-dcd4-4176-97b4-3a90ba5da9e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161358 Jul 14 16:06:36.688849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 976/2048] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:36 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:37.553618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f54ce7d3-ff43-4e6b-a16a-37dcc201379b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:37.554450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f54ce7d3-ff43-4e6b-a16a-37dcc201379b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:37.563515 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f54ce7d3-ff43-4e6b-a16a-37dcc201379b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:37.564279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f54ce7d3-ff43-4e6b-a16a-37dcc201379b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:37.565441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f54ce7d3-ff43-4e6b-a16a-37dcc201379b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:37.566097 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f54ce7d3-ff43-4e6b-a16a-37dcc201379b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:37.707190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0474a9d5-2269-4a63-aae9-7bad359a75c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:37.707894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0474a9d5-2269-4a63-aae9-7bad359a75c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:37.714439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0474a9d5-2269-4a63-aae9-7bad359a75c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:37.714848 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f54ce7d3-ff43-4e6b-a16a-37dcc201379b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:37.715000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0474a9d5-2269-4a63-aae9-7bad359a75c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:37.715698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0474a9d5-2269-4a63-aae9-7bad359a75c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:37.716160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0474a9d5-2269-4a63-aae9-7bad359a75c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:37.724477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f54ce7d3-ff43-4e6b-a16a-37dcc201379b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:37.726024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f54ce7d3-ff43-4e6b-a16a-37dcc201379b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:37.727309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f54ce7d3-ff43-4e6b-a16a-37dcc201379b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.179605 Jul 14 16:06:37.727805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1073/2049] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:37 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:37.851677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0474a9d5-2269-4a63-aae9-7bad359a75c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:37.859673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0474a9d5-2269-4a63-aae9-7bad359a75c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157177 Jul 14 16:06:37.860231 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 977/2050] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:37 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:38.746104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f163aec2-615c-4e68-b61d-d8afad5d401e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:38.746737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f163aec2-615c-4e68-b61d-d8afad5d401e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:38.754532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f163aec2-615c-4e68-b61d-d8afad5d401e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:38.754978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f163aec2-615c-4e68-b61d-d8afad5d401e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:38.755767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f163aec2-615c-4e68-b61d-d8afad5d401e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:38.756207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f163aec2-615c-4e68-b61d-d8afad5d401e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:38.878632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d4961ed8-7a44-45dd-9236-be03a705b445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:38.879921 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d4961ed8-7a44-45dd-9236-be03a705b445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:38.886022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d4961ed8-7a44-45dd-9236-be03a705b445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:38.886479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d4961ed8-7a44-45dd-9236-be03a705b445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:38.887363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d4961ed8-7a44-45dd-9236-be03a705b445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:38.887925 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d4961ed8-7a44-45dd-9236-be03a705b445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:38.914671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f163aec2-615c-4e68-b61d-d8afad5d401e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:38.923996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f163aec2-615c-4e68-b61d-d8afad5d401e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:38.925861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f163aec2-615c-4e68-b61d-d8afad5d401e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:38.927049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f163aec2-615c-4e68-b61d-d8afad5d401e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.184844 Jul 14 16:06:38.927837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1074/2051] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:39.028965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d4961ed8-7a44-45dd-9236-be03a705b445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:39.038091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d4961ed8-7a44-45dd-9236-be03a705b445 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.164556 Jul 14 16:06:39.038691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 978/2052] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:38 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:39.946589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-be775d8b-6a49-4d87-b965-05ddfb98a295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:39.947183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-be775d8b-6a49-4d87-b965-05ddfb98a295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:39.954159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-be775d8b-6a49-4d87-b965-05ddfb98a295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:39.955658 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-be775d8b-6a49-4d87-b965-05ddfb98a295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:39.956525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-be775d8b-6a49-4d87-b965-05ddfb98a295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:39.956960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-be775d8b-6a49-4d87-b965-05ddfb98a295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:40.055762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e1c48d2a-632b-480b-8469-b663ff311dab tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:40.056395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e1c48d2a-632b-480b-8469-b663ff311dab tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:40.058792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:40.065898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e1c48d2a-632b-480b-8469-b663ff311dab tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:40.066084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e1c48d2a-632b-480b-8469-b663ff311dab tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:40.066779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e1c48d2a-632b-480b-8469-b663ff311dab tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:40.067222 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e1c48d2a-632b-480b-8469-b663ff311dab tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:40.130722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-be775d8b-6a49-4d87-b965-05ddfb98a295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:40.140710 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-be775d8b-6a49-4d87-b965-05ddfb98a295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:40.142268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-be775d8b-6a49-4d87-b965-05ddfb98a295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:40.143535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-be775d8b-6a49-4d87-b965-05ddfb98a295 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.200926 Jul 14 16:06:40.144132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1075/2053] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:39 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:40.209294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e1c48d2a-632b-480b-8469-b663ff311dab tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:40.217514 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e1c48d2a-632b-480b-8469-b663ff311dab tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.165684 Jul 14 16:06:40.218100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 979/2054] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:40 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:40.520946 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:06:40.521214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:06:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:06:41.162967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6836ed82-5a1e-47fb-8108-2db92641d013 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:41.163633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6836ed82-5a1e-47fb-8108-2db92641d013 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:41.170388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6836ed82-5a1e-47fb-8108-2db92641d013 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:41.170829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6836ed82-5a1e-47fb-8108-2db92641d013 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:41.171622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6836ed82-5a1e-47fb-8108-2db92641d013 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:41.172066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6836ed82-5a1e-47fb-8108-2db92641d013 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:41.234594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1ae2d7b5-a924-4c71-bc57-8697eae1df24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:41.235462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1ae2d7b5-a924-4c71-bc57-8697eae1df24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:41.242237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1ae2d7b5-a924-4c71-bc57-8697eae1df24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:41.242767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1ae2d7b5-a924-4c71-bc57-8697eae1df24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:41.243557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1ae2d7b5-a924-4c71-bc57-8697eae1df24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:41.244026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1ae2d7b5-a924-4c71-bc57-8697eae1df24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:41.305566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6836ed82-5a1e-47fb-8108-2db92641d013 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:41.313977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6836ed82-5a1e-47fb-8108-2db92641d013 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:41.315483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6836ed82-5a1e-47fb-8108-2db92641d013 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:41.316681 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6836ed82-5a1e-47fb-8108-2db92641d013 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.157937 Jul 14 16:06:41.317250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1076/2055] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:41 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:41.383893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1ae2d7b5-a924-4c71-bc57-8697eae1df24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:41.391812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1ae2d7b5-a924-4c71-bc57-8697eae1df24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161291 Jul 14 16:06:41.392501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 980/2056] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:41 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:42.336216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-58a952d8-6381-427b-b3da-69b61102387e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:42.336742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-58a952d8-6381-427b-b3da-69b61102387e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:42.343264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-58a952d8-6381-427b-b3da-69b61102387e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:42.343756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-58a952d8-6381-427b-b3da-69b61102387e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:42.347357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-58a952d8-6381-427b-b3da-69b61102387e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:42.347917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-58a952d8-6381-427b-b3da-69b61102387e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:42.409218 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f9cfb370-c208-4b47-b893-b29fc33b1884 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:42.410081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f9cfb370-c208-4b47-b893-b29fc33b1884 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:42.417027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9cfb370-c208-4b47-b893-b29fc33b1884 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:42.417483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9cfb370-c208-4b47-b893-b29fc33b1884 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:42.418267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9cfb370-c208-4b47-b893-b29fc33b1884 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:42.418712 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9cfb370-c208-4b47-b893-b29fc33b1884 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:42.491966 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-58a952d8-6381-427b-b3da-69b61102387e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:42.500662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-58a952d8-6381-427b-b3da-69b61102387e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:42.502745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-58a952d8-6381-427b-b3da-69b61102387e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:42.504942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-58a952d8-6381-427b-b3da-69b61102387e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.172833 Jul 14 16:06:42.505747 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1077/2057] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:42 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:42.563448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f9cfb370-c208-4b47-b893-b29fc33b1884 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:42.572415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f9cfb370-c208-4b47-b893-b29fc33b1884 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.167970 Jul 14 16:06:42.572985 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 981/2058] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:42 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:43.522951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bc5c31ca-067a-406e-86f0-7f3605a637f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:43.523561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bc5c31ca-067a-406e-86f0-7f3605a637f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:43.530273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc5c31ca-067a-406e-86f0-7f3605a637f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:43.530721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc5c31ca-067a-406e-86f0-7f3605a637f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:43.531476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc5c31ca-067a-406e-86f0-7f3605a637f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:43.532048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc5c31ca-067a-406e-86f0-7f3605a637f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:43.589628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-315c64e7-6b40-4149-b67c-741b274d4c13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:43.590244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-315c64e7-6b40-4149-b67c-741b274d4c13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:43.597500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-315c64e7-6b40-4149-b67c-741b274d4c13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:43.597956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-315c64e7-6b40-4149-b67c-741b274d4c13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:43.598732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-315c64e7-6b40-4149-b67c-741b274d4c13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:43.599173 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-315c64e7-6b40-4149-b67c-741b274d4c13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:43.672926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bc5c31ca-067a-406e-86f0-7f3605a637f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:43.681748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bc5c31ca-067a-406e-86f0-7f3605a637f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:43.683255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bc5c31ca-067a-406e-86f0-7f3605a637f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:43.684448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bc5c31ca-067a-406e-86f0-7f3605a637f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.166056 Jul 14 16:06:43.685295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1078/2059] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:43 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:43.744417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-315c64e7-6b40-4149-b67c-741b274d4c13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:43.752602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-315c64e7-6b40-4149-b67c-741b274d4c13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.166906 Jul 14 16:06:43.754344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 982/2060] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:43 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:44.703778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-97d1f988-ff24-4ed7-a2b6-a31896379408 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:44.704401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-97d1f988-ff24-4ed7-a2b6-a31896379408 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:44.711624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97d1f988-ff24-4ed7-a2b6-a31896379408 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:44.712082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97d1f988-ff24-4ed7-a2b6-a31896379408 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:44.712934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97d1f988-ff24-4ed7-a2b6-a31896379408 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:44.713368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97d1f988-ff24-4ed7-a2b6-a31896379408 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:44.717229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:44.771514 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f9e26c06-da64-44bd-9c68-955c2354acca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:44.772287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f9e26c06-da64-44bd-9c68-955c2354acca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:44.779587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9e26c06-da64-44bd-9c68-955c2354acca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:44.780055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9e26c06-da64-44bd-9c68-955c2354acca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:44.780971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9e26c06-da64-44bd-9c68-955c2354acca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:44.781524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9e26c06-da64-44bd-9c68-955c2354acca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:44.848188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-97d1f988-ff24-4ed7-a2b6-a31896379408 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:44.856931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-97d1f988-ff24-4ed7-a2b6-a31896379408 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:44.858440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-97d1f988-ff24-4ed7-a2b6-a31896379408 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:44.859614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-97d1f988-ff24-4ed7-a2b6-a31896379408 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.159811 Jul 14 16:06:44.860218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1079/2061] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:44.916958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f9e26c06-da64-44bd-9c68-955c2354acca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:44.924811 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f9e26c06-da64-44bd-9c68-955c2354acca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158353 Jul 14 16:06:44.925482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 983/2062] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:44 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:45.878483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-56ac0865-a0e6-4adc-8ab5-621a75981226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:45.879341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-56ac0865-a0e6-4adc-8ab5-621a75981226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:45.885738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-56ac0865-a0e6-4adc-8ab5-621a75981226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:45.886192 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-56ac0865-a0e6-4adc-8ab5-621a75981226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:45.887008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-56ac0865-a0e6-4adc-8ab5-621a75981226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:45.887443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-56ac0865-a0e6-4adc-8ab5-621a75981226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:45.941137 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3bb77c45-14af-4e49-87b7-dcdd5b4d1ad2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:45.941752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3bb77c45-14af-4e49-87b7-dcdd5b4d1ad2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:45.948683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bb77c45-14af-4e49-87b7-dcdd5b4d1ad2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:45.949210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bb77c45-14af-4e49-87b7-dcdd5b4d1ad2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:45.950050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bb77c45-14af-4e49-87b7-dcdd5b4d1ad2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:45.950656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bb77c45-14af-4e49-87b7-dcdd5b4d1ad2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:46.023008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-56ac0865-a0e6-4adc-8ab5-621a75981226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:46.031494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-56ac0865-a0e6-4adc-8ab5-621a75981226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:46.033163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-56ac0865-a0e6-4adc-8ab5-621a75981226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:46.034339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-56ac0865-a0e6-4adc-8ab5-621a75981226 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.159855 Jul 14 16:06:46.035455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1080/2063] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:45 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:46.085182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3bb77c45-14af-4e49-87b7-dcdd5b4d1ad2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:46.093200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3bb77c45-14af-4e49-87b7-dcdd5b4d1ad2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155992 Jul 14 16:06:46.093768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 984/2064] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:45 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:47.054008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f7f6b75e-61d6-4821-a56f-5d483b87d1e8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:47.054633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f7f6b75e-61d6-4821-a56f-5d483b87d1e8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:47.061256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f7f6b75e-61d6-4821-a56f-5d483b87d1e8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:47.061700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f7f6b75e-61d6-4821-a56f-5d483b87d1e8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:47.062453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f7f6b75e-61d6-4821-a56f-5d483b87d1e8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:47.062888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f7f6b75e-61d6-4821-a56f-5d483b87d1e8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:47.112496 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8e3ce232-5338-4722-b54e-dde1780aa03e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:47.114255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8e3ce232-5338-4722-b54e-dde1780aa03e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:47.120403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e3ce232-5338-4722-b54e-dde1780aa03e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:47.120850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e3ce232-5338-4722-b54e-dde1780aa03e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:47.121608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e3ce232-5338-4722-b54e-dde1780aa03e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:47.122045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e3ce232-5338-4722-b54e-dde1780aa03e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:47.196452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f7f6b75e-61d6-4821-a56f-5d483b87d1e8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:47.204677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f7f6b75e-61d6-4821-a56f-5d483b87d1e8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:47.206159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f7f6b75e-61d6-4821-a56f-5d483b87d1e8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:47.207735 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f7f6b75e-61d6-4821-a56f-5d483b87d1e8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.158364 Jul 14 16:06:47.208299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1081/2065] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:47 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:47.259026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8e3ce232-5338-4722-b54e-dde1780aa03e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:47.266969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8e3ce232-5338-4722-b54e-dde1780aa03e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.159197 Jul 14 16:06:47.267538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 985/2066] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:47 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:48.225691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0373b395-d0d1-4bf2-b4e3-0fc8ff9b8bc9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:48.226322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0373b395-d0d1-4bf2-b4e3-0fc8ff9b8bc9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:48.232983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0373b395-d0d1-4bf2-b4e3-0fc8ff9b8bc9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:48.233432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0373b395-d0d1-4bf2-b4e3-0fc8ff9b8bc9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:48.234187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0373b395-d0d1-4bf2-b4e3-0fc8ff9b8bc9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:48.234618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0373b395-d0d1-4bf2-b4e3-0fc8ff9b8bc9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:48.285805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d1400dc7-78fc-4293-8207-620ef6662e08 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:48.286420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d1400dc7-78fc-4293-8207-620ef6662e08 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:48.293203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d1400dc7-78fc-4293-8207-620ef6662e08 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:48.293693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d1400dc7-78fc-4293-8207-620ef6662e08 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:48.294470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d1400dc7-78fc-4293-8207-620ef6662e08 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:48.294903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d1400dc7-78fc-4293-8207-620ef6662e08 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:48.372204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0373b395-d0d1-4bf2-b4e3-0fc8ff9b8bc9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:48.380862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0373b395-d0d1-4bf2-b4e3-0fc8ff9b8bc9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:48.382405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0373b395-d0d1-4bf2-b4e3-0fc8ff9b8bc9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:48.383646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0373b395-d0d1-4bf2-b4e3-0fc8ff9b8bc9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.162669 Jul 14 16:06:48.384202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1082/2067] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:48 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:48.429558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d1400dc7-78fc-4293-8207-620ef6662e08 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:48.432951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:06:48.438432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d1400dc7-78fc-4293-8207-620ef6662e08 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157488 Jul 14 16:06:48.439009 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 986/2068] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:48 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:48.872666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:06:48.872922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:06:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:06:49.402141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-88438d95-42f1-4a07-bb31-14819b98ed87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:49.402733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-88438d95-42f1-4a07-bb31-14819b98ed87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:49.409138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-88438d95-42f1-4a07-bb31-14819b98ed87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:49.410077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-88438d95-42f1-4a07-bb31-14819b98ed87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:49.410834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-88438d95-42f1-4a07-bb31-14819b98ed87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:49.411255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-88438d95-42f1-4a07-bb31-14819b98ed87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:49.455431 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6d1a8216-04db-4919-9e2a-5a6f726b8519 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:49.456101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6d1a8216-04db-4919-9e2a-5a6f726b8519 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:49.462775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6d1a8216-04db-4919-9e2a-5a6f726b8519 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:49.463231 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6d1a8216-04db-4919-9e2a-5a6f726b8519 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:49.464047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6d1a8216-04db-4919-9e2a-5a6f726b8519 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:49.464489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6d1a8216-04db-4919-9e2a-5a6f726b8519 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:49.549848 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-88438d95-42f1-4a07-bb31-14819b98ed87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:49.561407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-88438d95-42f1-4a07-bb31-14819b98ed87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:49.562917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-88438d95-42f1-4a07-bb31-14819b98ed87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:49.564106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-88438d95-42f1-4a07-bb31-14819b98ed87 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.165877 Jul 14 16:06:49.564664 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1083/2069] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:49 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:49.601817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6d1a8216-04db-4919-9e2a-5a6f726b8519 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:49.609929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6d1a8216-04db-4919-9e2a-5a6f726b8519 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158626 Jul 14 16:06:49.610485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 987/2070] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:49 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:06:50.582332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f4bed769-2bd5-496e-8470-33631184b79a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:50.582944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f4bed769-2bd5-496e-8470-33631184b79a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:50.589587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4bed769-2bd5-496e-8470-33631184b79a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:50.590041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4bed769-2bd5-496e-8470-33631184b79a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:50.590960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4bed769-2bd5-496e-8470-33631184b79a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:50.591406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4bed769-2bd5-496e-8470-33631184b79a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:50.626854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5517b604-13bc-4838-b36d-2562f759a1a0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:50.627393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5517b604-13bc-4838-b36d-2562f759a1a0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:50.634698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5517b604-13bc-4838-b36d-2562f759a1a0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:50.635154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5517b604-13bc-4838-b36d-2562f759a1a0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:50.635966 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5517b604-13bc-4838-b36d-2562f759a1a0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:50.636414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5517b604-13bc-4838-b36d-2562f759a1a0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:50.766224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5517b604-13bc-4838-b36d-2562f759a1a0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:50.774682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5517b604-13bc-4838-b36d-2562f759a1a0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151647 Jul 14 16:06:50.777789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f4bed769-2bd5-496e-8470-33631184b79a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:50.781744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 988/2071] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:50 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:50.786701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f4bed769-2bd5-496e-8470-33631184b79a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:50.788402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f4bed769-2bd5-496e-8470-33631184b79a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:50.789837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f4bed769-2bd5-496e-8470-33631184b79a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.211536 Jul 14 16:06:50.801038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1084/2072] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:50 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:51.798391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6b4afce2-d788-4cb0-a781-c2263c9a81d3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:51.799158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6b4afce2-d788-4cb0-a781-c2263c9a81d3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:51.809733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b4afce2-d788-4cb0-a781-c2263c9a81d3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:51.810302 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b4afce2-d788-4cb0-a781-c2263c9a81d3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:51.810921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1ecad39b-bd14-49e3-84f2-9c6cbedbc083 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:51.811377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b4afce2-d788-4cb0-a781-c2263c9a81d3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:51.811530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b4afce2-d788-4cb0-a781-c2263c9a81d3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:51.811669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1ecad39b-bd14-49e3-84f2-9c6cbedbc083 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:51.818818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1ecad39b-bd14-49e3-84f2-9c6cbedbc083 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:51.819275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1ecad39b-bd14-49e3-84f2-9c6cbedbc083 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:51.820119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1ecad39b-bd14-49e3-84f2-9c6cbedbc083 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:51.820564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1ecad39b-bd14-49e3-84f2-9c6cbedbc083 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:51.945411 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6b4afce2-d788-4cb0-a781-c2263c9a81d3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:51.953814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6b4afce2-d788-4cb0-a781-c2263c9a81d3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.159297 Jul 14 16:06:51.954762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 989/2073] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:51 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:51.957417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1ecad39b-bd14-49e3-84f2-9c6cbedbc083 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:51.974485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1ecad39b-bd14-49e3-84f2-9c6cbedbc083 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:51.975994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1ecad39b-bd14-49e3-84f2-9c6cbedbc083 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:51.977154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1ecad39b-bd14-49e3-84f2-9c6cbedbc083 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.171597 Jul 14 16:06:51.977728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1085/2074] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:51 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:06:52.971799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-064ca4a6-1061-4368-99d8-410a8a1b259b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:52.973351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-064ca4a6-1061-4368-99d8-410a8a1b259b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:52.979652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-064ca4a6-1061-4368-99d8-410a8a1b259b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:52.980112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-064ca4a6-1061-4368-99d8-410a8a1b259b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:52.980887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-064ca4a6-1061-4368-99d8-410a8a1b259b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:52.981327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-064ca4a6-1061-4368-99d8-410a8a1b259b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:52.996095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-09d6fd4f-9457-4b0d-9664-9d6e3596ecb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:52.997205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-09d6fd4f-9457-4b0d-9664-9d6e3596ecb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:53.003644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-09d6fd4f-9457-4b0d-9664-9d6e3596ecb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:53.004323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-09d6fd4f-9457-4b0d-9664-9d6e3596ecb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:53.005345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-09d6fd4f-9457-4b0d-9664-9d6e3596ecb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:53.005794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-09d6fd4f-9457-4b0d-9664-9d6e3596ecb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:53.126010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-064ca4a6-1061-4368-99d8-410a8a1b259b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:53.134130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-064ca4a6-1061-4368-99d8-410a8a1b259b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.166168 Jul 14 16:06:53.134884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 990/2075] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:52 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:53.144448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-09d6fd4f-9457-4b0d-9664-9d6e3596ecb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:53.153145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-09d6fd4f-9457-4b0d-9664-9d6e3596ecb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:53.154651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-09d6fd4f-9457-4b0d-9664-9d6e3596ecb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:53.155837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-09d6fd4f-9457-4b0d-9664-9d6e3596ecb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.163917 Jul 14 16:06:53.156506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1086/2076] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:52 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:06:54.152082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1fd9d7cc-63fc-4296-8c7d-61e84282a92e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:54.152700 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1fd9d7cc-63fc-4296-8c7d-61e84282a92e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:54.160196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fd9d7cc-63fc-4296-8c7d-61e84282a92e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:54.160959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fd9d7cc-63fc-4296-8c7d-61e84282a92e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:54.161786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fd9d7cc-63fc-4296-8c7d-61e84282a92e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:54.162233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1fd9d7cc-63fc-4296-8c7d-61e84282a92e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:54.174370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4a92bf39-5ed9-4e9e-ae88-bb3435763768 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:54.174986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4a92bf39-5ed9-4e9e-ae88-bb3435763768 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:54.182678 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a92bf39-5ed9-4e9e-ae88-bb3435763768 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:54.183128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a92bf39-5ed9-4e9e-ae88-bb3435763768 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:54.183957 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a92bf39-5ed9-4e9e-ae88-bb3435763768 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:54.184395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a92bf39-5ed9-4e9e-ae88-bb3435763768 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:54.307873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1fd9d7cc-63fc-4296-8c7d-61e84282a92e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:54.317204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1fd9d7cc-63fc-4296-8c7d-61e84282a92e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.168159 Jul 14 16:06:54.320789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 991/2077] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:54 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:54.325115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4a92bf39-5ed9-4e9e-ae88-bb3435763768 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:54.334396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4a92bf39-5ed9-4e9e-ae88-bb3435763768 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:54.335908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4a92bf39-5ed9-4e9e-ae88-bb3435763768 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:54.337063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4a92bf39-5ed9-4e9e-ae88-bb3435763768 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.166608 Jul 14 16:06:54.337794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1087/2078] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:54 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:06:55.337728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-43ea2c5f-8115-4a11-ba00-2226d8f8a868 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:55.338333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-43ea2c5f-8115-4a11-ba00-2226d8f8a868 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:55.344829 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43ea2c5f-8115-4a11-ba00-2226d8f8a868 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:55.345281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43ea2c5f-8115-4a11-ba00-2226d8f8a868 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:55.346039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43ea2c5f-8115-4a11-ba00-2226d8f8a868 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:55.346483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43ea2c5f-8115-4a11-ba00-2226d8f8a868 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:55.354705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c5a43214-4f06-45a2-a5e8-fd80552b7f47 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:55.355324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c5a43214-4f06-45a2-a5e8-fd80552b7f47 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:55.363531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5a43214-4f06-45a2-a5e8-fd80552b7f47 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:55.364720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5a43214-4f06-45a2-a5e8-fd80552b7f47 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:55.365508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5a43214-4f06-45a2-a5e8-fd80552b7f47 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:55.366039 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c5a43214-4f06-45a2-a5e8-fd80552b7f47 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:55.493758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-43ea2c5f-8115-4a11-ba00-2226d8f8a868 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:55.502512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c5a43214-4f06-45a2-a5e8-fd80552b7f47 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:55.503332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-43ea2c5f-8115-4a11-ba00-2226d8f8a868 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.169410 Jul 14 16:06:55.504124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 992/2079] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:55 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:55.513704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c5a43214-4f06-45a2-a5e8-fd80552b7f47 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:55.514500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c5a43214-4f06-45a2-a5e8-fd80552b7f47 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:55.516729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c5a43214-4f06-45a2-a5e8-fd80552b7f47 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.165570 Jul 14 16:06:55.517360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1088/2080] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:55 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:06:56.522915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ec20bf7c-d1ac-403c-b35d-888edc9854c4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:56.523559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ec20bf7c-d1ac-403c-b35d-888edc9854c4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:56.531571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec20bf7c-d1ac-403c-b35d-888edc9854c4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:56.532151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec20bf7c-d1ac-403c-b35d-888edc9854c4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:56.532949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec20bf7c-d1ac-403c-b35d-888edc9854c4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:56.533392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec20bf7c-d1ac-403c-b35d-888edc9854c4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:56.535863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-abde39f6-6404-45f0-bf87-061817a75192 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:56.537031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-abde39f6-6404-45f0-bf87-061817a75192 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:56.544594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abde39f6-6404-45f0-bf87-061817a75192 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:56.545084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abde39f6-6404-45f0-bf87-061817a75192 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:56.546021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abde39f6-6404-45f0-bf87-061817a75192 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:56.546476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-abde39f6-6404-45f0-bf87-061817a75192 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:56.697075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ec20bf7c-d1ac-403c-b35d-888edc9854c4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:56.705556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ec20bf7c-d1ac-403c-b35d-888edc9854c4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.188495 Jul 14 16:06:56.706833 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 993/2081] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:56 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:56.718818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-abde39f6-6404-45f0-bf87-061817a75192 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:56.731947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-abde39f6-6404-45f0-bf87-061817a75192 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:56.734590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-abde39f6-6404-45f0-bf87-061817a75192 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:56.735894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-abde39f6-6404-45f0-bf87-061817a75192 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.205064 Jul 14 16:06:56.736512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1089/2082] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:56 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:06:57.725751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ea89775e-29ae-4cde-9d59-1353035228c9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:57.726384 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ea89775e-29ae-4cde-9d59-1353035228c9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:57.732915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea89775e-29ae-4cde-9d59-1353035228c9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:57.733362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea89775e-29ae-4cde-9d59-1353035228c9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:57.734114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea89775e-29ae-4cde-9d59-1353035228c9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:57.734547 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ea89775e-29ae-4cde-9d59-1353035228c9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:57.756240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6e491302-1008-4607-ae90-b8ea5ef3412d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:57.756955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6e491302-1008-4607-ae90-b8ea5ef3412d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:57.763567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6e491302-1008-4607-ae90-b8ea5ef3412d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:57.764050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6e491302-1008-4607-ae90-b8ea5ef3412d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:57.764920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6e491302-1008-4607-ae90-b8ea5ef3412d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:57.765366 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6e491302-1008-4607-ae90-b8ea5ef3412d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:57.870172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ea89775e-29ae-4cde-9d59-1353035228c9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:57.878571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ea89775e-29ae-4cde-9d59-1353035228c9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157328 Jul 14 16:06:57.879892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 994/2083] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:57 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:57.905095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6e491302-1008-4607-ae90-b8ea5ef3412d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:57.913709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6e491302-1008-4607-ae90-b8ea5ef3412d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:57.915458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6e491302-1008-4607-ae90-b8ea5ef3412d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:57.916638 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6e491302-1008-4607-ae90-b8ea5ef3412d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.165036 Jul 14 16:06:57.917200 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1090/2084] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:57 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:06:58.896742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-04bf873f-9c03-4471-81e3-9c6c2b99ebeb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:58.897365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-04bf873f-9c03-4471-81e3-9c6c2b99ebeb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:58.903903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04bf873f-9c03-4471-81e3-9c6c2b99ebeb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:58.904352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04bf873f-9c03-4471-81e3-9c6c2b99ebeb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:58.905124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04bf873f-9c03-4471-81e3-9c6c2b99ebeb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:58.905564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04bf873f-9c03-4471-81e3-9c6c2b99ebeb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:58.935321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a8df4aeb-cd76-488b-bdb4-28ab5581fbf7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:06:58.935966 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a8df4aeb-cd76-488b-bdb4-28ab5581fbf7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:06:58.943508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8df4aeb-cd76-488b-bdb4-28ab5581fbf7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:58.943992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8df4aeb-cd76-488b-bdb4-28ab5581fbf7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:58.944768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8df4aeb-cd76-488b-bdb4-28ab5581fbf7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:06:58.945208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8df4aeb-cd76-488b-bdb4-28ab5581fbf7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:06:59.043900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-04bf873f-9c03-4471-81e3-9c6c2b99ebeb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:59.052717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-04bf873f-9c03-4471-81e3-9c6c2b99ebeb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160015 Jul 14 16:06:59.053292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 995/2085] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:06:58 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:06:59.084687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a8df4aeb-cd76-488b-bdb4-28ab5581fbf7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:59.093001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a8df4aeb-cd76-488b-bdb4-28ab5581fbf7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:59.094517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a8df4aeb-cd76-488b-bdb4-28ab5581fbf7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:06:59.095708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a8df4aeb-cd76-488b-bdb4-28ab5581fbf7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.164479 Jul 14 16:06:59.096267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1091/2086] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:06:58 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:00.071137 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4af02c94-b9d7-4068-8e3e-5a33133c1d21 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:00.071782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4af02c94-b9d7-4068-8e3e-5a33133c1d21 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:00.078310 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4af02c94-b9d7-4068-8e3e-5a33133c1d21 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:00.078762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4af02c94-b9d7-4068-8e3e-5a33133c1d21 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:00.079535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4af02c94-b9d7-4068-8e3e-5a33133c1d21 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:00.079995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4af02c94-b9d7-4068-8e3e-5a33133c1d21 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:00.114616 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-27f382c7-3e12-44df-9f4c-ec9cc9697001 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:00.115396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-27f382c7-3e12-44df-9f4c-ec9cc9697001 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:00.122332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27f382c7-3e12-44df-9f4c-ec9cc9697001 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:00.122730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27f382c7-3e12-44df-9f4c-ec9cc9697001 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:00.123541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27f382c7-3e12-44df-9f4c-ec9cc9697001 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:00.124035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27f382c7-3e12-44df-9f4c-ec9cc9697001 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:00.214716 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4af02c94-b9d7-4068-8e3e-5a33133c1d21 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:00.222715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4af02c94-b9d7-4068-8e3e-5a33133c1d21 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156043 Jul 14 16:07:00.223288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 996/2087] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:00 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:00.263696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-27f382c7-3e12-44df-9f4c-ec9cc9697001 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:00.270256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-27f382c7-3e12-44df-9f4c-ec9cc9697001 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:00.272295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-27f382c7-3e12-44df-9f4c-ec9cc9697001 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:00.273448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-27f382c7-3e12-44df-9f4c-ec9cc9697001 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.162971 Jul 14 16:07:00.280223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1092/2088] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:00 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:01.240682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-138e0a89-d310-41d7-81e9-5ef7e16d852c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:01.241577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-138e0a89-d310-41d7-81e9-5ef7e16d852c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:01.249622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-138e0a89-d310-41d7-81e9-5ef7e16d852c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:01.249984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-138e0a89-d310-41d7-81e9-5ef7e16d852c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:01.250770 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-138e0a89-d310-41d7-81e9-5ef7e16d852c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:01.251215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-138e0a89-d310-41d7-81e9-5ef7e16d852c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:01.304495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-52a476e3-de0b-4823-93b8-8bf28aabd793 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:01.305100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-52a476e3-de0b-4823-93b8-8bf28aabd793 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:01.311884 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52a476e3-de0b-4823-93b8-8bf28aabd793 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:01.312338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52a476e3-de0b-4823-93b8-8bf28aabd793 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:01.313109 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52a476e3-de0b-4823-93b8-8bf28aabd793 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:01.313551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-52a476e3-de0b-4823-93b8-8bf28aabd793 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:01.406609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-138e0a89-d310-41d7-81e9-5ef7e16d852c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:01.419704 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-138e0a89-d310-41d7-81e9-5ef7e16d852c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.183566 Jul 14 16:07:01.420283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 997/2089] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:01 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:01.463917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-52a476e3-de0b-4823-93b8-8bf28aabd793 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:01.472676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-52a476e3-de0b-4823-93b8-8bf28aabd793 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:01.474744 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-52a476e3-de0b-4823-93b8-8bf28aabd793 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:01.475961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-52a476e3-de0b-4823-93b8-8bf28aabd793 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1800 microversion: 2.20 time: 0.176240 Jul 14 16:07:01.476519 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1093/2090] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:01 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1800 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:02.438473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-303c4e66-baef-4475-8b4b-671cf33367c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:02.439174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-303c4e66-baef-4475-8b4b-671cf33367c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:02.441824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=52 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:02.452989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-303c4e66-baef-4475-8b4b-671cf33367c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:02.453654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-303c4e66-baef-4475-8b4b-671cf33367c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:02.454880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-303c4e66-baef-4475-8b4b-671cf33367c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:02.455484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-303c4e66-baef-4475-8b4b-671cf33367c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:02.619985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-303c4e66-baef-4475-8b4b-671cf33367c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:02.630697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-303c4e66-baef-4475-8b4b-671cf33367c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.195663 Jul 14 16:07:02.633628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1094/2091] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:02 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:07:02.640077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0408fd3e-e34a-4d40-bd96-14e0a5766b4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:02.640996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0408fd3e-e34a-4d40-bd96-14e0a5766b4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:02.649371 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0408fd3e-e34a-4d40-bd96-14e0a5766b4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:02.649667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-c226d413-085f-4f90-86d8-644948ab0135 req-976da5c1-d0f7-4419-a2f0-4feb8536222a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e5c8cb95-bde5-4c91-99de-27aa44a822bf", "name": "network-vif-deleted", "tag": "daed7bb6-45ad-49c9-829a-e0e2a0eca7f9"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:07:02.650133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0408fd3e-e34a-4d40-bd96-14e0a5766b4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:02.650775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0408fd3e-e34a-4d40-bd96-14e0a5766b4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:02.651273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0408fd3e-e34a-4d40-bd96-14e0a5766b4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:02.657679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-c226d413-085f-4f90-86d8-644948ab0135 req-976da5c1-d0f7-4419-a2f0-4feb8536222a service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:02.658126 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-c226d413-085f-4f90-86d8-644948ab0135 req-976da5c1-d0f7-4419-a2f0-4feb8536222a service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:02.669833 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-c226d413-085f-4f90-86d8-644948ab0135 req-976da5c1-d0f7-4419-a2f0-4feb8536222a service nova] Creating event network-vif-deleted:daed7bb6-45ad-49c9-829a-e0e2a0eca7f9 for instance e5c8cb95-bde5-4c91-99de-27aa44a822bf on hv-cinder-82651 Jul 14 16:07:02.674960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-c226d413-085f-4f90-86d8-644948ab0135 req-976da5c1-d0f7-4419-a2f0-4feb8536222a service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.292523 Jul 14 16:07:02.675560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 998/2092] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:07:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:07:02.718461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0408fd3e-e34a-4d40-bd96-14e0a5766b4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:02.721784 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:02.727967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0408fd3e-e34a-4d40-bd96-14e0a5766b4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:02.729454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0408fd3e-e34a-4d40-bd96-14e0a5766b4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:02.730588 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0408fd3e-e34a-4d40-bd96-14e0a5766b4b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.095787 Jul 14 16:07:02.731142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1095/2093] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:03.651462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bf400526-42b6-478f-a8e8-9242c7f45078 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:03.652201 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bf400526-42b6-478f-a8e8-9242c7f45078 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:03.658432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf400526-42b6-478f-a8e8-9242c7f45078 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:03.658885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf400526-42b6-478f-a8e8-9242c7f45078 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:03.659670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf400526-42b6-478f-a8e8-9242c7f45078 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:03.660430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf400526-42b6-478f-a8e8-9242c7f45078 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:03.750204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b14a1503-d68c-441a-a578-7aec8b733a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:03.750915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b14a1503-d68c-441a-a578-7aec8b733a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:03.757852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b14a1503-d68c-441a-a578-7aec8b733a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:03.758381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b14a1503-d68c-441a-a578-7aec8b733a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:03.759314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b14a1503-d68c-441a-a578-7aec8b733a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:03.759913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b14a1503-d68c-441a-a578-7aec8b733a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:03.793662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bf400526-42b6-478f-a8e8-9242c7f45078 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:03.801908 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bf400526-42b6-478f-a8e8-9242c7f45078 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155150 Jul 14 16:07:03.802587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 999/2094] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:03 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:03.823241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b14a1503-d68c-441a-a578-7aec8b733a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:03.831767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b14a1503-d68c-441a-a578-7aec8b733a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:03.833873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b14a1503-d68c-441a-a578-7aec8b733a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:03.835010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b14a1503-d68c-441a-a578-7aec8b733a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088674 Jul 14 16:07:03.835851 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1096/2095] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:04.819474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7b41ebed-cc41-4b8b-9783-7f03cadeca91 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:04.820114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7b41ebed-cc41-4b8b-9783-7f03cadeca91 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:04.826971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b41ebed-cc41-4b8b-9783-7f03cadeca91 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.827426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b41ebed-cc41-4b8b-9783-7f03cadeca91 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.828269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b41ebed-cc41-4b8b-9783-7f03cadeca91 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.828715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7b41ebed-cc41-4b8b-9783-7f03cadeca91 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.852767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b3850e8f-8032-4ad5-879a-928ea5decebb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:04.853386 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b3850e8f-8032-4ad5-879a-928ea5decebb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:04.860005 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b3850e8f-8032-4ad5-879a-928ea5decebb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.860458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b3850e8f-8032-4ad5-879a-928ea5decebb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.861224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b3850e8f-8032-4ad5-879a-928ea5decebb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:04.861665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b3850e8f-8032-4ad5-879a-928ea5decebb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:04.926698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b3850e8f-8032-4ad5-879a-928ea5decebb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:04.936253 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b3850e8f-8032-4ad5-879a-928ea5decebb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:04.937779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b3850e8f-8032-4ad5-879a-928ea5decebb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:04.938939 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b3850e8f-8032-4ad5-879a-928ea5decebb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090089 Jul 14 16:07:04.939533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1097/2096] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:04.971022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7b41ebed-cc41-4b8b-9783-7f03cadeca91 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:04.979238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7b41ebed-cc41-4b8b-9783-7f03cadeca91 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.164712 Jul 14 16:07:04.979840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1000/2097] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:04 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:05.997347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-877db71a-3024-4588-bfec-d04bcdff58d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:05.998080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-877db71a-3024-4588-bfec-d04bcdff58d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:06.004832 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-877db71a-3024-4588-bfec-d04bcdff58d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:06.006451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-877db71a-3024-4588-bfec-d04bcdff58d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:06.007294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-877db71a-3024-4588-bfec-d04bcdff58d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:06.007763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-877db71a-3024-4588-bfec-d04bcdff58d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:06.091760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4d969739-7f64-4990-91c5-15e8fbe34919 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:06.092378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4d969739-7f64-4990-91c5-15e8fbe34919 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:06.098529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4d969739-7f64-4990-91c5-15e8fbe34919 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:06.099548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4d969739-7f64-4990-91c5-15e8fbe34919 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:06.100348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4d969739-7f64-4990-91c5-15e8fbe34919 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:06.100786 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4d969739-7f64-4990-91c5-15e8fbe34919 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:06.139546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-877db71a-3024-4588-bfec-d04bcdff58d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:06.148272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-877db71a-3024-4588-bfec-d04bcdff58d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154864 Jul 14 16:07:06.148861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1001/2098] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:05 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:07:06.163714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4d969739-7f64-4990-91c5-15e8fbe34919 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:06.172473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4d969739-7f64-4990-91c5-15e8fbe34919 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:06.173995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4d969739-7f64-4990-91c5-15e8fbe34919 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:06.175137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4d969739-7f64-4990-91c5-15e8fbe34919 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.216905 Jul 14 16:07:06.175704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1098/2099] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:05 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:07.166048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-63659e1d-fa4d-464a-b757-ae9ece474967 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:07.166670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-63659e1d-fa4d-464a-b757-ae9ece474967 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:07.173273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-63659e1d-fa4d-464a-b757-ae9ece474967 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:07.173739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-63659e1d-fa4d-464a-b757-ae9ece474967 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:07.174488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-63659e1d-fa4d-464a-b757-ae9ece474967 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:07.174926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-63659e1d-fa4d-464a-b757-ae9ece474967 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:07.192221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f3d9ae3e-e12a-41cf-a9e8-73ea14592823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:07.193423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f3d9ae3e-e12a-41cf-a9e8-73ea14592823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:07.200023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3d9ae3e-e12a-41cf-a9e8-73ea14592823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:07.200475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3d9ae3e-e12a-41cf-a9e8-73ea14592823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:07.201235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3d9ae3e-e12a-41cf-a9e8-73ea14592823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:07.201707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3d9ae3e-e12a-41cf-a9e8-73ea14592823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:07.276220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f3d9ae3e-e12a-41cf-a9e8-73ea14592823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:07.285010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f3d9ae3e-e12a-41cf-a9e8-73ea14592823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:07.287233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f3d9ae3e-e12a-41cf-a9e8-73ea14592823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:07.288418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f3d9ae3e-e12a-41cf-a9e8-73ea14592823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.100253 Jul 14 16:07:07.289104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1099/2100] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:07 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:07.315130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-63659e1d-fa4d-464a-b757-ae9ece474967 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:07.323884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-63659e1d-fa4d-464a-b757-ae9ece474967 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.162529 Jul 14 16:07:07.324458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1002/2101] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:07 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:08.306552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-70d33d92-22d0-492a-bc38-dbfdea8d9444 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:08.307155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-70d33d92-22d0-492a-bc38-dbfdea8d9444 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:08.313911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70d33d92-22d0-492a-bc38-dbfdea8d9444 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:08.314349 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70d33d92-22d0-492a-bc38-dbfdea8d9444 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:08.315152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70d33d92-22d0-492a-bc38-dbfdea8d9444 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:08.315965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70d33d92-22d0-492a-bc38-dbfdea8d9444 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:08.341131 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-92aee596-6c3c-4698-bd47-9c9a20d9ddca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:08.341745 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-92aee596-6c3c-4698-bd47-9c9a20d9ddca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:08.348455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92aee596-6c3c-4698-bd47-9c9a20d9ddca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:08.349433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92aee596-6c3c-4698-bd47-9c9a20d9ddca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:08.350225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92aee596-6c3c-4698-bd47-9c9a20d9ddca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:08.350663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92aee596-6c3c-4698-bd47-9c9a20d9ddca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:08.378814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-70d33d92-22d0-492a-bc38-dbfdea8d9444 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:08.387925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-70d33d92-22d0-492a-bc38-dbfdea8d9444 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:08.389439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-70d33d92-22d0-492a-bc38-dbfdea8d9444 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:08.390579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-70d33d92-22d0-492a-bc38-dbfdea8d9444 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088092 Jul 14 16:07:08.391168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1100/2102] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:08 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:08.484802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-92aee596-6c3c-4698-bd47-9c9a20d9ddca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:08.493539 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-92aee596-6c3c-4698-bd47-9c9a20d9ddca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156328 Jul 14 16:07:08.494111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1003/2103] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:08 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:07:09.409448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-15dbe48c-dc78-4528-a263-9bab3dc26ab3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:09.410046 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-15dbe48c-dc78-4528-a263-9bab3dc26ab3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:09.417597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15dbe48c-dc78-4528-a263-9bab3dc26ab3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:09.418048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15dbe48c-dc78-4528-a263-9bab3dc26ab3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:09.418810 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15dbe48c-dc78-4528-a263-9bab3dc26ab3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:09.419247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15dbe48c-dc78-4528-a263-9bab3dc26ab3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:09.482692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-15dbe48c-dc78-4528-a263-9bab3dc26ab3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:09.491221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-15dbe48c-dc78-4528-a263-9bab3dc26ab3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:09.492745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-15dbe48c-dc78-4528-a263-9bab3dc26ab3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:09.493871 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-15dbe48c-dc78-4528-a263-9bab3dc26ab3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088347 Jul 14 16:07:09.494426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1101/2104] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:09 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:09.510468 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-25d4c6b9-31e7-4e6b-9fcb-c883f9d902dc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:09.511080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-25d4c6b9-31e7-4e6b-9fcb-c883f9d902dc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:09.517732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-25d4c6b9-31e7-4e6b-9fcb-c883f9d902dc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:09.518182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-25d4c6b9-31e7-4e6b-9fcb-c883f9d902dc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:09.518945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-25d4c6b9-31e7-4e6b-9fcb-c883f9d902dc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:09.519377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-25d4c6b9-31e7-4e6b-9fcb-c883f9d902dc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:09.524186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:09.668586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-25d4c6b9-31e7-4e6b-9fcb-c883f9d902dc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:09.676705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-25d4c6b9-31e7-4e6b-9fcb-c883f9d902dc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.170028 Jul 14 16:07:09.678521 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1004/2105] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:09 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:10.512153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-50f0a28e-be95-4317-b2f2-24b28786ceda tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:10.512917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-50f0a28e-be95-4317-b2f2-24b28786ceda tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:10.520040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-50f0a28e-be95-4317-b2f2-24b28786ceda tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:10.520613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-50f0a28e-be95-4317-b2f2-24b28786ceda tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:10.521835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-50f0a28e-be95-4317-b2f2-24b28786ceda tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:10.522896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-50f0a28e-be95-4317-b2f2-24b28786ceda tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:10.586335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-50f0a28e-be95-4317-b2f2-24b28786ceda tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:10.594911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-50f0a28e-be95-4317-b2f2-24b28786ceda tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:10.596453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-50f0a28e-be95-4317-b2f2-24b28786ceda tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:10.597607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-50f0a28e-be95-4317-b2f2-24b28786ceda tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089461 Jul 14 16:07:10.598166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1102/2106] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:10 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:10.697294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b2abb5ff-dc3c-46ed-a1d5-b2e952d9eaae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:10.698375 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b2abb5ff-dc3c-46ed-a1d5-b2e952d9eaae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:10.701674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=52 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:10.709188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b2abb5ff-dc3c-46ed-a1d5-b2e952d9eaae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:10.709649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b2abb5ff-dc3c-46ed-a1d5-b2e952d9eaae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:10.710434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b2abb5ff-dc3c-46ed-a1d5-b2e952d9eaae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:10.710876 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b2abb5ff-dc3c-46ed-a1d5-b2e952d9eaae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:10.851212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b2abb5ff-dc3c-46ed-a1d5-b2e952d9eaae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:10.859176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b2abb5ff-dc3c-46ed-a1d5-b2e952d9eaae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.168485 Jul 14 16:07:10.859758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1005/2107] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:10 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:11.615941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e9dd4be8-a985-4431-9066-2878b626bc4e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:11.616523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e9dd4be8-a985-4431-9066-2878b626bc4e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:11.623040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e9dd4be8-a985-4431-9066-2878b626bc4e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:11.623485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e9dd4be8-a985-4431-9066-2878b626bc4e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:11.624265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e9dd4be8-a985-4431-9066-2878b626bc4e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:11.624697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e9dd4be8-a985-4431-9066-2878b626bc4e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:11.688871 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e9dd4be8-a985-4431-9066-2878b626bc4e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:11.697350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e9dd4be8-a985-4431-9066-2878b626bc4e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:11.698836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e9dd4be8-a985-4431-9066-2878b626bc4e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:11.699991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e9dd4be8-a985-4431-9066-2878b626bc4e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088170 Jul 14 16:07:11.700550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1103/2108] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:11 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:11.877030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bb9b9886-e0b6-4ea3-b8f5-0eace537c1c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:11.877577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bb9b9886-e0b6-4ea3-b8f5-0eace537c1c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:11.885158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb9b9886-e0b6-4ea3-b8f5-0eace537c1c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:11.885600 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb9b9886-e0b6-4ea3-b8f5-0eace537c1c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:11.886367 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb9b9886-e0b6-4ea3-b8f5-0eace537c1c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:11.886802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb9b9886-e0b6-4ea3-b8f5-0eace537c1c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:12.024651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bb9b9886-e0b6-4ea3-b8f5-0eace537c1c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:12.032740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bb9b9886-e0b6-4ea3-b8f5-0eace537c1c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.159723 Jul 14 16:07:12.033316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1006/2109] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:11 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:12.719198 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-00468538-a437-41e6-bca8-a16c36db8586 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:12.719829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-00468538-a437-41e6-bca8-a16c36db8586 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:12.727378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-00468538-a437-41e6-bca8-a16c36db8586 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:12.727863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-00468538-a437-41e6-bca8-a16c36db8586 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:12.728626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-00468538-a437-41e6-bca8-a16c36db8586 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:12.729083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-00468538-a437-41e6-bca8-a16c36db8586 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:12.800621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-00468538-a437-41e6-bca8-a16c36db8586 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:12.809235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-00468538-a437-41e6-bca8-a16c36db8586 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:12.810814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-00468538-a437-41e6-bca8-a16c36db8586 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:12.811985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-00468538-a437-41e6-bca8-a16c36db8586 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.096724 Jul 14 16:07:12.812536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1104/2110] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:12 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:13.050050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f3195306-8e69-4d45-b2ba-16e3c8950bfa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:13.050687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f3195306-8e69-4d45-b2ba-16e3c8950bfa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:13.057280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f3195306-8e69-4d45-b2ba-16e3c8950bfa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:13.057724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f3195306-8e69-4d45-b2ba-16e3c8950bfa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:13.058499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f3195306-8e69-4d45-b2ba-16e3c8950bfa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:13.058936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f3195306-8e69-4d45-b2ba-16e3c8950bfa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:13.191812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f3195306-8e69-4d45-b2ba-16e3c8950bfa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:13.200419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f3195306-8e69-4d45-b2ba-16e3c8950bfa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154274 Jul 14 16:07:13.200996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1007/2111] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:13 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:13.361612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:07:13.361612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:07:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:07:13.831354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3f4feceb-7e9c-4c24-92fc-a0a0b0fc84a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:13.832056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3f4feceb-7e9c-4c24-92fc-a0a0b0fc84a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:13.838664 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f4feceb-7e9c-4c24-92fc-a0a0b0fc84a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:13.839114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f4feceb-7e9c-4c24-92fc-a0a0b0fc84a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:13.839923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f4feceb-7e9c-4c24-92fc-a0a0b0fc84a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:13.840363 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3f4feceb-7e9c-4c24-92fc-a0a0b0fc84a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:13.902670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3f4feceb-7e9c-4c24-92fc-a0a0b0fc84a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:13.915254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3f4feceb-7e9c-4c24-92fc-a0a0b0fc84a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:13.916783 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3f4feceb-7e9c-4c24-92fc-a0a0b0fc84a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:13.917932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3f4feceb-7e9c-4c24-92fc-a0a0b0fc84a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.092499 Jul 14 16:07:13.918485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1105/2112] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:13 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:14.218278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d174598a-5221-491d-9fa7-8a0805816360 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:14.218917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d174598a-5221-491d-9fa7-8a0805816360 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:14.226002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d174598a-5221-491d-9fa7-8a0805816360 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:14.226455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d174598a-5221-491d-9fa7-8a0805816360 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:14.227259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d174598a-5221-491d-9fa7-8a0805816360 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:14.227733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d174598a-5221-491d-9fa7-8a0805816360 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:14.372054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d174598a-5221-491d-9fa7-8a0805816360 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:14.380032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d174598a-5221-491d-9fa7-8a0805816360 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.165583 Jul 14 16:07:14.380594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1008/2113] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:14 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:14.937341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2f126716-0458-47ae-9c9e-b2454ef83f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:14.937979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2f126716-0458-47ae-9c9e-b2454ef83f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:14.945551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f126716-0458-47ae-9c9e-b2454ef83f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:14.946035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f126716-0458-47ae-9c9e-b2454ef83f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:14.946803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f126716-0458-47ae-9c9e-b2454ef83f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:14.947244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f126716-0458-47ae-9c9e-b2454ef83f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:15.011195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2f126716-0458-47ae-9c9e-b2454ef83f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:15.019845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2f126716-0458-47ae-9c9e-b2454ef83f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:15.022467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2f126716-0458-47ae-9c9e-b2454ef83f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:15.023617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2f126716-0458-47ae-9c9e-b2454ef83f50 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090220 Jul 14 16:07:15.024175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1106/2114] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:14 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:15.398919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-70526ff1-c354-44b6-9f78-9d94f472b40f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:15.399726 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-70526ff1-c354-44b6-9f78-9d94f472b40f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:15.406408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70526ff1-c354-44b6-9f78-9d94f472b40f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:15.406855 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70526ff1-c354-44b6-9f78-9d94f472b40f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:15.407660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70526ff1-c354-44b6-9f78-9d94f472b40f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:15.408290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70526ff1-c354-44b6-9f78-9d94f472b40f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:15.549879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-70526ff1-c354-44b6-9f78-9d94f472b40f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:15.558774 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-70526ff1-c354-44b6-9f78-9d94f472b40f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.164988 Jul 14 16:07:15.559341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1009/2115] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:15 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:16.042473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b0c82645-0c55-41fc-9377-90330d97c32c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:16.043073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b0c82645-0c55-41fc-9377-90330d97c32c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:16.049748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0c82645-0c55-41fc-9377-90330d97c32c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:16.050195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0c82645-0c55-41fc-9377-90330d97c32c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:16.050936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0c82645-0c55-41fc-9377-90330d97c32c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:16.051367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b0c82645-0c55-41fc-9377-90330d97c32c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:16.117516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0c82645-0c55-41fc-9377-90330d97c32c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:16.126025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0c82645-0c55-41fc-9377-90330d97c32c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:16.127502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b0c82645-0c55-41fc-9377-90330d97c32c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:16.128687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b0c82645-0c55-41fc-9377-90330d97c32c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090406 Jul 14 16:07:16.129231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1107/2116] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:16 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:16.576244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-faebc68f-6280-4744-be9a-d8e1e66f4c74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:16.576850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-faebc68f-6280-4744-be9a-d8e1e66f4c74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:16.584709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-faebc68f-6280-4744-be9a-d8e1e66f4c74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:16.585191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-faebc68f-6280-4744-be9a-d8e1e66f4c74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:16.585961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-faebc68f-6280-4744-be9a-d8e1e66f4c74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:16.586394 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-faebc68f-6280-4744-be9a-d8e1e66f4c74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:16.721255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-faebc68f-6280-4744-be9a-d8e1e66f4c74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:16.729920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-faebc68f-6280-4744-be9a-d8e1e66f4c74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157531 Jul 14 16:07:16.730484 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1010/2117] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:16 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:17.146920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e3c55dd9-bfea-4617-a2d8-19dce553386b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:17.147529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e3c55dd9-bfea-4617-a2d8-19dce553386b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:17.154119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e3c55dd9-bfea-4617-a2d8-19dce553386b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:17.154567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e3c55dd9-bfea-4617-a2d8-19dce553386b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:17.155326 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e3c55dd9-bfea-4617-a2d8-19dce553386b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:17.155795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e3c55dd9-bfea-4617-a2d8-19dce553386b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:17.225053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e3c55dd9-bfea-4617-a2d8-19dce553386b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:17.233436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e3c55dd9-bfea-4617-a2d8-19dce553386b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:17.235042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e3c55dd9-bfea-4617-a2d8-19dce553386b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:17.236257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e3c55dd9-bfea-4617-a2d8-19dce553386b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.093322 Jul 14 16:07:17.236822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1108/2118] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:17 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:17.747777 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-07628d9f-8cf4-40dd-95fb-b5bd44602c8f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:17.748783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-07628d9f-8cf4-40dd-95fb-b5bd44602c8f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:17.756351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07628d9f-8cf4-40dd-95fb-b5bd44602c8f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:17.756810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07628d9f-8cf4-40dd-95fb-b5bd44602c8f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:17.757684 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07628d9f-8cf4-40dd-95fb-b5bd44602c8f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:17.758201 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07628d9f-8cf4-40dd-95fb-b5bd44602c8f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:17.893317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-07628d9f-8cf4-40dd-95fb-b5bd44602c8f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:17.902335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-07628d9f-8cf4-40dd-95fb-b5bd44602c8f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158713 Jul 14 16:07:17.902913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1011/2119] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:17 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:18.254667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0e08a91d-3c4d-4230-8470-65cb23e10a4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:18.255275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0e08a91d-3c4d-4230-8470-65cb23e10a4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:18.262002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e08a91d-3c4d-4230-8470-65cb23e10a4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:18.262457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e08a91d-3c4d-4230-8470-65cb23e10a4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:18.263222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e08a91d-3c4d-4230-8470-65cb23e10a4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:18.263691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e08a91d-3c4d-4230-8470-65cb23e10a4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:18.326442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0e08a91d-3c4d-4230-8470-65cb23e10a4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:18.335489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0e08a91d-3c4d-4230-8470-65cb23e10a4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:18.337057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0e08a91d-3c4d-4230-8470-65cb23e10a4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:18.338211 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0e08a91d-3c4d-4230-8470-65cb23e10a4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087496 Jul 14 16:07:18.338769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1109/2120] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:18 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:18.920854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fef006d9-be72-4a60-b6a0-ae6c29cb47cd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:18.921977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fef006d9-be72-4a60-b6a0-ae6c29cb47cd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:18.932392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fef006d9-be72-4a60-b6a0-ae6c29cb47cd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:18.933041 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fef006d9-be72-4a60-b6a0-ae6c29cb47cd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:18.933602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fef006d9-be72-4a60-b6a0-ae6c29cb47cd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:18.934035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fef006d9-be72-4a60-b6a0-ae6c29cb47cd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:19.093860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fef006d9-be72-4a60-b6a0-ae6c29cb47cd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:19.103409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fef006d9-be72-4a60-b6a0-ae6c29cb47cd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.186824 Jul 14 16:07:19.104016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1012/2121] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:18 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:07:19.359073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0a7e0c0b-8e3b-4958-981e-e391829f0fae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:19.360145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0a7e0c0b-8e3b-4958-981e-e391829f0fae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:19.368509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a7e0c0b-8e3b-4958-981e-e391829f0fae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:19.368953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a7e0c0b-8e3b-4958-981e-e391829f0fae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:19.369721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a7e0c0b-8e3b-4958-981e-e391829f0fae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:19.370196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0a7e0c0b-8e3b-4958-981e-e391829f0fae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:19.448088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0a7e0c0b-8e3b-4958-981e-e391829f0fae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:19.461318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0a7e0c0b-8e3b-4958-981e-e391829f0fae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:19.465673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0a7e0c0b-8e3b-4958-981e-e391829f0fae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:19.465993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0a7e0c0b-8e3b-4958-981e-e391829f0fae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.113522 Jul 14 16:07:19.466879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1110/2122] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:19 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:20.122063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f86ddbd6-d59b-416e-b618-1c6776d2a3a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:20.122656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f86ddbd6-d59b-416e-b618-1c6776d2a3a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:20.129265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f86ddbd6-d59b-416e-b618-1c6776d2a3a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:20.130314 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f86ddbd6-d59b-416e-b618-1c6776d2a3a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:20.131177 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f86ddbd6-d59b-416e-b618-1c6776d2a3a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:20.131652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f86ddbd6-d59b-416e-b618-1c6776d2a3a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:20.291159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f86ddbd6-d59b-416e-b618-1c6776d2a3a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:20.299432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f86ddbd6-d59b-416e-b618-1c6776d2a3a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.181509 Jul 14 16:07:20.300058 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1013/2123] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:20 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:20.487303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9a00bc8c-4be1-446f-b7ce-13718908d5fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:20.487958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9a00bc8c-4be1-446f-b7ce-13718908d5fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:20.495293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a00bc8c-4be1-446f-b7ce-13718908d5fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:20.495780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a00bc8c-4be1-446f-b7ce-13718908d5fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:20.496556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a00bc8c-4be1-446f-b7ce-13718908d5fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:20.497322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a00bc8c-4be1-446f-b7ce-13718908d5fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:20.574825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9a00bc8c-4be1-446f-b7ce-13718908d5fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:20.585056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9a00bc8c-4be1-446f-b7ce-13718908d5fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:20.586545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9a00bc8c-4be1-446f-b7ce-13718908d5fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:20.587774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9a00bc8c-4be1-446f-b7ce-13718908d5fe tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.104571 Jul 14 16:07:20.588328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1111/2124] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:21.319212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4a10e69c-57d4-4ceb-84cf-33224e9f8116 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:21.319807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4a10e69c-57d4-4ceb-84cf-33224e9f8116 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:21.328052 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4a10e69c-57d4-4ceb-84cf-33224e9f8116 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:21.328782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4a10e69c-57d4-4ceb-84cf-33224e9f8116 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:21.330064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4a10e69c-57d4-4ceb-84cf-33224e9f8116 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:21.330844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4a10e69c-57d4-4ceb-84cf-33224e9f8116 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:21.484910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4a10e69c-57d4-4ceb-84cf-33224e9f8116 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:21.496535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4a10e69c-57d4-4ceb-84cf-33224e9f8116 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.182420 Jul 14 16:07:21.497121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1014/2125] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:21 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:21.607401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-91401d7d-a279-46c2-9338-bfe2e327e0e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:21.607998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-91401d7d-a279-46c2-9338-bfe2e327e0e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:21.614862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91401d7d-a279-46c2-9338-bfe2e327e0e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:21.615313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91401d7d-a279-46c2-9338-bfe2e327e0e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:21.616095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91401d7d-a279-46c2-9338-bfe2e327e0e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:21.616531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91401d7d-a279-46c2-9338-bfe2e327e0e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:21.635157 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:21.681407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-91401d7d-a279-46c2-9338-bfe2e327e0e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:21.690004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-91401d7d-a279-46c2-9338-bfe2e327e0e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:21.691499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-91401d7d-a279-46c2-9338-bfe2e327e0e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:21.693249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-91401d7d-a279-46c2-9338-bfe2e327e0e9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090131 Jul 14 16:07:21.693761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1112/2126] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:21 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:22.521922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d8168f70-72d2-4d4e-86bb-104aaafcfd98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:22.522564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d8168f70-72d2-4d4e-86bb-104aaafcfd98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:22.529135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8168f70-72d2-4d4e-86bb-104aaafcfd98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:22.529581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8168f70-72d2-4d4e-86bb-104aaafcfd98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:22.530346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8168f70-72d2-4d4e-86bb-104aaafcfd98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:22.530784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8168f70-72d2-4d4e-86bb-104aaafcfd98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:22.668835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d8168f70-72d2-4d4e-86bb-104aaafcfd98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:22.677794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d8168f70-72d2-4d4e-86bb-104aaafcfd98 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161112 Jul 14 16:07:22.678371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1015/2127] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:22 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:22.711518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-27f2f385-ce3f-40e3-91b6-83cab2bbf31b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:22.712272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-27f2f385-ce3f-40e3-91b6-83cab2bbf31b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:22.718746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27f2f385-ce3f-40e3-91b6-83cab2bbf31b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:22.719188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27f2f385-ce3f-40e3-91b6-83cab2bbf31b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:22.719966 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27f2f385-ce3f-40e3-91b6-83cab2bbf31b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:22.720399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27f2f385-ce3f-40e3-91b6-83cab2bbf31b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:22.783963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-27f2f385-ce3f-40e3-91b6-83cab2bbf31b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:22.792682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-27f2f385-ce3f-40e3-91b6-83cab2bbf31b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:22.794167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-27f2f385-ce3f-40e3-91b6-83cab2bbf31b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:22.795305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-27f2f385-ce3f-40e3-91b6-83cab2bbf31b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087798 Jul 14 16:07:22.795902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1113/2128] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:22 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:23.695218 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0cf0edd6-38a9-4fc1-91fe-c5415b02e71a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:23.695902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0cf0edd6-38a9-4fc1-91fe-c5415b02e71a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:23.702698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cf0edd6-38a9-4fc1-91fe-c5415b02e71a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:23.703154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cf0edd6-38a9-4fc1-91fe-c5415b02e71a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:23.703968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cf0edd6-38a9-4fc1-91fe-c5415b02e71a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:23.704412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cf0edd6-38a9-4fc1-91fe-c5415b02e71a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:23.814356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-24f9cb42-9c10-48b8-be2a-c0aede612fd0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:23.814962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-24f9cb42-9c10-48b8-be2a-c0aede612fd0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:23.822075 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-24f9cb42-9c10-48b8-be2a-c0aede612fd0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:23.822522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-24f9cb42-9c10-48b8-be2a-c0aede612fd0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:23.823288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-24f9cb42-9c10-48b8-be2a-c0aede612fd0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:23.823753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-24f9cb42-9c10-48b8-be2a-c0aede612fd0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:23.843042 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0cf0edd6-38a9-4fc1-91fe-c5415b02e71a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:23.853557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0cf0edd6-38a9-4fc1-91fe-c5415b02e71a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.163295 Jul 14 16:07:23.863953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1016/2129] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:23 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:23.888455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-24f9cb42-9c10-48b8-be2a-c0aede612fd0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:23.897815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-24f9cb42-9c10-48b8-be2a-c0aede612fd0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:23.899304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-24f9cb42-9c10-48b8-be2a-c0aede612fd0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:23.900474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-24f9cb42-9c10-48b8-be2a-c0aede612fd0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090042 Jul 14 16:07:23.901030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1114/2130] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:23 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:24.872092 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fa33cf32-98c6-4fed-a42c-332e5db5171c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:24.872893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fa33cf32-98c6-4fed-a42c-332e5db5171c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:24.879272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa33cf32-98c6-4fed-a42c-332e5db5171c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:24.879781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa33cf32-98c6-4fed-a42c-332e5db5171c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:24.880599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa33cf32-98c6-4fed-a42c-332e5db5171c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:24.881039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa33cf32-98c6-4fed-a42c-332e5db5171c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:24.918596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6626a69f-3350-4f74-b6ed-68c8a458162f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:24.919214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6626a69f-3350-4f74-b6ed-68c8a458162f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:24.925896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6626a69f-3350-4f74-b6ed-68c8a458162f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:24.926451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6626a69f-3350-4f74-b6ed-68c8a458162f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:24.927245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6626a69f-3350-4f74-b6ed-68c8a458162f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:24.927712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6626a69f-3350-4f74-b6ed-68c8a458162f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:24.996101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6626a69f-3350-4f74-b6ed-68c8a458162f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:25.007413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6626a69f-3350-4f74-b6ed-68c8a458162f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:25.008950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6626a69f-3350-4f74-b6ed-68c8a458162f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:25.010103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6626a69f-3350-4f74-b6ed-68c8a458162f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.095708 Jul 14 16:07:25.010673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1115/2131] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:24 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:25.026444 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fa33cf32-98c6-4fed-a42c-332e5db5171c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:25.034474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fa33cf32-98c6-4fed-a42c-332e5db5171c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.166431 Jul 14 16:07:25.035040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1017/2132] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:24 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:26.028857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ccc66220-7712-4410-b362-6afb892d39c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:26.029505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ccc66220-7712-4410-b362-6afb892d39c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:26.036850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ccc66220-7712-4410-b362-6afb892d39c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:26.037304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ccc66220-7712-4410-b362-6afb892d39c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:26.038070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ccc66220-7712-4410-b362-6afb892d39c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:26.038510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ccc66220-7712-4410-b362-6afb892d39c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:26.052703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7d0e3f6a-e931-45c0-a8a9-4b340da354bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:26.053392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7d0e3f6a-e931-45c0-a8a9-4b340da354bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:26.060703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d0e3f6a-e931-45c0-a8a9-4b340da354bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:26.061225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d0e3f6a-e931-45c0-a8a9-4b340da354bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:26.062076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d0e3f6a-e931-45c0-a8a9-4b340da354bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:26.062649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7d0e3f6a-e931-45c0-a8a9-4b340da354bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:26.105845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ccc66220-7712-4410-b362-6afb892d39c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:26.116507 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ccc66220-7712-4410-b362-6afb892d39c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:26.118000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ccc66220-7712-4410-b362-6afb892d39c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:26.119315 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ccc66220-7712-4410-b362-6afb892d39c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.094506 Jul 14 16:07:26.119908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1116/2133] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:26 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:26.208672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7d0e3f6a-e931-45c0-a8a9-4b340da354bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:26.218854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7d0e3f6a-e931-45c0-a8a9-4b340da354bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.170174 Jul 14 16:07:26.219442 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1018/2134] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:26 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:07:27.137897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-886501b1-af13-4d5a-93c5-05ab0af88dc7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:27.138527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-886501b1-af13-4d5a-93c5-05ab0af88dc7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:27.145015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-886501b1-af13-4d5a-93c5-05ab0af88dc7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:27.146395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-886501b1-af13-4d5a-93c5-05ab0af88dc7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:27.146907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-886501b1-af13-4d5a-93c5-05ab0af88dc7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:27.147348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-886501b1-af13-4d5a-93c5-05ab0af88dc7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:27.212186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-886501b1-af13-4d5a-93c5-05ab0af88dc7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:27.220708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-886501b1-af13-4d5a-93c5-05ab0af88dc7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:27.222216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-886501b1-af13-4d5a-93c5-05ab0af88dc7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:27.223368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-886501b1-af13-4d5a-93c5-05ab0af88dc7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089449 Jul 14 16:07:27.223981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1117/2135] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:27.237137 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6af3266b-2994-4ec4-a994-2e072b423b02 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:27.237745 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6af3266b-2994-4ec4-a994-2e072b423b02 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:27.245238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6af3266b-2994-4ec4-a994-2e072b423b02 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:27.245681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6af3266b-2994-4ec4-a994-2e072b423b02 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:27.246441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6af3266b-2994-4ec4-a994-2e072b423b02 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:27.246877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6af3266b-2994-4ec4-a994-2e072b423b02 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:27.392954 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6af3266b-2994-4ec4-a994-2e072b423b02 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:27.401437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6af3266b-2994-4ec4-a994-2e072b423b02 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.168166 Jul 14 16:07:27.401998 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1019/2136] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:27 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:28.241953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1bb352ff-302b-4951-ae0d-61902c9ff071 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:28.242557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1bb352ff-302b-4951-ae0d-61902c9ff071 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:28.249120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1bb352ff-302b-4951-ae0d-61902c9ff071 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:28.249505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1bb352ff-302b-4951-ae0d-61902c9ff071 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:28.250476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1bb352ff-302b-4951-ae0d-61902c9ff071 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:28.250690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1bb352ff-302b-4951-ae0d-61902c9ff071 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:28.315659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1bb352ff-302b-4951-ae0d-61902c9ff071 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:28.325017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1bb352ff-302b-4951-ae0d-61902c9ff071 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:28.326523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1bb352ff-302b-4951-ae0d-61902c9ff071 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:28.327739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1bb352ff-302b-4951-ae0d-61902c9ff071 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090368 Jul 14 16:07:28.328880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1118/2137] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:28 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:28.419743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-70c04390-9690-44dc-a788-a316a4c8de20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:28.420360 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-70c04390-9690-44dc-a788-a316a4c8de20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:28.429175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70c04390-9690-44dc-a788-a316a4c8de20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:28.429649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70c04390-9690-44dc-a788-a316a4c8de20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:28.430480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70c04390-9690-44dc-a788-a316a4c8de20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:28.430976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70c04390-9690-44dc-a788-a316a4c8de20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:28.580389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-70c04390-9690-44dc-a788-a316a4c8de20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:28.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:28.590389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-70c04390-9690-44dc-a788-a316a4c8de20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.174541 Jul 14 16:07:28.591124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1020/2138] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:28 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:29.347633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-526c40d7-7dbc-44a8-93f4-c418a47c5b79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:29.348237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-526c40d7-7dbc-44a8-93f4-c418a47c5b79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:29.355478 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-526c40d7-7dbc-44a8-93f4-c418a47c5b79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:29.356000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-526c40d7-7dbc-44a8-93f4-c418a47c5b79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:29.356797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-526c40d7-7dbc-44a8-93f4-c418a47c5b79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:29.357250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-526c40d7-7dbc-44a8-93f4-c418a47c5b79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:29.429823 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-526c40d7-7dbc-44a8-93f4-c418a47c5b79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:29.439147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-526c40d7-7dbc-44a8-93f4-c418a47c5b79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:29.440866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-526c40d7-7dbc-44a8-93f4-c418a47c5b79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:29.442649 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-526c40d7-7dbc-44a8-93f4-c418a47c5b79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.099336 Jul 14 16:07:29.444091 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1119/2139] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:29 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:29.614696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bf5e054e-7c4d-419a-954b-5c6eca718635 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:29.615231 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bf5e054e-7c4d-419a-954b-5c6eca718635 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:29.621668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf5e054e-7c4d-419a-954b-5c6eca718635 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:29.622116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf5e054e-7c4d-419a-954b-5c6eca718635 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:29.622969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf5e054e-7c4d-419a-954b-5c6eca718635 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:29.623418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf5e054e-7c4d-419a-954b-5c6eca718635 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:29.761831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bf5e054e-7c4d-419a-954b-5c6eca718635 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:29.770265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bf5e054e-7c4d-419a-954b-5c6eca718635 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160352 Jul 14 16:07:29.771575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1021/2140] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:29 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:30.467402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-466f988a-58ad-40ea-b766-912ae4a2c4dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:30.468158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-466f988a-58ad-40ea-b766-912ae4a2c4dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:30.476929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-466f988a-58ad-40ea-b766-912ae4a2c4dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:30.477533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-466f988a-58ad-40ea-b766-912ae4a2c4dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:30.478288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-466f988a-58ad-40ea-b766-912ae4a2c4dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:30.478799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-466f988a-58ad-40ea-b766-912ae4a2c4dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:30.550113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-466f988a-58ad-40ea-b766-912ae4a2c4dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:30.560639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-466f988a-58ad-40ea-b766-912ae4a2c4dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:30.562450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-466f988a-58ad-40ea-b766-912ae4a2c4dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:30.563967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-466f988a-58ad-40ea-b766-912ae4a2c4dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.100662 Jul 14 16:07:30.564383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1120/2141] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:30 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:30.788196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c2860404-27a0-47df-bea7-b08aca174210 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:30.788849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c2860404-27a0-47df-bea7-b08aca174210 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:30.795656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2860404-27a0-47df-bea7-b08aca174210 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:30.796114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2860404-27a0-47df-bea7-b08aca174210 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:30.796882 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2860404-27a0-47df-bea7-b08aca174210 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:30.797327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2860404-27a0-47df-bea7-b08aca174210 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:30.931355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c2860404-27a0-47df-bea7-b08aca174210 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:30.939395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c2860404-27a0-47df-bea7-b08aca174210 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155812 Jul 14 16:07:30.939984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1022/2142] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:30 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:31.583930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-38459f06-f53d-4070-a364-72aad0e3675e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:31.584483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-38459f06-f53d-4070-a364-72aad0e3675e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:31.591008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38459f06-f53d-4070-a364-72aad0e3675e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:31.591450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38459f06-f53d-4070-a364-72aad0e3675e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:31.592236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38459f06-f53d-4070-a364-72aad0e3675e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:31.592669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38459f06-f53d-4070-a364-72aad0e3675e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:31.656268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-38459f06-f53d-4070-a364-72aad0e3675e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:31.665337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-38459f06-f53d-4070-a364-72aad0e3675e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:31.666825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-38459f06-f53d-4070-a364-72aad0e3675e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:31.667998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-38459f06-f53d-4070-a364-72aad0e3675e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088621 Jul 14 16:07:31.668546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1121/2143] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:31 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:31.956932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a3e7f254-54ca-4872-92c2-b9e3f19a1a90 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:31.957542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a3e7f254-54ca-4872-92c2-b9e3f19a1a90 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:31.964488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a3e7f254-54ca-4872-92c2-b9e3f19a1a90 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:31.964936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a3e7f254-54ca-4872-92c2-b9e3f19a1a90 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:31.965700 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a3e7f254-54ca-4872-92c2-b9e3f19a1a90 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:31.966135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a3e7f254-54ca-4872-92c2-b9e3f19a1a90 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:32.102947 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a3e7f254-54ca-4872-92c2-b9e3f19a1a90 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:32.110951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a3e7f254-54ca-4872-92c2-b9e3f19a1a90 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157919 Jul 14 16:07:32.111520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1023/2144] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:31 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:32.686849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3588fd64-64e6-45ac-bc21-565916eb2093 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:32.687463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3588fd64-64e6-45ac-bc21-565916eb2093 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:32.689925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=56 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:32.697079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3588fd64-64e6-45ac-bc21-565916eb2093 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:32.697526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3588fd64-64e6-45ac-bc21-565916eb2093 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:32.698298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3588fd64-64e6-45ac-bc21-565916eb2093 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:32.698730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3588fd64-64e6-45ac-bc21-565916eb2093 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:32.778095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3588fd64-64e6-45ac-bc21-565916eb2093 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:32.788727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3588fd64-64e6-45ac-bc21-565916eb2093 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:32.790490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3588fd64-64e6-45ac-bc21-565916eb2093 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:32.791662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3588fd64-64e6-45ac-bc21-565916eb2093 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.108696 Jul 14 16:07:32.792228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1122/2145] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:33.128232 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a8781984-99cb-4043-999a-f4ae0ba7b619 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:33.128880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a8781984-99cb-4043-999a-f4ae0ba7b619 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:33.135406 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8781984-99cb-4043-999a-f4ae0ba7b619 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:33.135898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8781984-99cb-4043-999a-f4ae0ba7b619 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:33.136690 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8781984-99cb-4043-999a-f4ae0ba7b619 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:33.137112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8781984-99cb-4043-999a-f4ae0ba7b619 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:33.276272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a8781984-99cb-4043-999a-f4ae0ba7b619 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:33.284445 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a8781984-99cb-4043-999a-f4ae0ba7b619 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160116 Jul 14 16:07:33.285006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1024/2146] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:33 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:33.809458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e70ca716-7580-4d6c-a47c-84d6f1b4d5e0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:33.810107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e70ca716-7580-4d6c-a47c-84d6f1b4d5e0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:33.816434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e70ca716-7580-4d6c-a47c-84d6f1b4d5e0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:33.816886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e70ca716-7580-4d6c-a47c-84d6f1b4d5e0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:33.818634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e70ca716-7580-4d6c-a47c-84d6f1b4d5e0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:33.819081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e70ca716-7580-4d6c-a47c-84d6f1b4d5e0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:33.885890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e70ca716-7580-4d6c-a47c-84d6f1b4d5e0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:33.894477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e70ca716-7580-4d6c-a47c-84d6f1b4d5e0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:33.897190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e70ca716-7580-4d6c-a47c-84d6f1b4d5e0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:33.898416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e70ca716-7580-4d6c-a47c-84d6f1b4d5e0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.093111 Jul 14 16:07:33.898895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1123/2147] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:33 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:34.302673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2fba0966-ee75-4a46-8b2a-da2488563d0a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:34.303269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2fba0966-ee75-4a46-8b2a-da2488563d0a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:34.310081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2fba0966-ee75-4a46-8b2a-da2488563d0a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:34.310529 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2fba0966-ee75-4a46-8b2a-da2488563d0a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:34.311304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2fba0966-ee75-4a46-8b2a-da2488563d0a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:34.311859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2fba0966-ee75-4a46-8b2a-da2488563d0a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:34.447297 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2fba0966-ee75-4a46-8b2a-da2488563d0a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:34.455530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2fba0966-ee75-4a46-8b2a-da2488563d0a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156949 Jul 14 16:07:34.456130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1025/2148] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:34 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:34.917079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ddeb55c9-140f-4f21-bf85-3ebe1ac53532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:34.917693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ddeb55c9-140f-4f21-bf85-3ebe1ac53532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:34.924417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddeb55c9-140f-4f21-bf85-3ebe1ac53532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:34.924868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddeb55c9-140f-4f21-bf85-3ebe1ac53532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:34.925633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddeb55c9-140f-4f21-bf85-3ebe1ac53532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:34.926077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ddeb55c9-140f-4f21-bf85-3ebe1ac53532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:34.989781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ddeb55c9-140f-4f21-bf85-3ebe1ac53532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:34.998677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ddeb55c9-140f-4f21-bf85-3ebe1ac53532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:35.000217 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ddeb55c9-140f-4f21-bf85-3ebe1ac53532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:35.001370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ddeb55c9-140f-4f21-bf85-3ebe1ac53532 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088454 Jul 14 16:07:35.001972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1124/2149] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:34 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:35.473483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-13141c14-a078-4d00-ae3d-00fbe9b31e74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:35.475020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-13141c14-a078-4d00-ae3d-00fbe9b31e74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:35.481416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13141c14-a078-4d00-ae3d-00fbe9b31e74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:35.481864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13141c14-a078-4d00-ae3d-00fbe9b31e74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:35.482620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13141c14-a078-4d00-ae3d-00fbe9b31e74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:35.483053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13141c14-a078-4d00-ae3d-00fbe9b31e74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:35.617876 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-13141c14-a078-4d00-ae3d-00fbe9b31e74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:35.625836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-13141c14-a078-4d00-ae3d-00fbe9b31e74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156290 Jul 14 16:07:35.626512 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1026/2150] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:35 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:36.019855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-89389a1f-f5cb-4077-bb9b-f53307390223 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:36.021210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-89389a1f-f5cb-4077-bb9b-f53307390223 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:36.028515 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89389a1f-f5cb-4077-bb9b-f53307390223 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:36.028961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89389a1f-f5cb-4077-bb9b-f53307390223 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:36.029714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89389a1f-f5cb-4077-bb9b-f53307390223 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:36.030151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89389a1f-f5cb-4077-bb9b-f53307390223 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:36.094723 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-89389a1f-f5cb-4077-bb9b-f53307390223 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:36.104174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-89389a1f-f5cb-4077-bb9b-f53307390223 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:36.105664 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-89389a1f-f5cb-4077-bb9b-f53307390223 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:36.106829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-89389a1f-f5cb-4077-bb9b-f53307390223 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.091043 Jul 14 16:07:36.107398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1125/2151] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:36 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:36.643275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-10826b18-5905-4f02-84c1-53c3d48897fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:36.643928 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-10826b18-5905-4f02-84c1-53c3d48897fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:36.651394 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-10826b18-5905-4f02-84c1-53c3d48897fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:36.651881 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-10826b18-5905-4f02-84c1-53c3d48897fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:36.652665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-10826b18-5905-4f02-84c1-53c3d48897fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:36.653110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-10826b18-5905-4f02-84c1-53c3d48897fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:36.802977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-10826b18-5905-4f02-84c1-53c3d48897fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:36.811653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-10826b18-5905-4f02-84c1-53c3d48897fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.172503 Jul 14 16:07:36.812228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1027/2152] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:36 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:37.124973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bd79d224-c9c1-4d49-88c6-53630d5dab84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:37.125607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bd79d224-c9c1-4d49-88c6-53630d5dab84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:37.132436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd79d224-c9c1-4d49-88c6-53630d5dab84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:37.132877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd79d224-c9c1-4d49-88c6-53630d5dab84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:37.133629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd79d224-c9c1-4d49-88c6-53630d5dab84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:37.134063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd79d224-c9c1-4d49-88c6-53630d5dab84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:37.196682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd79d224-c9c1-4d49-88c6-53630d5dab84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:37.205285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd79d224-c9c1-4d49-88c6-53630d5dab84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:37.206756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd79d224-c9c1-4d49-88c6-53630d5dab84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:37.207910 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bd79d224-c9c1-4d49-88c6-53630d5dab84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086865 Jul 14 16:07:37.208960 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1126/2153] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:37 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:37.828798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6b39b974-e2a3-4e5a-bd94-34de165fae16 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:37.829448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6b39b974-e2a3-4e5a-bd94-34de165fae16 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:37.836565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b39b974-e2a3-4e5a-bd94-34de165fae16 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:37.837005 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b39b974-e2a3-4e5a-bd94-34de165fae16 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:37.837755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b39b974-e2a3-4e5a-bd94-34de165fae16 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:37.838206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b39b974-e2a3-4e5a-bd94-34de165fae16 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:37.971305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6b39b974-e2a3-4e5a-bd94-34de165fae16 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:37.979524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6b39b974-e2a3-4e5a-bd94-34de165fae16 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154559 Jul 14 16:07:37.980021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1028/2154] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:37 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:38.227153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-30471abd-9673-47c0-9fc5-2af68a7af5ff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:38.227867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-30471abd-9673-47c0-9fc5-2af68a7af5ff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:38.234412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30471abd-9673-47c0-9fc5-2af68a7af5ff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:38.234858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30471abd-9673-47c0-9fc5-2af68a7af5ff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:38.235624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30471abd-9673-47c0-9fc5-2af68a7af5ff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:38.236067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30471abd-9673-47c0-9fc5-2af68a7af5ff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:38.310087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-30471abd-9673-47c0-9fc5-2af68a7af5ff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:38.320038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-30471abd-9673-47c0-9fc5-2af68a7af5ff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:38.321536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-30471abd-9673-47c0-9fc5-2af68a7af5ff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:38.322713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-30471abd-9673-47c0-9fc5-2af68a7af5ff tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.100025 Jul 14 16:07:38.323273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1127/2155] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:38.997670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ad94779d-2f2b-45c3-9121-ad7059ed699a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:38.998298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ad94779d-2f2b-45c3-9121-ad7059ed699a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:39.005120 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ad94779d-2f2b-45c3-9121-ad7059ed699a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:39.005578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ad94779d-2f2b-45c3-9121-ad7059ed699a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:39.006456 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ad94779d-2f2b-45c3-9121-ad7059ed699a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:39.006900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ad94779d-2f2b-45c3-9121-ad7059ed699a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:39.158796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ad94779d-2f2b-45c3-9121-ad7059ed699a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:39.168384 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ad94779d-2f2b-45c3-9121-ad7059ed699a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.174641 Jul 14 16:07:39.168965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1029/2156] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:38 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:39.340724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2bc2efcf-e0a2-4595-b4fa-ba761a550ceb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:39.341309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2bc2efcf-e0a2-4595-b4fa-ba761a550ceb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:39.348144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2bc2efcf-e0a2-4595-b4fa-ba761a550ceb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:39.349252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2bc2efcf-e0a2-4595-b4fa-ba761a550ceb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:39.350241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2bc2efcf-e0a2-4595-b4fa-ba761a550ceb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:39.350707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2bc2efcf-e0a2-4595-b4fa-ba761a550ceb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:39.418010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2bc2efcf-e0a2-4595-b4fa-ba761a550ceb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:39.427062 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2bc2efcf-e0a2-4595-b4fa-ba761a550ceb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:39.428863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2bc2efcf-e0a2-4595-b4fa-ba761a550ceb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:39.430036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2bc2efcf-e0a2-4595-b4fa-ba761a550ceb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.093382 Jul 14 16:07:39.430605 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1128/2157] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:39 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:40.185868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0c72b4b7-e8f0-4b68-9e66-cafaee219915 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:40.186480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0c72b4b7-e8f0-4b68-9e66-cafaee219915 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:40.193929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c72b4b7-e8f0-4b68-9e66-cafaee219915 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:40.194372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c72b4b7-e8f0-4b68-9e66-cafaee219915 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:40.195139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c72b4b7-e8f0-4b68-9e66-cafaee219915 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:40.195575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c72b4b7-e8f0-4b68-9e66-cafaee219915 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:40.328855 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0c72b4b7-e8f0-4b68-9e66-cafaee219915 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:40.337011 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0c72b4b7-e8f0-4b68-9e66-cafaee219915 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155005 Jul 14 16:07:40.337573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1030/2158] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:40 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:40.449232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2c21d6a9-6182-4710-a248-da985a2647a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:40.449846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2c21d6a9-6182-4710-a248-da985a2647a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:40.456408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2c21d6a9-6182-4710-a248-da985a2647a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:40.456856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2c21d6a9-6182-4710-a248-da985a2647a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:40.457623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2c21d6a9-6182-4710-a248-da985a2647a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:40.458124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2c21d6a9-6182-4710-a248-da985a2647a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:40.463002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:40.524497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2c21d6a9-6182-4710-a248-da985a2647a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:40.533719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2c21d6a9-6182-4710-a248-da985a2647a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:40.535136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2c21d6a9-6182-4710-a248-da985a2647a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:40.536990 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2c21d6a9-6182-4710-a248-da985a2647a5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.091044 Jul 14 16:07:40.537559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1129/2159] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:40 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:41.355179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f1dcfd92-0ebe-4c91-8857-8ab958191e05 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:41.355782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f1dcfd92-0ebe-4c91-8857-8ab958191e05 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:41.357549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=52 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:41.362824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1dcfd92-0ebe-4c91-8857-8ab958191e05 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.363273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1dcfd92-0ebe-4c91-8857-8ab958191e05 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.364079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1dcfd92-0ebe-4c91-8857-8ab958191e05 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.365197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1dcfd92-0ebe-4c91-8857-8ab958191e05 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.504281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f1dcfd92-0ebe-4c91-8857-8ab958191e05 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:41.512363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f1dcfd92-0ebe-4c91-8857-8ab958191e05 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161342 Jul 14 16:07:41.512946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1031/2160] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:41 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:41.555625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8a5b84fe-37fa-475b-907d-72058e030312 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:41.556293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8a5b84fe-37fa-475b-907d-72058e030312 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:41.562933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8a5b84fe-37fa-475b-907d-72058e030312 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.563374 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8a5b84fe-37fa-475b-907d-72058e030312 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.564167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8a5b84fe-37fa-475b-907d-72058e030312 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:41.564604 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8a5b84fe-37fa-475b-907d-72058e030312 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:41.629117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8a5b84fe-37fa-475b-907d-72058e030312 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:41.637652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8a5b84fe-37fa-475b-907d-72058e030312 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:41.639143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8a5b84fe-37fa-475b-907d-72058e030312 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:41.640318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8a5b84fe-37fa-475b-907d-72058e030312 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088651 Jul 14 16:07:41.640874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1130/2161] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:41 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:42.535410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c7686620-ea28-497b-821e-807335e0a6ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:42.537245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c7686620-ea28-497b-821e-807335e0a6ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:42.544384 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7686620-ea28-497b-821e-807335e0a6ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:42.544868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7686620-ea28-497b-821e-807335e0a6ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:42.545639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7686620-ea28-497b-821e-807335e0a6ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:42.546075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7686620-ea28-497b-821e-807335e0a6ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:42.658994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b149d8c5-dacc-4108-b694-3aedcc63ae58 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:42.659612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b149d8c5-dacc-4108-b694-3aedcc63ae58 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:42.667175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b149d8c5-dacc-4108-b694-3aedcc63ae58 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:42.667639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b149d8c5-dacc-4108-b694-3aedcc63ae58 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:42.668445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b149d8c5-dacc-4108-b694-3aedcc63ae58 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:42.668882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b149d8c5-dacc-4108-b694-3aedcc63ae58 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:42.700443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c7686620-ea28-497b-821e-807335e0a6ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:42.710851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c7686620-ea28-497b-821e-807335e0a6ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.180997 Jul 14 16:07:42.711439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1032/2162] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:42 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:42.738175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b149d8c5-dacc-4108-b694-3aedcc63ae58 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:42.747630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b149d8c5-dacc-4108-b694-3aedcc63ae58 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:42.749252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b149d8c5-dacc-4108-b694-3aedcc63ae58 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:42.750413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b149d8c5-dacc-4108-b694-3aedcc63ae58 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.096006 Jul 14 16:07:42.751223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1131/2163] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:42 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:43.730018 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-399fc75f-f2e8-45c4-b4cc-5d4cc4ce6550 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:43.730620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-399fc75f-f2e8-45c4-b4cc-5d4cc4ce6550 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:43.737854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-399fc75f-f2e8-45c4-b4cc-5d4cc4ce6550 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:43.738460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-399fc75f-f2e8-45c4-b4cc-5d4cc4ce6550 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:43.739246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-399fc75f-f2e8-45c4-b4cc-5d4cc4ce6550 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:43.740388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-399fc75f-f2e8-45c4-b4cc-5d4cc4ce6550 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:43.769218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-83a020ce-8259-41a9-a8f7-e1ce2c592910 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:43.769856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-83a020ce-8259-41a9-a8f7-e1ce2c592910 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:43.777816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83a020ce-8259-41a9-a8f7-e1ce2c592910 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:43.778364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83a020ce-8259-41a9-a8f7-e1ce2c592910 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:43.779221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83a020ce-8259-41a9-a8f7-e1ce2c592910 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:43.779769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-83a020ce-8259-41a9-a8f7-e1ce2c592910 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:43.850388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-83a020ce-8259-41a9-a8f7-e1ce2c592910 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:43.859145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-83a020ce-8259-41a9-a8f7-e1ce2c592910 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:43.860744 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-83a020ce-8259-41a9-a8f7-e1ce2c592910 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:43.861892 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-83a020ce-8259-41a9-a8f7-e1ce2c592910 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.096727 Jul 14 16:07:43.862455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1132/2164] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:43 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:43.889013 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-399fc75f-f2e8-45c4-b4cc-5d4cc4ce6550 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:43.897524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-399fc75f-f2e8-45c4-b4cc-5d4cc4ce6550 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.171665 Jul 14 16:07:43.898088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1033/2165] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:43 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:44.880015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c013d5df-5694-4c70-8822-6dbe04b51273 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:44.880737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c013d5df-5694-4c70-8822-6dbe04b51273 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:44.887167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c013d5df-5694-4c70-8822-6dbe04b51273 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:44.887622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c013d5df-5694-4c70-8822-6dbe04b51273 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:44.888390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c013d5df-5694-4c70-8822-6dbe04b51273 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:44.888819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c013d5df-5694-4c70-8822-6dbe04b51273 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:44.915588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-006f8e1e-4be0-4baf-a0b7-cbd4ab954704 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:44.916259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-006f8e1e-4be0-4baf-a0b7-cbd4ab954704 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:44.922879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-006f8e1e-4be0-4baf-a0b7-cbd4ab954704 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:44.923346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-006f8e1e-4be0-4baf-a0b7-cbd4ab954704 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:44.924151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-006f8e1e-4be0-4baf-a0b7-cbd4ab954704 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:44.924597 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-006f8e1e-4be0-4baf-a0b7-cbd4ab954704 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:44.950325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c013d5df-5694-4c70-8822-6dbe04b51273 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:44.958813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c013d5df-5694-4c70-8822-6dbe04b51273 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:44.960358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c013d5df-5694-4c70-8822-6dbe04b51273 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:44.961516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c013d5df-5694-4c70-8822-6dbe04b51273 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.085446 Jul 14 16:07:44.962072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1133/2166] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:45.058885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-006f8e1e-4be0-4baf-a0b7-cbd4ab954704 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:45.066796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-006f8e1e-4be0-4baf-a0b7-cbd4ab954704 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155829 Jul 14 16:07:45.067421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1034/2167] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:44 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:07:45.980416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-45c53f46-e4e3-4ee7-9db6-c3516ffa8af6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:45.981021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-45c53f46-e4e3-4ee7-9db6-c3516ffa8af6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:45.987933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45c53f46-e4e3-4ee7-9db6-c3516ffa8af6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:45.989190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45c53f46-e4e3-4ee7-9db6-c3516ffa8af6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:45.989473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45c53f46-e4e3-4ee7-9db6-c3516ffa8af6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:45.991312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-45c53f46-e4e3-4ee7-9db6-c3516ffa8af6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:46.055382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-45c53f46-e4e3-4ee7-9db6-c3516ffa8af6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:46.063702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-45c53f46-e4e3-4ee7-9db6-c3516ffa8af6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:46.065193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-45c53f46-e4e3-4ee7-9db6-c3516ffa8af6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:46.066312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-45c53f46-e4e3-4ee7-9db6-c3516ffa8af6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089874 Jul 14 16:07:46.066858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1134/2168] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:45 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:46.084352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b1fd9eb6-4905-4720-b1b1-f581c7b48a13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:46.085054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b1fd9eb6-4905-4720-b1b1-f581c7b48a13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:46.091410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b1fd9eb6-4905-4720-b1b1-f581c7b48a13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:46.091892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b1fd9eb6-4905-4720-b1b1-f581c7b48a13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:46.092650 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b1fd9eb6-4905-4720-b1b1-f581c7b48a13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:46.093083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b1fd9eb6-4905-4720-b1b1-f581c7b48a13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:46.226414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b1fd9eb6-4905-4720-b1b1-f581c7b48a13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:46.236674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b1fd9eb6-4905-4720-b1b1-f581c7b48a13 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156657 Jul 14 16:07:46.237250 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1035/2169] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:46 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:47.085280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-46834ffc-8efb-4dcd-b18b-13e6371c38ed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:47.085907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-46834ffc-8efb-4dcd-b18b-13e6371c38ed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:47.092644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-46834ffc-8efb-4dcd-b18b-13e6371c38ed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:47.093094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-46834ffc-8efb-4dcd-b18b-13e6371c38ed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:47.093865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-46834ffc-8efb-4dcd-b18b-13e6371c38ed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:47.094303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-46834ffc-8efb-4dcd-b18b-13e6371c38ed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:47.159425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-46834ffc-8efb-4dcd-b18b-13e6371c38ed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:47.168457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-46834ffc-8efb-4dcd-b18b-13e6371c38ed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:47.169951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-46834ffc-8efb-4dcd-b18b-13e6371c38ed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:47.171076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-46834ffc-8efb-4dcd-b18b-13e6371c38ed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090475 Jul 14 16:07:47.171642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1135/2170] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:47 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:47.253922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-006295f0-5388-4515-88ce-f4a7c0137a62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:47.254469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-006295f0-5388-4515-88ce-f4a7c0137a62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:47.261569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-006295f0-5388-4515-88ce-f4a7c0137a62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:47.262012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-006295f0-5388-4515-88ce-f4a7c0137a62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:47.262809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-006295f0-5388-4515-88ce-f4a7c0137a62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:47.263238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-006295f0-5388-4515-88ce-f4a7c0137a62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:47.394338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-006295f0-5388-4515-88ce-f4a7c0137a62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:47.402959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-006295f0-5388-4515-88ce-f4a7c0137a62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152977 Jul 14 16:07:47.403528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1036/2171] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:47 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:48.189120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d4f482a5-7ce3-4145-9b76-29e11880a0f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:48.189729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d4f482a5-7ce3-4145-9b76-29e11880a0f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:48.197284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d4f482a5-7ce3-4145-9b76-29e11880a0f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:48.197733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d4f482a5-7ce3-4145-9b76-29e11880a0f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:48.198492 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d4f482a5-7ce3-4145-9b76-29e11880a0f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:48.198928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d4f482a5-7ce3-4145-9b76-29e11880a0f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:48.263126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d4f482a5-7ce3-4145-9b76-29e11880a0f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:48.272295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d4f482a5-7ce3-4145-9b76-29e11880a0f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:48.273799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d4f482a5-7ce3-4145-9b76-29e11880a0f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:48.274951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d4f482a5-7ce3-4145-9b76-29e11880a0f3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089732 Jul 14 16:07:48.275516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1136/2172] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:48 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:07:48.420233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e076f53e-a2ce-4342-988f-b7fb85674e63 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:48.421067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e076f53e-a2ce-4342-988f-b7fb85674e63 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:48.428006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e076f53e-a2ce-4342-988f-b7fb85674e63 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:48.428460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e076f53e-a2ce-4342-988f-b7fb85674e63 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:48.429224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e076f53e-a2ce-4342-988f-b7fb85674e63 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:48.429666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e076f53e-a2ce-4342-988f-b7fb85674e63 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:48.449554 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:48.564806 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e076f53e-a2ce-4342-988f-b7fb85674e63 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:48.573752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e076f53e-a2ce-4342-988f-b7fb85674e63 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157437 Jul 14 16:07:48.574318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1037/2173] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:48 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:49.301213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c8ff609a-0445-4737-91be-80a6c6b5da9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:49.302264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c8ff609a-0445-4737-91be-80a6c6b5da9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:49.308159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c8ff609a-0445-4737-91be-80a6c6b5da9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:49.308610 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c8ff609a-0445-4737-91be-80a6c6b5da9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:49.309377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c8ff609a-0445-4737-91be-80a6c6b5da9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:49.309817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c8ff609a-0445-4737-91be-80a6c6b5da9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:49.371657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c8ff609a-0445-4737-91be-80a6c6b5da9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:49.381014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c8ff609a-0445-4737-91be-80a6c6b5da9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:49.382698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c8ff609a-0445-4737-91be-80a6c6b5da9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:49.383870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c8ff609a-0445-4737-91be-80a6c6b5da9b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.095044 Jul 14 16:07:49.384425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1137/2174] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:49 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:49.591938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-09543f38-ef20-4fe9-a841-894953fc2696 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:49.592612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-09543f38-ef20-4fe9-a841-894953fc2696 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:49.599860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-09543f38-ef20-4fe9-a841-894953fc2696 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:49.600309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-09543f38-ef20-4fe9-a841-894953fc2696 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:49.601076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-09543f38-ef20-4fe9-a841-894953fc2696 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:49.601516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-09543f38-ef20-4fe9-a841-894953fc2696 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:49.734288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-09543f38-ef20-4fe9-a841-894953fc2696 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:49.742933 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-09543f38-ef20-4fe9-a841-894953fc2696 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155132 Jul 14 16:07:49.743498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1038/2175] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:49 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:50.402350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5bd5f726-f240-426b-9a0b-63d266b11ab9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:50.402959 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5bd5f726-f240-426b-9a0b-63d266b11ab9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:50.409622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5bd5f726-f240-426b-9a0b-63d266b11ab9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:50.410068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5bd5f726-f240-426b-9a0b-63d266b11ab9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:50.411551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5bd5f726-f240-426b-9a0b-63d266b11ab9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:50.412153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5bd5f726-f240-426b-9a0b-63d266b11ab9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:50.473081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5bd5f726-f240-426b-9a0b-63d266b11ab9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:50.482309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5bd5f726-f240-426b-9a0b-63d266b11ab9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:50.483833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5bd5f726-f240-426b-9a0b-63d266b11ab9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:50.484981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5bd5f726-f240-426b-9a0b-63d266b11ab9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086648 Jul 14 16:07:50.485734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1138/2176] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:50 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:50.760848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f5e9b2d8-91f1-4dbb-a617-4b016a2f2d74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:50.761468 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f5e9b2d8-91f1-4dbb-a617-4b016a2f2d74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:50.768126 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f5e9b2d8-91f1-4dbb-a617-4b016a2f2d74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:50.768585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f5e9b2d8-91f1-4dbb-a617-4b016a2f2d74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:50.769348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f5e9b2d8-91f1-4dbb-a617-4b016a2f2d74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:50.769789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f5e9b2d8-91f1-4dbb-a617-4b016a2f2d74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:50.903000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f5e9b2d8-91f1-4dbb-a617-4b016a2f2d74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:50.910988 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f5e9b2d8-91f1-4dbb-a617-4b016a2f2d74 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154279 Jul 14 16:07:50.911552 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1039/2177] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:50 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:51.502364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dc0479a1-e7e0-45b9-9d9b-66eb8b05e2af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:51.502976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dc0479a1-e7e0-45b9-9d9b-66eb8b05e2af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:51.510244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dc0479a1-e7e0-45b9-9d9b-66eb8b05e2af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.510692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dc0479a1-e7e0-45b9-9d9b-66eb8b05e2af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.511452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dc0479a1-e7e0-45b9-9d9b-66eb8b05e2af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.511928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dc0479a1-e7e0-45b9-9d9b-66eb8b05e2af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.577698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dc0479a1-e7e0-45b9-9d9b-66eb8b05e2af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:51.587966 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dc0479a1-e7e0-45b9-9d9b-66eb8b05e2af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:51.589461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dc0479a1-e7e0-45b9-9d9b-66eb8b05e2af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:51.590614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dc0479a1-e7e0-45b9-9d9b-66eb8b05e2af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.092288 Jul 14 16:07:51.591166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1139/2178] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:51 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:51.929369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-843e6bb5-e548-47bc-a0ce-76c8f30422ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:51.929980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-843e6bb5-e548-47bc-a0ce-76c8f30422ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:51.936637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-843e6bb5-e548-47bc-a0ce-76c8f30422ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.937122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-843e6bb5-e548-47bc-a0ce-76c8f30422ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:51.937896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-843e6bb5-e548-47bc-a0ce-76c8f30422ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:51.938337 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-843e6bb5-e548-47bc-a0ce-76c8f30422ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:52.084608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-843e6bb5-e548-47bc-a0ce-76c8f30422ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:52.093738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-843e6bb5-e548-47bc-a0ce-76c8f30422ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.168750 Jul 14 16:07:52.094318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1040/2179] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:51 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:52.608908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d8a64f19-0264-4f51-b9e6-c29cd564e75d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:52.609515 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d8a64f19-0264-4f51-b9e6-c29cd564e75d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:52.618986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8a64f19-0264-4f51-b9e6-c29cd564e75d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:52.619440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8a64f19-0264-4f51-b9e6-c29cd564e75d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:52.620254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8a64f19-0264-4f51-b9e6-c29cd564e75d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:52.620694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8a64f19-0264-4f51-b9e6-c29cd564e75d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:52.682460 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d8a64f19-0264-4f51-b9e6-c29cd564e75d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:52.690904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d8a64f19-0264-4f51-b9e6-c29cd564e75d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:52.692444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d8a64f19-0264-4f51-b9e6-c29cd564e75d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:52.693689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d8a64f19-0264-4f51-b9e6-c29cd564e75d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088623 Jul 14 16:07:52.694286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1140/2180] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:52 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:53.113321 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9cd90912-ad34-439b-9e01-9751276ccd8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:53.113937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9cd90912-ad34-439b-9e01-9751276ccd8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:53.121002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9cd90912-ad34-439b-9e01-9751276ccd8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:53.121452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9cd90912-ad34-439b-9e01-9751276ccd8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:53.122212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9cd90912-ad34-439b-9e01-9751276ccd8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:53.129387 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9cd90912-ad34-439b-9e01-9751276ccd8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:53.262958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9cd90912-ad34-439b-9e01-9751276ccd8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:53.270900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9cd90912-ad34-439b-9e01-9751276ccd8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161425 Jul 14 16:07:53.271646 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1041/2181] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:53 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:07:53.711925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-90504f65-dad7-4022-a56c-d787144fcc90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:53.712569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-90504f65-dad7-4022-a56c-d787144fcc90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:53.719143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90504f65-dad7-4022-a56c-d787144fcc90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:53.719615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90504f65-dad7-4022-a56c-d787144fcc90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:53.720432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90504f65-dad7-4022-a56c-d787144fcc90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:53.720867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90504f65-dad7-4022-a56c-d787144fcc90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:53.783490 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-90504f65-dad7-4022-a56c-d787144fcc90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:53.793347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-90504f65-dad7-4022-a56c-d787144fcc90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:53.794846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-90504f65-dad7-4022-a56c-d787144fcc90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:53.796135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-90504f65-dad7-4022-a56c-d787144fcc90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088537 Jul 14 16:07:53.796667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1141/2182] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:53 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:54.288093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-70dd65f0-12b7-4417-a05e-724dfcddf684 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:54.288656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-70dd65f0-12b7-4417-a05e-724dfcddf684 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:54.295367 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70dd65f0-12b7-4417-a05e-724dfcddf684 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:54.295860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70dd65f0-12b7-4417-a05e-724dfcddf684 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:54.296622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70dd65f0-12b7-4417-a05e-724dfcddf684 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:54.297066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70dd65f0-12b7-4417-a05e-724dfcddf684 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:54.429586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-70dd65f0-12b7-4417-a05e-724dfcddf684 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:54.437546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-70dd65f0-12b7-4417-a05e-724dfcddf684 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153753 Jul 14 16:07:54.438114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1042/2183] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:54 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:07:54.814522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-96e8d28d-0d77-4e15-b34d-27b691b6530b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:54.815110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-96e8d28d-0d77-4e15-b34d-27b691b6530b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:54.821998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96e8d28d-0d77-4e15-b34d-27b691b6530b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:54.822441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96e8d28d-0d77-4e15-b34d-27b691b6530b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:54.823185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96e8d28d-0d77-4e15-b34d-27b691b6530b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:54.823631 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96e8d28d-0d77-4e15-b34d-27b691b6530b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:54.885112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-96e8d28d-0d77-4e15-b34d-27b691b6530b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:54.893612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-96e8d28d-0d77-4e15-b34d-27b691b6530b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:54.895076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-96e8d28d-0d77-4e15-b34d-27b691b6530b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:54.896240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-96e8d28d-0d77-4e15-b34d-27b691b6530b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.085667 Jul 14 16:07:54.897318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1142/2184] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:54 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:55.454643 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-db4eab48-2258-4667-91d6-dabf3628a8ad tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:55.455244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-db4eab48-2258-4667-91d6-dabf3628a8ad tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:55.462749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db4eab48-2258-4667-91d6-dabf3628a8ad tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:55.463199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db4eab48-2258-4667-91d6-dabf3628a8ad tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:55.464165 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db4eab48-2258-4667-91d6-dabf3628a8ad tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:55.464640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-db4eab48-2258-4667-91d6-dabf3628a8ad tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:55.597244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-db4eab48-2258-4667-91d6-dabf3628a8ad tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:55.605644 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-db4eab48-2258-4667-91d6-dabf3628a8ad tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154910 Jul 14 16:07:55.606213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1043/2185] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:55 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:55.914757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ece25fd9-14fc-49b2-8840-7058f9e5109f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:55.915655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ece25fd9-14fc-49b2-8840-7058f9e5109f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:55.922238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ece25fd9-14fc-49b2-8840-7058f9e5109f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:55.922693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ece25fd9-14fc-49b2-8840-7058f9e5109f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:55.923444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ece25fd9-14fc-49b2-8840-7058f9e5109f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:55.923909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ece25fd9-14fc-49b2-8840-7058f9e5109f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:55.991634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ece25fd9-14fc-49b2-8840-7058f9e5109f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:56.000203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ece25fd9-14fc-49b2-8840-7058f9e5109f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:56.001701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ece25fd9-14fc-49b2-8840-7058f9e5109f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:56.002844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ece25fd9-14fc-49b2-8840-7058f9e5109f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.092474 Jul 14 16:07:56.003406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1143/2186] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:55 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:56.622846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0f2a2552-dc09-4997-b65f-012559cf66c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:56.623459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0f2a2552-dc09-4997-b65f-012559cf66c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:56.630045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0f2a2552-dc09-4997-b65f-012559cf66c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:56.630439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0f2a2552-dc09-4997-b65f-012559cf66c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:56.631216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0f2a2552-dc09-4997-b65f-012559cf66c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:56.631683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0f2a2552-dc09-4997-b65f-012559cf66c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:56.765664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0f2a2552-dc09-4997-b65f-012559cf66c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:56.774590 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0f2a2552-dc09-4997-b65f-012559cf66c7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155693 Jul 14 16:07:56.775171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1044/2187] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:56 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:57.022400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3ca1b49b-882a-49da-a27f-307b00665420 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:57.023115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3ca1b49b-882a-49da-a27f-307b00665420 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:57.030246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ca1b49b-882a-49da-a27f-307b00665420 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:57.030688 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ca1b49b-882a-49da-a27f-307b00665420 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:57.031531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ca1b49b-882a-49da-a27f-307b00665420 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:57.031986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ca1b49b-882a-49da-a27f-307b00665420 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:57.094948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3ca1b49b-882a-49da-a27f-307b00665420 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:57.103684 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3ca1b49b-882a-49da-a27f-307b00665420 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:57.105183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3ca1b49b-882a-49da-a27f-307b00665420 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:57.106377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3ca1b49b-882a-49da-a27f-307b00665420 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088928 Jul 14 16:07:57.106953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1144/2188] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:57 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:57.792131 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-029e1a23-5bf2-42a1-92bd-9097a8bc3242 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:57.792732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-029e1a23-5bf2-42a1-92bd-9097a8bc3242 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:57.799196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-029e1a23-5bf2-42a1-92bd-9097a8bc3242 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:57.799676 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-029e1a23-5bf2-42a1-92bd-9097a8bc3242 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:57.800439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-029e1a23-5bf2-42a1-92bd-9097a8bc3242 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:57.800888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-029e1a23-5bf2-42a1-92bd-9097a8bc3242 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:57.930336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-029e1a23-5bf2-42a1-92bd-9097a8bc3242 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:57.938174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-029e1a23-5bf2-42a1-92bd-9097a8bc3242 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.150500 Jul 14 16:07:57.938789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1045/2189] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:57 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:58.124515 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-15da661f-28c6-4f7b-996f-b0343ad7c1b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:58.125069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-15da661f-28c6-4f7b-996f-b0343ad7c1b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:58.132340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15da661f-28c6-4f7b-996f-b0343ad7c1b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:58.132828 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15da661f-28c6-4f7b-996f-b0343ad7c1b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:58.133579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15da661f-28c6-4f7b-996f-b0343ad7c1b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:58.134011 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-15da661f-28c6-4f7b-996f-b0343ad7c1b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:58.197286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-15da661f-28c6-4f7b-996f-b0343ad7c1b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:58.200679 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:07:58.206377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-15da661f-28c6-4f7b-996f-b0343ad7c1b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:58.207884 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-15da661f-28c6-4f7b-996f-b0343ad7c1b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:58.209553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-15da661f-28c6-4f7b-996f-b0343ad7c1b3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088775 Jul 14 16:07:58.210174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1145/2190] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:58 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:07:58.957590 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-93492351-4359-43a5-9e95-08a0e6d6f408 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:58.958397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-93492351-4359-43a5-9e95-08a0e6d6f408 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:58.965575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93492351-4359-43a5-9e95-08a0e6d6f408 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:58.966020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93492351-4359-43a5-9e95-08a0e6d6f408 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:58.966786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93492351-4359-43a5-9e95-08a0e6d6f408 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:58.967217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93492351-4359-43a5-9e95-08a0e6d6f408 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:59.116617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-93492351-4359-43a5-9e95-08a0e6d6f408 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:59.125993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-93492351-4359-43a5-9e95-08a0e6d6f408 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.172836 Jul 14 16:07:59.126736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1046/2191] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:07:58 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:07:59.228545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5294df22-e9b5-4a09-8159-4234696d0a2c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:07:59.229633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5294df22-e9b5-4a09-8159-4234696d0a2c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:07:59.239534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5294df22-e9b5-4a09-8159-4234696d0a2c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:59.240465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5294df22-e9b5-4a09-8159-4234696d0a2c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:59.241265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5294df22-e9b5-4a09-8159-4234696d0a2c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:07:59.241728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5294df22-e9b5-4a09-8159-4234696d0a2c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:07:59.327046 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5294df22-e9b5-4a09-8159-4234696d0a2c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:59.336694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5294df22-e9b5-4a09-8159-4234696d0a2c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:59.338213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5294df22-e9b5-4a09-8159-4234696d0a2c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:07:59.339366 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5294df22-e9b5-4a09-8159-4234696d0a2c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.115395 Jul 14 16:07:59.339972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1146/2192] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:07:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:00.146922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4c84a7c8-6c1f-4c45-abb9-8a84f0292df8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:00.147519 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4c84a7c8-6c1f-4c45-abb9-8a84f0292df8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:00.154016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4c84a7c8-6c1f-4c45-abb9-8a84f0292df8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:00.154460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4c84a7c8-6c1f-4c45-abb9-8a84f0292df8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:00.155211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4c84a7c8-6c1f-4c45-abb9-8a84f0292df8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:00.155692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4c84a7c8-6c1f-4c45-abb9-8a84f0292df8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:00.284116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4c84a7c8-6c1f-4c45-abb9-8a84f0292df8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:00.292995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4c84a7c8-6c1f-4c45-abb9-8a84f0292df8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.150019 Jul 14 16:08:00.293562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1047/2193] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:00 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:00.358302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0198ea4a-41eb-4138-a6f4-ce6b518dc2c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:00.358917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0198ea4a-41eb-4138-a6f4-ce6b518dc2c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:00.365578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0198ea4a-41eb-4138-a6f4-ce6b518dc2c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:00.366028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0198ea4a-41eb-4138-a6f4-ce6b518dc2c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:00.366791 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0198ea4a-41eb-4138-a6f4-ce6b518dc2c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:00.367231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0198ea4a-41eb-4138-a6f4-ce6b518dc2c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:00.433378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0198ea4a-41eb-4138-a6f4-ce6b518dc2c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:00.441733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0198ea4a-41eb-4138-a6f4-ce6b518dc2c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:00.443407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0198ea4a-41eb-4138-a6f4-ce6b518dc2c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:00.444652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0198ea4a-41eb-4138-a6f4-ce6b518dc2c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090332 Jul 14 16:08:00.445208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1147/2194] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:00 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:01.310479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e40b2baf-5fdd-48cb-96d2-b9e98c3141fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:01.311021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e40b2baf-5fdd-48cb-96d2-b9e98c3141fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:01.317691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e40b2baf-5fdd-48cb-96d2-b9e98c3141fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:01.318745 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e40b2baf-5fdd-48cb-96d2-b9e98c3141fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:01.319740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e40b2baf-5fdd-48cb-96d2-b9e98c3141fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:01.320102 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e40b2baf-5fdd-48cb-96d2-b9e98c3141fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:01.453273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e40b2baf-5fdd-48cb-96d2-b9e98c3141fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:01.462071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e40b2baf-5fdd-48cb-96d2-b9e98c3141fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155626 Jul 14 16:08:01.462636 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1048/2195] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:01 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:01.463221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ded65d1e-1420-4800-9d23-e0fc5d6554d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:01.463850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ded65d1e-1420-4800-9d23-e0fc5d6554d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:01.470466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ded65d1e-1420-4800-9d23-e0fc5d6554d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:01.470906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ded65d1e-1420-4800-9d23-e0fc5d6554d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:01.471675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ded65d1e-1420-4800-9d23-e0fc5d6554d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:01.472103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ded65d1e-1420-4800-9d23-e0fc5d6554d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:01.536524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ded65d1e-1420-4800-9d23-e0fc5d6554d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:01.545414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ded65d1e-1420-4800-9d23-e0fc5d6554d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:01.546906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ded65d1e-1420-4800-9d23-e0fc5d6554d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:01.548586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ded65d1e-1420-4800-9d23-e0fc5d6554d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089778 Jul 14 16:08:01.548733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1148/2196] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:01 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:02.488258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9d4ea675-5754-43f4-9e1a-d15a3f36fa4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:02.488861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9d4ea675-5754-43f4-9e1a-d15a3f36fa4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:02.496227 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9d4ea675-5754-43f4-9e1a-d15a3f36fa4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:02.496667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9d4ea675-5754-43f4-9e1a-d15a3f36fa4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:02.497426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9d4ea675-5754-43f4-9e1a-d15a3f36fa4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:02.497862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9d4ea675-5754-43f4-9e1a-d15a3f36fa4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:02.567168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-183d337f-fc2a-42eb-978e-9447efed6a69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:02.567808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-183d337f-fc2a-42eb-978e-9447efed6a69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:02.575455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-183d337f-fc2a-42eb-978e-9447efed6a69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:02.575986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-183d337f-fc2a-42eb-978e-9447efed6a69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:02.576750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-183d337f-fc2a-42eb-978e-9447efed6a69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:02.577187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-183d337f-fc2a-42eb-978e-9447efed6a69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:02.644402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9d4ea675-5754-43f4-9e1a-d15a3f36fa4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:02.652321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-183d337f-fc2a-42eb-978e-9447efed6a69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:02.664754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9d4ea675-5754-43f4-9e1a-d15a3f36fa4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.180211 Jul 14 16:08:02.665846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1049/2197] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:02 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:02.666691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-183d337f-fc2a-42eb-978e-9447efed6a69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:02.668980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-183d337f-fc2a-42eb-978e-9447efed6a69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:02.670752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-183d337f-fc2a-42eb-978e-9447efed6a69 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.107799 Jul 14 16:08:02.671304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1149/2198] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:03.684649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-58c93660-2041-497d-a9e6-ea7175d8e036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:03.685352 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-58c93660-2041-497d-a9e6-ea7175d8e036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:03.690110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ae46e782-08b8-4e5e-a6d5-390cdf2a570a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:03.691143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ae46e782-08b8-4e5e-a6d5-390cdf2a570a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:03.692821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58c93660-2041-497d-a9e6-ea7175d8e036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:03.693780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58c93660-2041-497d-a9e6-ea7175d8e036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:03.694173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=56 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:03.694911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58c93660-2041-497d-a9e6-ea7175d8e036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:03.695387 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-58c93660-2041-497d-a9e6-ea7175d8e036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:03.699500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ae46e782-08b8-4e5e-a6d5-390cdf2a570a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:03.700004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ae46e782-08b8-4e5e-a6d5-390cdf2a570a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:03.700815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ae46e782-08b8-4e5e-a6d5-390cdf2a570a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:03.701392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ae46e782-08b8-4e5e-a6d5-390cdf2a570a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:03.764636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ae46e782-08b8-4e5e-a6d5-390cdf2a570a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:03.775967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ae46e782-08b8-4e5e-a6d5-390cdf2a570a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:03.777494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ae46e782-08b8-4e5e-a6d5-390cdf2a570a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:03.778640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ae46e782-08b8-4e5e-a6d5-390cdf2a570a tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.092457 Jul 14 16:08:03.779204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1150/2199] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:03.834378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-58c93660-2041-497d-a9e6-ea7175d8e036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:03.842385 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-58c93660-2041-497d-a9e6-ea7175d8e036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161617 Jul 14 16:08:03.842950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1050/2200] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:03 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:04.796883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e638daad-493a-4340-b48b-64794b4bb0c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:04.797499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e638daad-493a-4340-b48b-64794b4bb0c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:04.804373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e638daad-493a-4340-b48b-64794b4bb0c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:04.804819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e638daad-493a-4340-b48b-64794b4bb0c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:04.805575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e638daad-493a-4340-b48b-64794b4bb0c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:04.806013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e638daad-493a-4340-b48b-64794b4bb0c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:04.864340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7e02b2c8-a67b-47aa-9d14-eabbf567df34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:04.864959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7e02b2c8-a67b-47aa-9d14-eabbf567df34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:04.872005 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e02b2c8-a67b-47aa-9d14-eabbf567df34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:04.873856 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e02b2c8-a67b-47aa-9d14-eabbf567df34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:04.873856 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e02b2c8-a67b-47aa-9d14-eabbf567df34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:04.873856 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7e02b2c8-a67b-47aa-9d14-eabbf567df34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:04.876259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e638daad-493a-4340-b48b-64794b4bb0c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:04.885795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e638daad-493a-4340-b48b-64794b4bb0c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:04.887409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e638daad-493a-4340-b48b-64794b4bb0c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:04.888672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e638daad-493a-4340-b48b-64794b4bb0c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.095888 Jul 14 16:08:04.896797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1151/2201] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:05.023052 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7e02b2c8-a67b-47aa-9d14-eabbf567df34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:05.031066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7e02b2c8-a67b-47aa-9d14-eabbf567df34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.170640 Jul 14 16:08:05.031695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1051/2202] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:04 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:05.907955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-30714f70-2b82-4f8d-8827-94b85e50e336 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:05.908611 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-30714f70-2b82-4f8d-8827-94b85e50e336 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:05.915399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30714f70-2b82-4f8d-8827-94b85e50e336 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:05.915885 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30714f70-2b82-4f8d-8827-94b85e50e336 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:05.916645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30714f70-2b82-4f8d-8827-94b85e50e336 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:05.917086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30714f70-2b82-4f8d-8827-94b85e50e336 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:05.978753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-30714f70-2b82-4f8d-8827-94b85e50e336 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:05.987418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-30714f70-2b82-4f8d-8827-94b85e50e336 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:05.988992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-30714f70-2b82-4f8d-8827-94b85e50e336 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:05.990360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-30714f70-2b82-4f8d-8827-94b85e50e336 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086227 Jul 14 16:08:05.991231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1152/2203] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:05 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:06.048991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-07d949f3-8e0f-4dab-9d18-8ea00caf6471 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:06.049691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-07d949f3-8e0f-4dab-9d18-8ea00caf6471 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:06.057082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07d949f3-8e0f-4dab-9d18-8ea00caf6471 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:06.057546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07d949f3-8e0f-4dab-9d18-8ea00caf6471 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:06.058312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07d949f3-8e0f-4dab-9d18-8ea00caf6471 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:06.058754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-07d949f3-8e0f-4dab-9d18-8ea00caf6471 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:06.194857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-07d949f3-8e0f-4dab-9d18-8ea00caf6471 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:06.203068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-07d949f3-8e0f-4dab-9d18-8ea00caf6471 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157937 Jul 14 16:08:06.203665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1052/2204] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:06 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:07.008867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-43208db3-9360-4a4c-86a9-8bf05b451732 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:07.009474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-43208db3-9360-4a4c-86a9-8bf05b451732 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:07.015986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-43208db3-9360-4a4c-86a9-8bf05b451732 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:07.016435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-43208db3-9360-4a4c-86a9-8bf05b451732 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:07.017186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-43208db3-9360-4a4c-86a9-8bf05b451732 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:07.017621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-43208db3-9360-4a4c-86a9-8bf05b451732 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:07.078515 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-43208db3-9360-4a4c-86a9-8bf05b451732 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:07.087018 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-43208db3-9360-4a4c-86a9-8bf05b451732 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:07.088542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-43208db3-9360-4a4c-86a9-8bf05b451732 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:07.089676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-43208db3-9360-4a4c-86a9-8bf05b451732 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.085299 Jul 14 16:08:07.090232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1153/2205] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:07 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:07.221373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9f15aa62-06e2-4442-a3a8-48ed2dd4fd62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:07.221995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9f15aa62-06e2-4442-a3a8-48ed2dd4fd62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:07.229193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f15aa62-06e2-4442-a3a8-48ed2dd4fd62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:07.229654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f15aa62-06e2-4442-a3a8-48ed2dd4fd62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:07.230424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f15aa62-06e2-4442-a3a8-48ed2dd4fd62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:07.230870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f15aa62-06e2-4442-a3a8-48ed2dd4fd62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:07.371531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9f15aa62-06e2-4442-a3a8-48ed2dd4fd62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:07.379668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9f15aa62-06e2-4442-a3a8-48ed2dd4fd62 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.162117 Jul 14 16:08:07.380228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1053/2206] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:07 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:08.108919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1868099e-78f4-49eb-b297-4dcded6b9ffb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:08.109653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1868099e-78f4-49eb-b297-4dcded6b9ffb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:08.116576 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1868099e-78f4-49eb-b297-4dcded6b9ffb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:08.117020 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1868099e-78f4-49eb-b297-4dcded6b9ffb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:08.117776 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1868099e-78f4-49eb-b297-4dcded6b9ffb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:08.118208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1868099e-78f4-49eb-b297-4dcded6b9ffb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:08.186792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1868099e-78f4-49eb-b297-4dcded6b9ffb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:08.197739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1868099e-78f4-49eb-b297-4dcded6b9ffb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:08.199232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1868099e-78f4-49eb-b297-4dcded6b9ffb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:08.200428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1868099e-78f4-49eb-b297-4dcded6b9ffb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.095479 Jul 14 16:08:08.200989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1154/2207] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:08 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:08.397769 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1330d306-84df-4056-9160-cc6dfb6dc5ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:08.398386 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1330d306-84df-4056-9160-cc6dfb6dc5ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:08.405158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1330d306-84df-4056-9160-cc6dfb6dc5ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:08.405611 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1330d306-84df-4056-9160-cc6dfb6dc5ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:08.406415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1330d306-84df-4056-9160-cc6dfb6dc5ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:08.406886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1330d306-84df-4056-9160-cc6dfb6dc5ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:08.411063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:08.543659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1330d306-84df-4056-9160-cc6dfb6dc5ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:08.552113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1330d306-84df-4056-9160-cc6dfb6dc5ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158226 Jul 14 16:08:08.553382 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1054/2208] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:08 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:09.219800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e051c185-ac1f-4a93-b54a-e42be50b2d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:09.220404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e051c185-ac1f-4a93-b54a-e42be50b2d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:09.229188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e051c185-ac1f-4a93-b54a-e42be50b2d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:09.229643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e051c185-ac1f-4a93-b54a-e42be50b2d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:09.230414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e051c185-ac1f-4a93-b54a-e42be50b2d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:09.230856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e051c185-ac1f-4a93-b54a-e42be50b2d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:09.305199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e051c185-ac1f-4a93-b54a-e42be50b2d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:09.313854 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e051c185-ac1f-4a93-b54a-e42be50b2d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:09.315769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e051c185-ac1f-4a93-b54a-e42be50b2d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:09.316941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e051c185-ac1f-4a93-b54a-e42be50b2d67 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.101115 Jul 14 16:08:09.317514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1155/2209] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:09 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:09.570422 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ab65d27d-828d-49cc-a0c5-7dd79dee32dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:09.570983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ab65d27d-828d-49cc-a0c5-7dd79dee32dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:09.577501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab65d27d-828d-49cc-a0c5-7dd79dee32dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:09.577947 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab65d27d-828d-49cc-a0c5-7dd79dee32dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:09.578706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab65d27d-828d-49cc-a0c5-7dd79dee32dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:09.579136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab65d27d-828d-49cc-a0c5-7dd79dee32dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:09.707961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ab65d27d-828d-49cc-a0c5-7dd79dee32dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:09.716038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ab65d27d-828d-49cc-a0c5-7dd79dee32dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.149834 Jul 14 16:08:09.716645 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1055/2210] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:09 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:10.339549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0fe1bcbf-844a-4e67-a9e2-65aed56881c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:10.340355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0fe1bcbf-844a-4e67-a9e2-65aed56881c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:10.347267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0fe1bcbf-844a-4e67-a9e2-65aed56881c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:10.347762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0fe1bcbf-844a-4e67-a9e2-65aed56881c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:10.348527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0fe1bcbf-844a-4e67-a9e2-65aed56881c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:10.348969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0fe1bcbf-844a-4e67-a9e2-65aed56881c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:10.421680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0fe1bcbf-844a-4e67-a9e2-65aed56881c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:10.431925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0fe1bcbf-844a-4e67-a9e2-65aed56881c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:10.433428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0fe1bcbf-844a-4e67-a9e2-65aed56881c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:10.434580 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0fe1bcbf-844a-4e67-a9e2-65aed56881c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.099142 Jul 14 16:08:10.435134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1156/2211] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:10 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:10.734489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fc6d0fc4-a4dd-4cae-9f3e-f8d9b5a5e6ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:10.735105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fc6d0fc4-a4dd-4cae-9f3e-f8d9b5a5e6ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:10.742058 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fc6d0fc4-a4dd-4cae-9f3e-f8d9b5a5e6ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:10.742508 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fc6d0fc4-a4dd-4cae-9f3e-f8d9b5a5e6ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:10.743270 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fc6d0fc4-a4dd-4cae-9f3e-f8d9b5a5e6ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:10.743744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fc6d0fc4-a4dd-4cae-9f3e-f8d9b5a5e6ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:10.880312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fc6d0fc4-a4dd-4cae-9f3e-f8d9b5a5e6ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:10.888947 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fc6d0fc4-a4dd-4cae-9f3e-f8d9b5a5e6ff tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158440 Jul 14 16:08:10.889530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1056/2212] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:10 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:11.454562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d92df21e-aadd-4952-ad52-6fcf1b933b99 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:11.455217 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d92df21e-aadd-4952-ad52-6fcf1b933b99 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:11.462834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d92df21e-aadd-4952-ad52-6fcf1b933b99 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:11.463286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d92df21e-aadd-4952-ad52-6fcf1b933b99 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:11.464088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d92df21e-aadd-4952-ad52-6fcf1b933b99 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:11.464529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d92df21e-aadd-4952-ad52-6fcf1b933b99 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:11.528306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d92df21e-aadd-4952-ad52-6fcf1b933b99 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:11.537851 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d92df21e-aadd-4952-ad52-6fcf1b933b99 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:11.539558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d92df21e-aadd-4952-ad52-6fcf1b933b99 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:11.541136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d92df21e-aadd-4952-ad52-6fcf1b933b99 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090529 Jul 14 16:08:11.541708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1157/2213] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:11 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:11.907373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8b3708ab-de5d-480d-b630-19bea50f98fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:11.908107 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8b3708ab-de5d-480d-b630-19bea50f98fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:11.910795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=52 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:11.916647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8b3708ab-de5d-480d-b630-19bea50f98fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:11.917105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8b3708ab-de5d-480d-b630-19bea50f98fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:11.918900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8b3708ab-de5d-480d-b630-19bea50f98fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:11.919742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8b3708ab-de5d-480d-b630-19bea50f98fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:12.054671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8b3708ab-de5d-480d-b630-19bea50f98fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:12.062858 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8b3708ab-de5d-480d-b630-19bea50f98fc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.159436 Jul 14 16:08:12.063435 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1057/2214] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:11 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:12.558774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-26265133-cd49-42fb-8b65-d35090376b4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:12.559392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-26265133-cd49-42fb-8b65-d35090376b4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:12.566049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26265133-cd49-42fb-8b65-d35090376b4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:12.566502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26265133-cd49-42fb-8b65-d35090376b4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:12.567301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26265133-cd49-42fb-8b65-d35090376b4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:12.567775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26265133-cd49-42fb-8b65-d35090376b4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:12.632482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-26265133-cd49-42fb-8b65-d35090376b4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:12.641232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-26265133-cd49-42fb-8b65-d35090376b4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:12.642734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-26265133-cd49-42fb-8b65-d35090376b4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:12.643911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-26265133-cd49-42fb-8b65-d35090376b4f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089017 Jul 14 16:08:12.644468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1158/2215] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:12 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:13.080900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e622f64e-6d2f-4775-80b1-ef0aa9406a97 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:13.081564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e622f64e-6d2f-4775-80b1-ef0aa9406a97 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:13.088774 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e622f64e-6d2f-4775-80b1-ef0aa9406a97 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:13.089225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e622f64e-6d2f-4775-80b1-ef0aa9406a97 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:13.089995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e622f64e-6d2f-4775-80b1-ef0aa9406a97 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:13.090426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e622f64e-6d2f-4775-80b1-ef0aa9406a97 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:13.228899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e622f64e-6d2f-4775-80b1-ef0aa9406a97 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:13.237248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e622f64e-6d2f-4775-80b1-ef0aa9406a97 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160276 Jul 14 16:08:13.237818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1058/2216] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:13 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:13.662708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8ec314d9-41ee-4b4e-812c-8e40eb0ca7f8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:13.663263 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8ec314d9-41ee-4b4e-812c-8e40eb0ca7f8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:13.670052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8ec314d9-41ee-4b4e-812c-8e40eb0ca7f8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:13.670504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8ec314d9-41ee-4b4e-812c-8e40eb0ca7f8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:13.671270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8ec314d9-41ee-4b4e-812c-8e40eb0ca7f8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:13.671747 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8ec314d9-41ee-4b4e-812c-8e40eb0ca7f8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:13.742829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8ec314d9-41ee-4b4e-812c-8e40eb0ca7f8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:13.752200 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8ec314d9-41ee-4b4e-812c-8e40eb0ca7f8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:13.753713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8ec314d9-41ee-4b4e-812c-8e40eb0ca7f8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:13.754922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8ec314d9-41ee-4b4e-812c-8e40eb0ca7f8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.096336 Jul 14 16:08:13.756063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1159/2217] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:13 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:14.256776 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fd3e6183-1404-4e1c-abf4-eaef9d6572c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:14.257339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fd3e6183-1404-4e1c-abf4-eaef9d6572c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:14.263544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd3e6183-1404-4e1c-abf4-eaef9d6572c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:14.264018 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd3e6183-1404-4e1c-abf4-eaef9d6572c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:14.264786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd3e6183-1404-4e1c-abf4-eaef9d6572c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:14.265217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd3e6183-1404-4e1c-abf4-eaef9d6572c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:14.434263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fd3e6183-1404-4e1c-abf4-eaef9d6572c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:14.444071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fd3e6183-1404-4e1c-abf4-eaef9d6572c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.191343 Jul 14 16:08:14.444841 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1059/2218] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:14 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:14.775173 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d559c55c-bb6e-49e4-b520-5319254b2ddb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:14.775830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d559c55c-bb6e-49e4-b520-5319254b2ddb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:14.784347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d559c55c-bb6e-49e4-b520-5319254b2ddb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:14.784843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d559c55c-bb6e-49e4-b520-5319254b2ddb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:14.785799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d559c55c-bb6e-49e4-b520-5319254b2ddb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:14.786275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d559c55c-bb6e-49e4-b520-5319254b2ddb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:15.118064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d559c55c-bb6e-49e4-b520-5319254b2ddb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:15.129271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d559c55c-bb6e-49e4-b520-5319254b2ddb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:15.131532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d559c55c-bb6e-49e4-b520-5319254b2ddb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:15.132754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d559c55c-bb6e-49e4-b520-5319254b2ddb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.362947 Jul 14 16:08:15.133328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1160/2219] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:14 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:15.464293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0cf31946-0a26-4914-a9d8-58f383b688e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:15.465134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0cf31946-0a26-4914-a9d8-58f383b688e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:15.472772 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cf31946-0a26-4914-a9d8-58f383b688e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:15.473244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cf31946-0a26-4914-a9d8-58f383b688e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:15.474038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cf31946-0a26-4914-a9d8-58f383b688e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:15.475093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cf31946-0a26-4914-a9d8-58f383b688e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:15.653268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0cf31946-0a26-4914-a9d8-58f383b688e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:15.663146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0cf31946-0a26-4914-a9d8-58f383b688e6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.204207 Jul 14 16:08:15.663779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1060/2220] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:15 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:16.153305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-06cd8acc-903c-4a56-8d26-177324f89adf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:16.153977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-06cd8acc-903c-4a56-8d26-177324f89adf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:16.161085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06cd8acc-903c-4a56-8d26-177324f89adf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:16.162215 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06cd8acc-903c-4a56-8d26-177324f89adf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:16.163180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06cd8acc-903c-4a56-8d26-177324f89adf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:16.163655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-06cd8acc-903c-4a56-8d26-177324f89adf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:16.244531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-06cd8acc-903c-4a56-8d26-177324f89adf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:16.256131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-06cd8acc-903c-4a56-8d26-177324f89adf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:16.258069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-06cd8acc-903c-4a56-8d26-177324f89adf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:16.259215 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-06cd8acc-903c-4a56-8d26-177324f89adf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.111155 Jul 14 16:08:16.259797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1161/2221] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:16 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:16.684057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b389bbaf-a7b1-4a2f-b113-cbe3b1b57d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:16.684769 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b389bbaf-a7b1-4a2f-b113-cbe3b1b57d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:16.692022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b389bbaf-a7b1-4a2f-b113-cbe3b1b57d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:16.692479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b389bbaf-a7b1-4a2f-b113-cbe3b1b57d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:16.693959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b389bbaf-a7b1-4a2f-b113-cbe3b1b57d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:16.694403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b389bbaf-a7b1-4a2f-b113-cbe3b1b57d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:16.843237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b389bbaf-a7b1-4a2f-b113-cbe3b1b57d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:16.852045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b389bbaf-a7b1-4a2f-b113-cbe3b1b57d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.172070 Jul 14 16:08:16.852698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1061/2222] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:16 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:17.279696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ffbe1ee5-e3ba-4838-aa60-7e065868fe84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:17.280231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ffbe1ee5-e3ba-4838-aa60-7e065868fe84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:17.287001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffbe1ee5-e3ba-4838-aa60-7e065868fe84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:17.287465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffbe1ee5-e3ba-4838-aa60-7e065868fe84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:17.288265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffbe1ee5-e3ba-4838-aa60-7e065868fe84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:17.288693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffbe1ee5-e3ba-4838-aa60-7e065868fe84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:17.310365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:17.355860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ffbe1ee5-e3ba-4838-aa60-7e065868fe84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:17.365245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ffbe1ee5-e3ba-4838-aa60-7e065868fe84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:17.366927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ffbe1ee5-e3ba-4838-aa60-7e065868fe84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:17.368101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ffbe1ee5-e3ba-4838-aa60-7e065868fe84 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.092410 Jul 14 16:08:17.368657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1162/2223] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:17 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:17.870548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-011202ad-8237-45ac-9fe1-a7361df1b9ca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:17.871201 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-011202ad-8237-45ac-9fe1-a7361df1b9ca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:17.877919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-011202ad-8237-45ac-9fe1-a7361df1b9ca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:17.878373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-011202ad-8237-45ac-9fe1-a7361df1b9ca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:17.879142 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-011202ad-8237-45ac-9fe1-a7361df1b9ca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:17.879587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-011202ad-8237-45ac-9fe1-a7361df1b9ca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:18.014229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-011202ad-8237-45ac-9fe1-a7361df1b9ca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:18.022533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-011202ad-8237-45ac-9fe1-a7361df1b9ca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155852 Jul 14 16:08:18.023106 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1062/2224] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:17 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:18.386284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-eba7e922-a471-4c78-b814-4cd0941371c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:18.386880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eba7e922-a471-4c78-b814-4cd0941371c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:18.393543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eba7e922-a471-4c78-b814-4cd0941371c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:18.393992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eba7e922-a471-4c78-b814-4cd0941371c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:18.394773 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eba7e922-a471-4c78-b814-4cd0941371c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:18.395206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eba7e922-a471-4c78-b814-4cd0941371c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:18.462939 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-eba7e922-a471-4c78-b814-4cd0941371c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:18.469622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-eba7e922-a471-4c78-b814-4cd0941371c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:18.471128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-eba7e922-a471-4c78-b814-4cd0941371c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:18.472312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-eba7e922-a471-4c78-b814-4cd0941371c1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090004 Jul 14 16:08:18.472872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1163/2225] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:18 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:19.040580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4023fc51-b95d-4278-8786-d39c6cf37ae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:19.041197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4023fc51-b95d-4278-8786-d39c6cf37ae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:19.048033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4023fc51-b95d-4278-8786-d39c6cf37ae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:19.048485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4023fc51-b95d-4278-8786-d39c6cf37ae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:19.049254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4023fc51-b95d-4278-8786-d39c6cf37ae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:19.049694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4023fc51-b95d-4278-8786-d39c6cf37ae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:19.198330 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4023fc51-b95d-4278-8786-d39c6cf37ae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:19.207146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4023fc51-b95d-4278-8786-d39c6cf37ae9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.170904 Jul 14 16:08:19.207748 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1063/2226] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:19 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:19.494270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-487d351d-4c99-495e-871a-45eff78fa4f5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:19.495089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-487d351d-4c99-495e-871a-45eff78fa4f5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:19.505021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-487d351d-4c99-495e-871a-45eff78fa4f5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:19.505958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-487d351d-4c99-495e-871a-45eff78fa4f5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:19.506887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-487d351d-4c99-495e-871a-45eff78fa4f5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:19.507320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-487d351d-4c99-495e-871a-45eff78fa4f5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:19.575367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-487d351d-4c99-495e-871a-45eff78fa4f5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:19.584434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-487d351d-4c99-495e-871a-45eff78fa4f5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:19.586498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-487d351d-4c99-495e-871a-45eff78fa4f5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:19.587770 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-487d351d-4c99-495e-871a-45eff78fa4f5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.100326 Jul 14 16:08:19.588340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1164/2227] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:19 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:20.227271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-97f9264e-0e0e-44bb-9bdd-53cec64bbda7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:20.228163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-97f9264e-0e0e-44bb-9bdd-53cec64bbda7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:20.236625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97f9264e-0e0e-44bb-9bdd-53cec64bbda7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:20.237135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97f9264e-0e0e-44bb-9bdd-53cec64bbda7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:20.238193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97f9264e-0e0e-44bb-9bdd-53cec64bbda7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:20.238634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97f9264e-0e0e-44bb-9bdd-53cec64bbda7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:20.375347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-97f9264e-0e0e-44bb-9bdd-53cec64bbda7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:20.384599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-97f9264e-0e0e-44bb-9bdd-53cec64bbda7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.162721 Jul 14 16:08:20.385254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1064/2228] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:20 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:20.605794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-400804c7-f695-48d5-92e3-5a527183d2c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:20.606362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-400804c7-f695-48d5-92e3-5a527183d2c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:20.613086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-400804c7-f695-48d5-92e3-5a527183d2c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:20.613541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-400804c7-f695-48d5-92e3-5a527183d2c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:20.614321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-400804c7-f695-48d5-92e3-5a527183d2c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:20.614765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-400804c7-f695-48d5-92e3-5a527183d2c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:20.678367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-400804c7-f695-48d5-92e3-5a527183d2c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:20.687906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-400804c7-f695-48d5-92e3-5a527183d2c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:20.689390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-400804c7-f695-48d5-92e3-5a527183d2c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:20.690584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-400804c7-f695-48d5-92e3-5a527183d2c9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089253 Jul 14 16:08:20.691136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1165/2229] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:21.403890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2c585a71-7544-4cd2-af19-2666840a1bdd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:21.404502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2c585a71-7544-4cd2-af19-2666840a1bdd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:21.411024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2c585a71-7544-4cd2-af19-2666840a1bdd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:21.411469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2c585a71-7544-4cd2-af19-2666840a1bdd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:21.412265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2c585a71-7544-4cd2-af19-2666840a1bdd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:21.412703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2c585a71-7544-4cd2-af19-2666840a1bdd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:21.556565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2c585a71-7544-4cd2-af19-2666840a1bdd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:21.564859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2c585a71-7544-4cd2-af19-2666840a1bdd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.165502 Jul 14 16:08:21.565440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1065/2230] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:21 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:21.707976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f4ef78ef-119b-4495-b5ad-090cbddb30a4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:21.708559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f4ef78ef-119b-4495-b5ad-090cbddb30a4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:21.716074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4ef78ef-119b-4495-b5ad-090cbddb30a4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:21.716520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4ef78ef-119b-4495-b5ad-090cbddb30a4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:21.717286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4ef78ef-119b-4495-b5ad-090cbddb30a4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:21.717881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4ef78ef-119b-4495-b5ad-090cbddb30a4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:21.781445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f4ef78ef-119b-4495-b5ad-090cbddb30a4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:21.790069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f4ef78ef-119b-4495-b5ad-090cbddb30a4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:21.792580 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f4ef78ef-119b-4495-b5ad-090cbddb30a4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:21.793816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f4ef78ef-119b-4495-b5ad-090cbddb30a4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089997 Jul 14 16:08:21.794440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1166/2231] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:21 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:22.584960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0d441d45-8261-477c-b26a-16859badb93d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:22.585602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0d441d45-8261-477c-b26a-16859badb93d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:22.592964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d441d45-8261-477c-b26a-16859badb93d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:22.593618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d441d45-8261-477c-b26a-16859badb93d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:22.594412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d441d45-8261-477c-b26a-16859badb93d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:22.594850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d441d45-8261-477c-b26a-16859badb93d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:22.726015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0d441d45-8261-477c-b26a-16859badb93d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:22.734737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0d441d45-8261-477c-b26a-16859badb93d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153636 Jul 14 16:08:22.735309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1066/2232] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:22 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:22.811972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-79eb6d11-b4be-42f7-8d4c-72b59556e188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:22.812669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-79eb6d11-b4be-42f7-8d4c-72b59556e188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:22.819492 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79eb6d11-b4be-42f7-8d4c-72b59556e188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:22.819991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79eb6d11-b4be-42f7-8d4c-72b59556e188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:22.820740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79eb6d11-b4be-42f7-8d4c-72b59556e188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:22.821171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-79eb6d11-b4be-42f7-8d4c-72b59556e188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:22.883509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-79eb6d11-b4be-42f7-8d4c-72b59556e188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:22.895790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-79eb6d11-b4be-42f7-8d4c-72b59556e188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:22.897296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-79eb6d11-b4be-42f7-8d4c-72b59556e188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:22.898449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-79eb6d11-b4be-42f7-8d4c-72b59556e188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090456 Jul 14 16:08:22.899012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1167/2233] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:22 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:23.751899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a1ea3e8b-3639-4cc4-b578-6233e221aadc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:23.752531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a1ea3e8b-3639-4cc4-b578-6233e221aadc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:23.759155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a1ea3e8b-3639-4cc4-b578-6233e221aadc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:23.759723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a1ea3e8b-3639-4cc4-b578-6233e221aadc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:23.760501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a1ea3e8b-3639-4cc4-b578-6233e221aadc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:23.760947 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a1ea3e8b-3639-4cc4-b578-6233e221aadc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:23.897946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a1ea3e8b-3639-4cc4-b578-6233e221aadc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:23.907447 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a1ea3e8b-3639-4cc4-b578-6233e221aadc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.159518 Jul 14 16:08:23.908053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1067/2234] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:23 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:23.917407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fcc37684-a35f-4bec-9194-6c13d6447481 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:23.918031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fcc37684-a35f-4bec-9194-6c13d6447481 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:23.925844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcc37684-a35f-4bec-9194-6c13d6447481 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:23.925844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcc37684-a35f-4bec-9194-6c13d6447481 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:23.926146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcc37684-a35f-4bec-9194-6c13d6447481 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:23.926350 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcc37684-a35f-4bec-9194-6c13d6447481 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:23.992919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcc37684-a35f-4bec-9194-6c13d6447481 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:24.002796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcc37684-a35f-4bec-9194-6c13d6447481 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:24.004317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcc37684-a35f-4bec-9194-6c13d6447481 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:24.005452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fcc37684-a35f-4bec-9194-6c13d6447481 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.092536 Jul 14 16:08:24.006017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1168/2235] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:23 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:24.926737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6bb4a265-2ea8-4287-b5ad-50fca8bd3e8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:24.927331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6bb4a265-2ea8-4287-b5ad-50fca8bd3e8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:24.934559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6bb4a265-2ea8-4287-b5ad-50fca8bd3e8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:24.935008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6bb4a265-2ea8-4287-b5ad-50fca8bd3e8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:24.935805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6bb4a265-2ea8-4287-b5ad-50fca8bd3e8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:24.936243 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6bb4a265-2ea8-4287-b5ad-50fca8bd3e8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:25.022320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9c0f94e0-eb6a-4926-9b26-90717e375000 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:25.023092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9c0f94e0-eb6a-4926-9b26-90717e375000 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:25.030520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c0f94e0-eb6a-4926-9b26-90717e375000 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:25.030961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c0f94e0-eb6a-4926-9b26-90717e375000 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:25.031792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c0f94e0-eb6a-4926-9b26-90717e375000 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:25.032231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c0f94e0-eb6a-4926-9b26-90717e375000 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:25.074910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6bb4a265-2ea8-4287-b5ad-50fca8bd3e8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:25.083865 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6bb4a265-2ea8-4287-b5ad-50fca8bd3e8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161041 Jul 14 16:08:25.084459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1068/2236] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:24 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:25.101270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9c0f94e0-eb6a-4926-9b26-90717e375000 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:25.110675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9c0f94e0-eb6a-4926-9b26-90717e375000 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:25.112288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9c0f94e0-eb6a-4926-9b26-90717e375000 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:25.113523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9c0f94e0-eb6a-4926-9b26-90717e375000 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.095161 Jul 14 16:08:25.114092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1169/2237] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:25 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:26.101518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c895e34a-bd71-4de0-afd4-c3b80f605f14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:26.102065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c895e34a-bd71-4de0-afd4-c3b80f605f14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:26.109050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c895e34a-bd71-4de0-afd4-c3b80f605f14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:26.109499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c895e34a-bd71-4de0-afd4-c3b80f605f14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:26.110260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c895e34a-bd71-4de0-afd4-c3b80f605f14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:26.110705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c895e34a-bd71-4de0-afd4-c3b80f605f14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:26.132120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-13e990e9-7a6f-483f-8898-1142be76c06c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:26.132725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-13e990e9-7a6f-483f-8898-1142be76c06c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:26.140560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13e990e9-7a6f-483f-8898-1142be76c06c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:26.141014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13e990e9-7a6f-483f-8898-1142be76c06c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:26.141775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13e990e9-7a6f-483f-8898-1142be76c06c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:26.142208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13e990e9-7a6f-483f-8898-1142be76c06c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:26.209464 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-13e990e9-7a6f-483f-8898-1142be76c06c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:26.218733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-13e990e9-7a6f-483f-8898-1142be76c06c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:26.220247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-13e990e9-7a6f-483f-8898-1142be76c06c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:26.221404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-13e990e9-7a6f-483f-8898-1142be76c06c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.093105 Jul 14 16:08:26.221963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1170/2238] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:26 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:26.249325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c895e34a-bd71-4de0-afd4-c3b80f605f14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:26.257310 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c895e34a-bd71-4de0-afd4-c3b80f605f14 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.159702 Jul 14 16:08:26.257889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1069/2239] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:26 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:27.243862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5d868e98-a754-4ea1-bc06-f6a1341f4539 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:27.245393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5d868e98-a754-4ea1-bc06-f6a1341f4539 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:27.252951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5d868e98-a754-4ea1-bc06-f6a1341f4539 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.253316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5d868e98-a754-4ea1-bc06-f6a1341f4539 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.254084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5d868e98-a754-4ea1-bc06-f6a1341f4539 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.254512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5d868e98-a754-4ea1-bc06-f6a1341f4539 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.275744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ecf5cf8d-fec8-4f6d-b2c7-4bd034ab2d00 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:27.277141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ecf5cf8d-fec8-4f6d-b2c7-4bd034ab2d00 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:27.283914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ecf5cf8d-fec8-4f6d-b2c7-4bd034ab2d00 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.284477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ecf5cf8d-fec8-4f6d-b2c7-4bd034ab2d00 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.285260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ecf5cf8d-fec8-4f6d-b2c7-4bd034ab2d00 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:27.285694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ecf5cf8d-fec8-4f6d-b2c7-4bd034ab2d00 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:27.323038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5d868e98-a754-4ea1-bc06-f6a1341f4539 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:27.331720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5d868e98-a754-4ea1-bc06-f6a1341f4539 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:27.333205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5d868e98-a754-4ea1-bc06-f6a1341f4539 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:27.334360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5d868e98-a754-4ea1-bc06-f6a1341f4539 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.097307 Jul 14 16:08:27.334958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1171/2240] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:27.429441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ecf5cf8d-fec8-4f6d-b2c7-4bd034ab2d00 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:27.432861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:27.438291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ecf5cf8d-fec8-4f6d-b2c7-4bd034ab2d00 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.166445 Jul 14 16:08:27.438866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1070/2241] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:27 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:28.354609 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d843b93b-20ef-4520-8f56-b8d003ce5fed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:28.355224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d843b93b-20ef-4520-8f56-b8d003ce5fed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:28.363895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d843b93b-20ef-4520-8f56-b8d003ce5fed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:28.363895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d843b93b-20ef-4520-8f56-b8d003ce5fed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:28.365958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d843b93b-20ef-4520-8f56-b8d003ce5fed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:28.365958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d843b93b-20ef-4520-8f56-b8d003ce5fed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:28.434468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d843b93b-20ef-4520-8f56-b8d003ce5fed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:28.443233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d843b93b-20ef-4520-8f56-b8d003ce5fed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:28.444775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d843b93b-20ef-4520-8f56-b8d003ce5fed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:28.445936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d843b93b-20ef-4520-8f56-b8d003ce5fed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.095866 Jul 14 16:08:28.446497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1172/2242] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:28 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:28.456548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-aba77cbc-60cb-4730-a831-c5298b2f8ad0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:28.457168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-aba77cbc-60cb-4730-a831-c5298b2f8ad0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:28.464567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aba77cbc-60cb-4730-a831-c5298b2f8ad0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:28.465522 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aba77cbc-60cb-4730-a831-c5298b2f8ad0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:28.465703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aba77cbc-60cb-4730-a831-c5298b2f8ad0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:28.466128 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aba77cbc-60cb-4730-a831-c5298b2f8ad0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:28.614268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aba77cbc-60cb-4730-a831-c5298b2f8ad0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:28.627400 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-aba77cbc-60cb-4730-a831-c5298b2f8ad0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.174704 Jul 14 16:08:28.628493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1071/2243] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:28 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:29.465443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7793db28-89d8-4dfc-a762-2bccb0ddf074 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:29.466097 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7793db28-89d8-4dfc-a762-2bccb0ddf074 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:29.472654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7793db28-89d8-4dfc-a762-2bccb0ddf074 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.473108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7793db28-89d8-4dfc-a762-2bccb0ddf074 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:29.473866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7793db28-89d8-4dfc-a762-2bccb0ddf074 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.474305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7793db28-89d8-4dfc-a762-2bccb0ddf074 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:29.535542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7793db28-89d8-4dfc-a762-2bccb0ddf074 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:29.545281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7793db28-89d8-4dfc-a762-2bccb0ddf074 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:29.546760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7793db28-89d8-4dfc-a762-2bccb0ddf074 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:29.547913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7793db28-89d8-4dfc-a762-2bccb0ddf074 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086607 Jul 14 16:08:29.548468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1173/2244] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:29 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:29.648703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3788271c-9fad-4578-a185-14572a4f2184 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:29.649325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3788271c-9fad-4578-a185-14572a4f2184 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:29.661124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3788271c-9fad-4578-a185-14572a4f2184 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.661848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3788271c-9fad-4578-a185-14572a4f2184 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:29.662913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3788271c-9fad-4578-a185-14572a4f2184 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:29.663355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3788271c-9fad-4578-a185-14572a4f2184 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:29.804916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3788271c-9fad-4578-a185-14572a4f2184 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:29.814098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3788271c-9fad-4578-a185-14572a4f2184 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.168923 Jul 14 16:08:29.814670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1072/2245] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:29 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:30.566275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-74fe6f3d-1d9b-47ef-b3bc-2b54fa784995 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:30.566872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-74fe6f3d-1d9b-47ef-b3bc-2b54fa784995 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:30.574019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74fe6f3d-1d9b-47ef-b3bc-2b54fa784995 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:30.574458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74fe6f3d-1d9b-47ef-b3bc-2b54fa784995 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:30.575203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74fe6f3d-1d9b-47ef-b3bc-2b54fa784995 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:30.575693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74fe6f3d-1d9b-47ef-b3bc-2b54fa784995 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:30.636990 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-74fe6f3d-1d9b-47ef-b3bc-2b54fa784995 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:30.646054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-74fe6f3d-1d9b-47ef-b3bc-2b54fa784995 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:30.647497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-74fe6f3d-1d9b-47ef-b3bc-2b54fa784995 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:30.648671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-74fe6f3d-1d9b-47ef-b3bc-2b54fa784995 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086300 Jul 14 16:08:30.649231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1174/2246] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:30 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:30.831695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-31694efa-562e-41a2-a141-e0fe9f2ca909 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:30.832296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-31694efa-562e-41a2-a141-e0fe9f2ca909 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:30.838922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-31694efa-562e-41a2-a141-e0fe9f2ca909 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:30.839381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-31694efa-562e-41a2-a141-e0fe9f2ca909 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:30.840172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-31694efa-562e-41a2-a141-e0fe9f2ca909 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:30.840617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-31694efa-562e-41a2-a141-e0fe9f2ca909 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:30.967436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-31694efa-562e-41a2-a141-e0fe9f2ca909 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:30.975246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-31694efa-562e-41a2-a141-e0fe9f2ca909 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.147554 Jul 14 16:08:30.975851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1073/2247] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:30 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:31.668633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-324a351e-af79-4165-8cb2-1e989ef99f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:31.669237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-324a351e-af79-4165-8cb2-1e989ef99f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:31.675824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-324a351e-af79-4165-8cb2-1e989ef99f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:31.676266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-324a351e-af79-4165-8cb2-1e989ef99f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:31.677012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-324a351e-af79-4165-8cb2-1e989ef99f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:31.677440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-324a351e-af79-4165-8cb2-1e989ef99f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:31.747164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-324a351e-af79-4165-8cb2-1e989ef99f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:31.755633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-324a351e-af79-4165-8cb2-1e989ef99f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:31.757110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-324a351e-af79-4165-8cb2-1e989ef99f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:31.758246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-324a351e-af79-4165-8cb2-1e989ef99f6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.094896 Jul 14 16:08:31.758793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1175/2248] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:31 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:31.998516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d9ed74bc-af95-40c8-bb85-6b1725d84768 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:31.999136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d9ed74bc-af95-40c8-bb85-6b1725d84768 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:32.005690 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9ed74bc-af95-40c8-bb85-6b1725d84768 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:32.006140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9ed74bc-af95-40c8-bb85-6b1725d84768 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:32.006896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9ed74bc-af95-40c8-bb85-6b1725d84768 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:32.007333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9ed74bc-af95-40c8-bb85-6b1725d84768 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:32.138226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d9ed74bc-af95-40c8-bb85-6b1725d84768 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:32.146141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d9ed74bc-af95-40c8-bb85-6b1725d84768 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153406 Jul 14 16:08:32.146725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1074/2249] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:31 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:32.776040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-03be0f13-5393-4d9d-8f7f-b469293ab368 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:32.776687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-03be0f13-5393-4d9d-8f7f-b469293ab368 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:32.783419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03be0f13-5393-4d9d-8f7f-b469293ab368 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:32.783905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03be0f13-5393-4d9d-8f7f-b469293ab368 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:32.784654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03be0f13-5393-4d9d-8f7f-b469293ab368 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:32.785095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03be0f13-5393-4d9d-8f7f-b469293ab368 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:32.848125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-03be0f13-5393-4d9d-8f7f-b469293ab368 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:32.857001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-03be0f13-5393-4d9d-8f7f-b469293ab368 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:32.858495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-03be0f13-5393-4d9d-8f7f-b469293ab368 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:32.859653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-03be0f13-5393-4d9d-8f7f-b469293ab368 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087562 Jul 14 16:08:32.860240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1176/2250] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:33.164199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-68f84106-60a4-4d72-9a1c-116c90f31d96 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:33.164817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-68f84106-60a4-4d72-9a1c-116c90f31d96 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:33.172837 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68f84106-60a4-4d72-9a1c-116c90f31d96 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:33.173290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68f84106-60a4-4d72-9a1c-116c90f31d96 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:33.174051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68f84106-60a4-4d72-9a1c-116c90f31d96 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:33.174487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68f84106-60a4-4d72-9a1c-116c90f31d96 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:33.310640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-68f84106-60a4-4d72-9a1c-116c90f31d96 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:33.318572 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-68f84106-60a4-4d72-9a1c-116c90f31d96 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158203 Jul 14 16:08:33.319129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1075/2251] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:33 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:33.877395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d963fc49-7e9c-4774-9937-ac2cedcdd4c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:33.878002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d963fc49-7e9c-4774-9937-ac2cedcdd4c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:33.879900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=54 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:33.885133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d963fc49-7e9c-4774-9937-ac2cedcdd4c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:33.885585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d963fc49-7e9c-4774-9937-ac2cedcdd4c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:33.887178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d963fc49-7e9c-4774-9937-ac2cedcdd4c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:33.887619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d963fc49-7e9c-4774-9937-ac2cedcdd4c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:33.949636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d963fc49-7e9c-4774-9937-ac2cedcdd4c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:33.957907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d963fc49-7e9c-4774-9937-ac2cedcdd4c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:33.959382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d963fc49-7e9c-4774-9937-ac2cedcdd4c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:33.960544 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d963fc49-7e9c-4774-9937-ac2cedcdd4c3 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087218 Jul 14 16:08:33.961100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1177/2252] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:33 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:34.336420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5f4a42d7-c4d3-4e98-b9ab-27adb929c1d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:34.337071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5f4a42d7-c4d3-4e98-b9ab-27adb929c1d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:34.344312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5f4a42d7-c4d3-4e98-b9ab-27adb929c1d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:34.344763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5f4a42d7-c4d3-4e98-b9ab-27adb929c1d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:34.345517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5f4a42d7-c4d3-4e98-b9ab-27adb929c1d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:34.345952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5f4a42d7-c4d3-4e98-b9ab-27adb929c1d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:34.478397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5f4a42d7-c4d3-4e98-b9ab-27adb929c1d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:34.488420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5f4a42d7-c4d3-4e98-b9ab-27adb929c1d7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155799 Jul 14 16:08:34.488984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1076/2253] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:34 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:34.979284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-049df17a-c5b0-4ea7-84c8-03a684b04af5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:34.980057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-049df17a-c5b0-4ea7-84c8-03a684b04af5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:34.986660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-049df17a-c5b0-4ea7-84c8-03a684b04af5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:34.987116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-049df17a-c5b0-4ea7-84c8-03a684b04af5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:34.987926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-049df17a-c5b0-4ea7-84c8-03a684b04af5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:34.988370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-049df17a-c5b0-4ea7-84c8-03a684b04af5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:35.056751 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-049df17a-c5b0-4ea7-84c8-03a684b04af5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:35.065524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-049df17a-c5b0-4ea7-84c8-03a684b04af5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:35.067012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-049df17a-c5b0-4ea7-84c8-03a684b04af5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:35.068183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-049df17a-c5b0-4ea7-84c8-03a684b04af5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.092871 Jul 14 16:08:35.068736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1178/2254] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:34 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:35.505154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e323b813-8a9f-4cf9-8ad8-692fd0ce8abf tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:35.505708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e323b813-8a9f-4cf9-8ad8-692fd0ce8abf tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:35.512758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e323b813-8a9f-4cf9-8ad8-692fd0ce8abf tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:35.513214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e323b813-8a9f-4cf9-8ad8-692fd0ce8abf tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:35.513983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e323b813-8a9f-4cf9-8ad8-692fd0ce8abf tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:35.514441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e323b813-8a9f-4cf9-8ad8-692fd0ce8abf tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:35.646517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e323b813-8a9f-4cf9-8ad8-692fd0ce8abf tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:35.655043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e323b813-8a9f-4cf9-8ad8-692fd0ce8abf tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153883 Jul 14 16:08:35.655603 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1077/2255] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:35 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:36.086572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-445ef1f0-6e65-467d-89a7-cda927785eb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:36.087213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-445ef1f0-6e65-467d-89a7-cda927785eb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:36.094338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-445ef1f0-6e65-467d-89a7-cda927785eb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.094782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-445ef1f0-6e65-467d-89a7-cda927785eb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.095528 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-445ef1f0-6e65-467d-89a7-cda927785eb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.095986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-445ef1f0-6e65-467d-89a7-cda927785eb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.099944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:36.158640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-445ef1f0-6e65-467d-89a7-cda927785eb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:36.167307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-445ef1f0-6e65-467d-89a7-cda927785eb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:36.168858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-445ef1f0-6e65-467d-89a7-cda927785eb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:36.170041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-445ef1f0-6e65-467d-89a7-cda927785eb0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087335 Jul 14 16:08:36.170592 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1179/2256] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:36 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:36.673110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-34f318e4-4111-4821-9835-7e7174778f8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:36.673633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-34f318e4-4111-4821-9835-7e7174778f8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:36.680246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-34f318e4-4111-4821-9835-7e7174778f8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.680696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-34f318e4-4111-4821-9835-7e7174778f8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.681460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-34f318e4-4111-4821-9835-7e7174778f8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:36.681897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-34f318e4-4111-4821-9835-7e7174778f8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:36.810960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-34f318e4-4111-4821-9835-7e7174778f8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:36.819003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-34f318e4-4111-4821-9835-7e7174778f8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.150525 Jul 14 16:08:36.819569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1078/2257] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:36 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:37.188232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fcb688dd-7925-488c-b60b-f04ae04c8f36 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:37.188849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fcb688dd-7925-488c-b60b-f04ae04c8f36 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:37.195328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcb688dd-7925-488c-b60b-f04ae04c8f36 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:37.195820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcb688dd-7925-488c-b60b-f04ae04c8f36 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:37.196577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcb688dd-7925-488c-b60b-f04ae04c8f36 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:37.197012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcb688dd-7925-488c-b60b-f04ae04c8f36 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:37.260765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcb688dd-7925-488c-b60b-f04ae04c8f36 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:37.269405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcb688dd-7925-488c-b60b-f04ae04c8f36 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:37.270907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcb688dd-7925-488c-b60b-f04ae04c8f36 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:37.272098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fcb688dd-7925-488c-b60b-f04ae04c8f36 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087971 Jul 14 16:08:37.272662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1180/2258] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:37 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:37.836098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-97f3758f-bdde-4dc0-b1b8-b0e5e6d73277 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:37.836719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-97f3758f-bdde-4dc0-b1b8-b0e5e6d73277 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:37.844075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97f3758f-bdde-4dc0-b1b8-b0e5e6d73277 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:37.844531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97f3758f-bdde-4dc0-b1b8-b0e5e6d73277 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:37.845309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97f3758f-bdde-4dc0-b1b8-b0e5e6d73277 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:37.845752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97f3758f-bdde-4dc0-b1b8-b0e5e6d73277 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:37.970767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-97f3758f-bdde-4dc0-b1b8-b0e5e6d73277 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:37.978736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-97f3758f-bdde-4dc0-b1b8-b0e5e6d73277 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.146564 Jul 14 16:08:37.979309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1079/2259] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:37 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:38.290343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5f955209-3b99-41d3-ba80-6db1c0b72eed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:38.291194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5f955209-3b99-41d3-ba80-6db1c0b72eed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:38.298313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f955209-3b99-41d3-ba80-6db1c0b72eed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:38.298764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f955209-3b99-41d3-ba80-6db1c0b72eed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:38.299526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f955209-3b99-41d3-ba80-6db1c0b72eed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:38.299996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f955209-3b99-41d3-ba80-6db1c0b72eed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:38.361729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5f955209-3b99-41d3-ba80-6db1c0b72eed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:38.370105 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5f955209-3b99-41d3-ba80-6db1c0b72eed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:38.372300 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5f955209-3b99-41d3-ba80-6db1c0b72eed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:38.373447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5f955209-3b99-41d3-ba80-6db1c0b72eed tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087119 Jul 14 16:08:38.373999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1181/2260] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:38.997913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9a92d231-3645-45de-b4e5-47c8154f785f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:38.998546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9a92d231-3645-45de-b4e5-47c8154f785f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:39.006443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9a92d231-3645-45de-b4e5-47c8154f785f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:39.006926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9a92d231-3645-45de-b4e5-47c8154f785f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:39.007730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9a92d231-3645-45de-b4e5-47c8154f785f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:39.008524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9a92d231-3645-45de-b4e5-47c8154f785f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:39.386793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9a92d231-3645-45de-b4e5-47c8154f785f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:39.391288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-38965dc6-0f35-4642-ad15-3b79609b00f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:39.391925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-38965dc6-0f35-4642-ad15-3b79609b00f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:39.398606 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38965dc6-0f35-4642-ad15-3b79609b00f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:39.399057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38965dc6-0f35-4642-ad15-3b79609b00f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:39.399206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9a92d231-3645-45de-b4e5-47c8154f785f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.402120 Jul 14 16:08:39.400246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38965dc6-0f35-4642-ad15-3b79609b00f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:39.400372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1080/2261] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:38 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:39.401033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-38965dc6-0f35-4642-ad15-3b79609b00f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:39.467132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-38965dc6-0f35-4642-ad15-3b79609b00f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:39.475588 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-38965dc6-0f35-4642-ad15-3b79609b00f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:39.477130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-38965dc6-0f35-4642-ad15-3b79609b00f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:39.478275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-38965dc6-0f35-4642-ad15-3b79609b00f0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.091182 Jul 14 16:08:39.478830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1182/2262] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:39 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:40.417846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-da5f22c1-4804-47ff-9d9b-4cc0fafc1528 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:40.418490 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-da5f22c1-4804-47ff-9d9b-4cc0fafc1528 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:40.425204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-da5f22c1-4804-47ff-9d9b-4cc0fafc1528 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:40.425657 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-da5f22c1-4804-47ff-9d9b-4cc0fafc1528 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:40.426417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-da5f22c1-4804-47ff-9d9b-4cc0fafc1528 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:40.426847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-da5f22c1-4804-47ff-9d9b-4cc0fafc1528 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:40.497250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c62659f2-d0f0-43fd-ab18-56a796c84084 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:40.497798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c62659f2-d0f0-43fd-ab18-56a796c84084 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:40.505322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c62659f2-d0f0-43fd-ab18-56a796c84084 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:40.505322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c62659f2-d0f0-43fd-ab18-56a796c84084 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:40.506040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c62659f2-d0f0-43fd-ab18-56a796c84084 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:40.506481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c62659f2-d0f0-43fd-ab18-56a796c84084 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:40.558564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-da5f22c1-4804-47ff-9d9b-4cc0fafc1528 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:40.567856 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-da5f22c1-4804-47ff-9d9b-4cc0fafc1528 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154025 Jul 14 16:08:40.568416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1081/2263] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:40 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:40.580016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c62659f2-d0f0-43fd-ab18-56a796c84084 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:40.588393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c62659f2-d0f0-43fd-ab18-56a796c84084 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:40.589883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c62659f2-d0f0-43fd-ab18-56a796c84084 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:40.591713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c62659f2-d0f0-43fd-ab18-56a796c84084 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.098960 Jul 14 16:08:40.592274 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1183/2264] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:40 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:41.584975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c7b78c86-3364-4714-a1a6-e3d53af7c456 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:41.585707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c7b78c86-3364-4714-a1a6-e3d53af7c456 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:41.592446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7b78c86-3364-4714-a1a6-e3d53af7c456 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.592885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7b78c86-3364-4714-a1a6-e3d53af7c456 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:41.593635 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7b78c86-3364-4714-a1a6-e3d53af7c456 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.594069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7b78c86-3364-4714-a1a6-e3d53af7c456 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:41.609599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c04c0a7d-03ef-48d4-ac70-b6a68a74bcb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:41.610218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c04c0a7d-03ef-48d4-ac70-b6a68a74bcb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:41.616635 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c04c0a7d-03ef-48d4-ac70-b6a68a74bcb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.617092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c04c0a7d-03ef-48d4-ac70-b6a68a74bcb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:41.617854 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c04c0a7d-03ef-48d4-ac70-b6a68a74bcb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:41.618293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c04c0a7d-03ef-48d4-ac70-b6a68a74bcb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:41.687399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c04c0a7d-03ef-48d4-ac70-b6a68a74bcb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:41.697092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c04c0a7d-03ef-48d4-ac70-b6a68a74bcb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:41.698574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c04c0a7d-03ef-48d4-ac70-b6a68a74bcb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:41.700336 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c04c0a7d-03ef-48d4-ac70-b6a68a74bcb2 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.094162 Jul 14 16:08:41.701004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1184/2265] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:41 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:41.731296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c7b78c86-3364-4714-a1a6-e3d53af7c456 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:41.739243 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c7b78c86-3364-4714-a1a6-e3d53af7c456 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158267 Jul 14 16:08:41.739835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1082/2266] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:41 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:42.719930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8aeefc65-7016-48e9-84c5-f488b8ed3237 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:42.720736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8aeefc65-7016-48e9-84c5-f488b8ed3237 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:42.726972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8aeefc65-7016-48e9-84c5-f488b8ed3237 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.727412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8aeefc65-7016-48e9-84c5-f488b8ed3237 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.728190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8aeefc65-7016-48e9-84c5-f488b8ed3237 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.728621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8aeefc65-7016-48e9-84c5-f488b8ed3237 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.757028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ba6f5392-582d-413a-8386-95e2de430975 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:42.757662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ba6f5392-582d-413a-8386-95e2de430975 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:42.759971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=52 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:42.766170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba6f5392-582d-413a-8386-95e2de430975 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.766621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba6f5392-582d-413a-8386-95e2de430975 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.767399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba6f5392-582d-413a-8386-95e2de430975 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:42.767870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ba6f5392-582d-413a-8386-95e2de430975 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:42.791290 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8aeefc65-7016-48e9-84c5-f488b8ed3237 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:42.800067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8aeefc65-7016-48e9-84c5-f488b8ed3237 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:42.801564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8aeefc65-7016-48e9-84c5-f488b8ed3237 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:42.802706 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8aeefc65-7016-48e9-84c5-f488b8ed3237 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088639 Jul 14 16:08:42.803268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1185/2267] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:42 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:42.901068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ba6f5392-582d-413a-8386-95e2de430975 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:42.910145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ba6f5392-582d-413a-8386-95e2de430975 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156893 Jul 14 16:08:42.910960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1083/2268] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:42 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:08:43.821189 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c0af5b92-4eb5-419e-8a8d-e4decbe6f078 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:43.821818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c0af5b92-4eb5-419e-8a8d-e4decbe6f078 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:43.829455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0af5b92-4eb5-419e-8a8d-e4decbe6f078 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:43.829987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0af5b92-4eb5-419e-8a8d-e4decbe6f078 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:43.830734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0af5b92-4eb5-419e-8a8d-e4decbe6f078 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:43.831165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0af5b92-4eb5-419e-8a8d-e4decbe6f078 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:43.893502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c0af5b92-4eb5-419e-8a8d-e4decbe6f078 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:43.901821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c0af5b92-4eb5-419e-8a8d-e4decbe6f078 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:43.903728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c0af5b92-4eb5-419e-8a8d-e4decbe6f078 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:43.904916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c0af5b92-4eb5-419e-8a8d-e4decbe6f078 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087646 Jul 14 16:08:43.905472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1186/2269] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:43 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:43.926601 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3755387c-1eaf-43f3-80dd-0b8a1da42df6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:43.927218 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3755387c-1eaf-43f3-80dd-0b8a1da42df6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:43.934344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3755387c-1eaf-43f3-80dd-0b8a1da42df6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:43.934862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3755387c-1eaf-43f3-80dd-0b8a1da42df6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:43.935681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3755387c-1eaf-43f3-80dd-0b8a1da42df6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:43.936126 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3755387c-1eaf-43f3-80dd-0b8a1da42df6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.073449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3755387c-1eaf-43f3-80dd-0b8a1da42df6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:44.082299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3755387c-1eaf-43f3-80dd-0b8a1da42df6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.159481 Jul 14 16:08:44.082871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1084/2270] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:43 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:44.923559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7140b40b-d286-4c2a-849d-a0f416881a7e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:44.924310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7140b40b-d286-4c2a-849d-a0f416881a7e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:44.930634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7140b40b-d286-4c2a-849d-a0f416881a7e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.931083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7140b40b-d286-4c2a-849d-a0f416881a7e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.931893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7140b40b-d286-4c2a-849d-a0f416881a7e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:44.932288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7140b40b-d286-4c2a-849d-a0f416881a7e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:44.994961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7140b40b-d286-4c2a-849d-a0f416881a7e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:45.004306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7140b40b-d286-4c2a-849d-a0f416881a7e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:45.005802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7140b40b-d286-4c2a-849d-a0f416881a7e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:45.006949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7140b40b-d286-4c2a-849d-a0f416881a7e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087961 Jul 14 16:08:45.007503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1187/2271] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:45.100912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-40596f0f-2560-4bf9-90b2-59a81cba531c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:45.101453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-40596f0f-2560-4bf9-90b2-59a81cba531c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:45.108115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40596f0f-2560-4bf9-90b2-59a81cba531c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:45.108569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40596f0f-2560-4bf9-90b2-59a81cba531c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:45.109341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40596f0f-2560-4bf9-90b2-59a81cba531c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:45.109781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40596f0f-2560-4bf9-90b2-59a81cba531c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:45.245231 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-40596f0f-2560-4bf9-90b2-59a81cba531c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:45.254082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-40596f0f-2560-4bf9-90b2-59a81cba531c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157124 Jul 14 16:08:45.254651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1085/2272] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:45 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:46.025330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6856931a-754e-48b0-be88-38fc6dbbdc6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:46.025969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6856931a-754e-48b0-be88-38fc6dbbdc6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:46.033165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6856931a-754e-48b0-be88-38fc6dbbdc6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.033614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6856931a-754e-48b0-be88-38fc6dbbdc6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:46.034367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6856931a-754e-48b0-be88-38fc6dbbdc6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.034805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6856931a-754e-48b0-be88-38fc6dbbdc6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:46.099953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6856931a-754e-48b0-be88-38fc6dbbdc6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:46.108778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6856931a-754e-48b0-be88-38fc6dbbdc6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:46.110264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6856931a-754e-48b0-be88-38fc6dbbdc6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:46.111397 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6856931a-754e-48b0-be88-38fc6dbbdc6f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089959 Jul 14 16:08:46.111986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1188/2273] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:46 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:46.272205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-838682da-80fa-4595-979e-714ea918ea8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:46.272892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-838682da-80fa-4595-979e-714ea918ea8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:46.279076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-838682da-80fa-4595-979e-714ea918ea8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.279520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-838682da-80fa-4595-979e-714ea918ea8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:46.280445 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-838682da-80fa-4595-979e-714ea918ea8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:46.280887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-838682da-80fa-4595-979e-714ea918ea8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:46.409252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-838682da-80fa-4595-979e-714ea918ea8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:46.417442 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-838682da-80fa-4595-979e-714ea918ea8b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.149551 Jul 14 16:08:46.418005 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1086/2274] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:46 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:47.129608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-22681c80-9564-46e9-9d3c-bb21079ae85e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:47.130243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-22681c80-9564-46e9-9d3c-bb21079ae85e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:47.136774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22681c80-9564-46e9-9d3c-bb21079ae85e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:47.137976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22681c80-9564-46e9-9d3c-bb21079ae85e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.138793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22681c80-9564-46e9-9d3c-bb21079ae85e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:47.139321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-22681c80-9564-46e9-9d3c-bb21079ae85e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.204911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-22681c80-9564-46e9-9d3c-bb21079ae85e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:47.213176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-22681c80-9564-46e9-9d3c-bb21079ae85e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:47.214651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-22681c80-9564-46e9-9d3c-bb21079ae85e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:47.215962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-22681c80-9564-46e9-9d3c-bb21079ae85e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090203 Jul 14 16:08:47.216521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1189/2275] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:47 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:47.434937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-59877327-974f-4ba5-af2b-6ac4099ff691 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:47.435574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-59877327-974f-4ba5-af2b-6ac4099ff691 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:47.442144 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-59877327-974f-4ba5-af2b-6ac4099ff691 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:47.442599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-59877327-974f-4ba5-af2b-6ac4099ff691 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.443359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-59877327-974f-4ba5-af2b-6ac4099ff691 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:47.443834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-59877327-974f-4ba5-af2b-6ac4099ff691 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:47.461451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:47.577263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-59877327-974f-4ba5-af2b-6ac4099ff691 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:47.585169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-59877327-974f-4ba5-af2b-6ac4099ff691 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154721 Jul 14 16:08:47.585739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1087/2276] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:47 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:48.233796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-59263b9a-c71e-4cc1-855b-1867c240bb13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:48.234468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-59263b9a-c71e-4cc1-855b-1867c240bb13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:48.240969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59263b9a-c71e-4cc1-855b-1867c240bb13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.241423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59263b9a-c71e-4cc1-855b-1867c240bb13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:48.242182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59263b9a-c71e-4cc1-855b-1867c240bb13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.242626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59263b9a-c71e-4cc1-855b-1867c240bb13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:48.304880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-59263b9a-c71e-4cc1-855b-1867c240bb13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:48.313331 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-59263b9a-c71e-4cc1-855b-1867c240bb13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:48.314838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-59263b9a-c71e-4cc1-855b-1867c240bb13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:48.316022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-59263b9a-c71e-4cc1-855b-1867c240bb13 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086220 Jul 14 16:08:48.316583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1190/2277] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:48 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:48.603233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fefcc671-1981-4940-9c7e-e97a79325905 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:48.603817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fefcc671-1981-4940-9c7e-e97a79325905 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:48.610414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fefcc671-1981-4940-9c7e-e97a79325905 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.610870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fefcc671-1981-4940-9c7e-e97a79325905 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:48.611665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fefcc671-1981-4940-9c7e-e97a79325905 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:48.612109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fefcc671-1981-4940-9c7e-e97a79325905 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:48.745709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fefcc671-1981-4940-9c7e-e97a79325905 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:48.754121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fefcc671-1981-4940-9c7e-e97a79325905 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154841 Jul 14 16:08:48.754686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1088/2278] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:48 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:49.334415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9dadb37e-d0eb-4b2f-9db2-167ca9fad025 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:49.334969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9dadb37e-d0eb-4b2f-9db2-167ca9fad025 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:49.342018 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9dadb37e-d0eb-4b2f-9db2-167ca9fad025 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.342459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9dadb37e-d0eb-4b2f-9db2-167ca9fad025 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.343206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9dadb37e-d0eb-4b2f-9db2-167ca9fad025 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.343659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9dadb37e-d0eb-4b2f-9db2-167ca9fad025 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.406670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9dadb37e-d0eb-4b2f-9db2-167ca9fad025 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:49.414995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9dadb37e-d0eb-4b2f-9db2-167ca9fad025 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:49.416809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9dadb37e-d0eb-4b2f-9db2-167ca9fad025 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:49.417950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9dadb37e-d0eb-4b2f-9db2-167ca9fad025 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087509 Jul 14 16:08:49.419271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1191/2279] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:49 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:49.771317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-aa6e3e31-ebc8-4f39-9f0d-5f6b8d11a25a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:49.771976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-aa6e3e31-ebc8-4f39-9f0d-5f6b8d11a25a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:49.779466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aa6e3e31-ebc8-4f39-9f0d-5f6b8d11a25a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.780040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aa6e3e31-ebc8-4f39-9f0d-5f6b8d11a25a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.780813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aa6e3e31-ebc8-4f39-9f0d-5f6b8d11a25a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:49.781256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aa6e3e31-ebc8-4f39-9f0d-5f6b8d11a25a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:49.917145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aa6e3e31-ebc8-4f39-9f0d-5f6b8d11a25a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:49.925101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-aa6e3e31-ebc8-4f39-9f0d-5f6b8d11a25a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157654 Jul 14 16:08:49.925659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1089/2280] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:49 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:50.436956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-70b96070-909a-4896-9cdb-864664159942 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:50.437569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-70b96070-909a-4896-9cdb-864664159942 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:50.444133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70b96070-909a-4896-9cdb-864664159942 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.444583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70b96070-909a-4896-9cdb-864664159942 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.445338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70b96070-909a-4896-9cdb-864664159942 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.445774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70b96070-909a-4896-9cdb-864664159942 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.510447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-70b96070-909a-4896-9cdb-864664159942 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:50.519768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-70b96070-909a-4896-9cdb-864664159942 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:50.521257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-70b96070-909a-4896-9cdb-864664159942 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:50.522423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-70b96070-909a-4896-9cdb-864664159942 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090030 Jul 14 16:08:50.522976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1192/2281] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:50 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:50.942824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7982a9ec-df92-406e-9cc2-ea28e45960f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:50.943438 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7982a9ec-df92-406e-9cc2-ea28e45960f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:50.950910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7982a9ec-df92-406e-9cc2-ea28e45960f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.951361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7982a9ec-df92-406e-9cc2-ea28e45960f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:50.952155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7982a9ec-df92-406e-9cc2-ea28e45960f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:50.952596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7982a9ec-df92-406e-9cc2-ea28e45960f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:51.086097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7982a9ec-df92-406e-9cc2-ea28e45960f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:51.094948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7982a9ec-df92-406e-9cc2-ea28e45960f5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155849 Jul 14 16:08:51.095585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1090/2282] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:50 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:51.541290 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7dba819a-7727-4f4e-a690-58ea6a52262d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:51.542057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7dba819a-7727-4f4e-a690-58ea6a52262d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:51.549710 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7dba819a-7727-4f4e-a690-58ea6a52262d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:51.550166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7dba819a-7727-4f4e-a690-58ea6a52262d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:51.551002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7dba819a-7727-4f4e-a690-58ea6a52262d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:51.551509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7dba819a-7727-4f4e-a690-58ea6a52262d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:51.631692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7dba819a-7727-4f4e-a690-58ea6a52262d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:51.640572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7dba819a-7727-4f4e-a690-58ea6a52262d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:51.642068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7dba819a-7727-4f4e-a690-58ea6a52262d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:51.643227 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7dba819a-7727-4f4e-a690-58ea6a52262d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.106134 Jul 14 16:08:51.643819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1193/2283] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:51 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:52.112786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-254671ae-20da-4c69-929f-abe53e898593 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:52.113407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-254671ae-20da-4c69-929f-abe53e898593 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:52.119942 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-254671ae-20da-4c69-929f-abe53e898593 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:52.120401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-254671ae-20da-4c69-929f-abe53e898593 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:52.121244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-254671ae-20da-4c69-929f-abe53e898593 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:52.121693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-254671ae-20da-4c69-929f-abe53e898593 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:52.266546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-254671ae-20da-4c69-929f-abe53e898593 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:52.274672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-254671ae-20da-4c69-929f-abe53e898593 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.165770 Jul 14 16:08:52.275230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1091/2284] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:52 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:52.661921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bd5c4ac8-5619-476b-aa56-7f947f4a848e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:52.662473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bd5c4ac8-5619-476b-aa56-7f947f4a848e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:52.669372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd5c4ac8-5619-476b-aa56-7f947f4a848e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:52.669819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd5c4ac8-5619-476b-aa56-7f947f4a848e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:52.670583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd5c4ac8-5619-476b-aa56-7f947f4a848e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:52.671021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd5c4ac8-5619-476b-aa56-7f947f4a848e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:52.734429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd5c4ac8-5619-476b-aa56-7f947f4a848e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:52.742752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd5c4ac8-5619-476b-aa56-7f947f4a848e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:52.744264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd5c4ac8-5619-476b-aa56-7f947f4a848e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:52.745388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bd5c4ac8-5619-476b-aa56-7f947f4a848e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087535 Jul 14 16:08:52.745940 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1194/2285] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:52 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:08:53.292011 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-82f416b3-0934-4ba1-8e49-4ea3d58f2e51 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:53.292552 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-82f416b3-0934-4ba1-8e49-4ea3d58f2e51 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:53.299619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82f416b3-0934-4ba1-8e49-4ea3d58f2e51 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:53.300123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82f416b3-0934-4ba1-8e49-4ea3d58f2e51 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:53.300891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82f416b3-0934-4ba1-8e49-4ea3d58f2e51 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:53.301338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-82f416b3-0934-4ba1-8e49-4ea3d58f2e51 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:53.430363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-82f416b3-0934-4ba1-8e49-4ea3d58f2e51 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:53.438824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-82f416b3-0934-4ba1-8e49-4ea3d58f2e51 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151075 Jul 14 16:08:53.439388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1092/2286] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:53 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:53.763701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b5f42b21-834e-4e24-b378-97581fd67a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:53.764315 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b5f42b21-834e-4e24-b378-97581fd67a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:53.770959 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b5f42b21-834e-4e24-b378-97581fd67a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:53.771402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b5f42b21-834e-4e24-b378-97581fd67a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:53.772188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b5f42b21-834e-4e24-b378-97581fd67a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:53.772615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b5f42b21-834e-4e24-b378-97581fd67a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:53.843290 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b5f42b21-834e-4e24-b378-97581fd67a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:53.846655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:08:53.852692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b5f42b21-834e-4e24-b378-97581fd67a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:53.854209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b5f42b21-834e-4e24-b378-97581fd67a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:53.855434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b5f42b21-834e-4e24-b378-97581fd67a75 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.095696 Jul 14 16:08:53.856808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1195/2287] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:53 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:54.456279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6c3f17f5-b911-40a9-a71b-b93a2daa2036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:54.456898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6c3f17f5-b911-40a9-a71b-b93a2daa2036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:54.463500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c3f17f5-b911-40a9-a71b-b93a2daa2036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:54.463981 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c3f17f5-b911-40a9-a71b-b93a2daa2036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:54.464736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c3f17f5-b911-40a9-a71b-b93a2daa2036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:54.465281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c3f17f5-b911-40a9-a71b-b93a2daa2036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:54.596081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6c3f17f5-b911-40a9-a71b-b93a2daa2036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:54.604204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6c3f17f5-b911-40a9-a71b-b93a2daa2036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151748 Jul 14 16:08:54.604776 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1093/2288] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:54 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:54.875536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-03e135d6-2d98-418b-8a48-9b4146e50bc5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:54.876174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-03e135d6-2d98-418b-8a48-9b4146e50bc5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:54.882545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03e135d6-2d98-418b-8a48-9b4146e50bc5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:54.882995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03e135d6-2d98-418b-8a48-9b4146e50bc5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:54.883778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03e135d6-2d98-418b-8a48-9b4146e50bc5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:54.884216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03e135d6-2d98-418b-8a48-9b4146e50bc5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:54.945875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-03e135d6-2d98-418b-8a48-9b4146e50bc5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:54.954372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-03e135d6-2d98-418b-8a48-9b4146e50bc5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:54.955877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-03e135d6-2d98-418b-8a48-9b4146e50bc5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:54.957005 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-03e135d6-2d98-418b-8a48-9b4146e50bc5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086799 Jul 14 16:08:54.957558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1196/2289] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:54 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:55.621968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5225932f-000b-405e-8f64-259c0101edca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:55.622649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5225932f-000b-405e-8f64-259c0101edca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:55.629120 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5225932f-000b-405e-8f64-259c0101edca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:55.629611 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5225932f-000b-405e-8f64-259c0101edca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:55.630363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5225932f-000b-405e-8f64-259c0101edca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:55.630797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5225932f-000b-405e-8f64-259c0101edca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:55.763780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5225932f-000b-405e-8f64-259c0101edca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:55.771604 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5225932f-000b-405e-8f64-259c0101edca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153784 Jul 14 16:08:55.772181 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1094/2290] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:55 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:55.974877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8fc46d35-1825-404f-9351-82b1ebf1355b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:55.975483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8fc46d35-1825-404f-9351-82b1ebf1355b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:55.982409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8fc46d35-1825-404f-9351-82b1ebf1355b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:55.982861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8fc46d35-1825-404f-9351-82b1ebf1355b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:55.983649 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8fc46d35-1825-404f-9351-82b1ebf1355b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:55.984177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8fc46d35-1825-404f-9351-82b1ebf1355b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:56.047019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8fc46d35-1825-404f-9351-82b1ebf1355b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:56.055391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8fc46d35-1825-404f-9351-82b1ebf1355b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:56.056924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8fc46d35-1825-404f-9351-82b1ebf1355b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:56.058071 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8fc46d35-1825-404f-9351-82b1ebf1355b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087047 Jul 14 16:08:56.059158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1197/2291] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:55 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:56.789327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2c8900a7-9a21-4f54-9a4f-6c7dc4794a36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:56.789869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2c8900a7-9a21-4f54-9a4f-6c7dc4794a36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:56.797430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2c8900a7-9a21-4f54-9a4f-6c7dc4794a36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:56.797878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2c8900a7-9a21-4f54-9a4f-6c7dc4794a36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:56.798638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2c8900a7-9a21-4f54-9a4f-6c7dc4794a36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:56.799082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2c8900a7-9a21-4f54-9a4f-6c7dc4794a36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:56.933348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2c8900a7-9a21-4f54-9a4f-6c7dc4794a36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:56.942035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2c8900a7-9a21-4f54-9a4f-6c7dc4794a36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156621 Jul 14 16:08:56.942608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1095/2292] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:56 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:57.077905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-74b06f53-b171-43e0-87a9-d5467f68d334 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:57.078426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-74b06f53-b171-43e0-87a9-d5467f68d334 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:57.085016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74b06f53-b171-43e0-87a9-d5467f68d334 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:57.085468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74b06f53-b171-43e0-87a9-d5467f68d334 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:57.086224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74b06f53-b171-43e0-87a9-d5467f68d334 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:57.086663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74b06f53-b171-43e0-87a9-d5467f68d334 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:57.147768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-74b06f53-b171-43e0-87a9-d5467f68d334 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:57.156889 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-74b06f53-b171-43e0-87a9-d5467f68d334 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:57.158378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-74b06f53-b171-43e0-87a9-d5467f68d334 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:57.159526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-74b06f53-b171-43e0-87a9-d5467f68d334 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086300 Jul 14 16:08:57.160118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1198/2293] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:57 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:57.960476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-094a4810-1d97-45bd-91f0-81efa5f31183 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:57.961111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-094a4810-1d97-45bd-91f0-81efa5f31183 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:57.967729 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-094a4810-1d97-45bd-91f0-81efa5f31183 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:57.968171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-094a4810-1d97-45bd-91f0-81efa5f31183 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:57.968920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-094a4810-1d97-45bd-91f0-81efa5f31183 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:57.969349 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-094a4810-1d97-45bd-91f0-81efa5f31183 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:58.101889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-094a4810-1d97-45bd-91f0-81efa5f31183 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:58.110506 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-094a4810-1d97-45bd-91f0-81efa5f31183 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153902 Jul 14 16:08:58.111079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1096/2294] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:57 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:58.177680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-36e7e99e-c904-4e6b-aa31-11fa7c44d7d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:58.178292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-36e7e99e-c904-4e6b-aa31-11fa7c44d7d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:58.184897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36e7e99e-c904-4e6b-aa31-11fa7c44d7d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:58.185349 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36e7e99e-c904-4e6b-aa31-11fa7c44d7d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:58.186129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36e7e99e-c904-4e6b-aa31-11fa7c44d7d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:58.186562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36e7e99e-c904-4e6b-aa31-11fa7c44d7d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:58.251769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-36e7e99e-c904-4e6b-aa31-11fa7c44d7d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:58.260136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-36e7e99e-c904-4e6b-aa31-11fa7c44d7d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:58.261630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-36e7e99e-c904-4e6b-aa31-11fa7c44d7d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:58.262838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-36e7e99e-c904-4e6b-aa31-11fa7c44d7d4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088983 Jul 14 16:08:58.263617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1199/2295] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:58 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:08:59.128687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a2268f22-282a-40e5-8734-ec79f5190929 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:59.129303 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a2268f22-282a-40e5-8734-ec79f5190929 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:59.135816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a2268f22-282a-40e5-8734-ec79f5190929 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:59.136271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a2268f22-282a-40e5-8734-ec79f5190929 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:59.137031 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a2268f22-282a-40e5-8734-ec79f5190929 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:59.137471 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a2268f22-282a-40e5-8734-ec79f5190929 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:59.277342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a2268f22-282a-40e5-8734-ec79f5190929 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:59.282034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7a7e6301-9c0e-405b-bb16-215be5b71764 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:08:59.282644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7a7e6301-9c0e-405b-bb16-215be5b71764 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:08:59.289790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a2268f22-282a-40e5-8734-ec79f5190929 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.164693 Jul 14 16:08:59.290679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1097/2296] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:08:59 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:08:59.293290 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a7e6301-9c0e-405b-bb16-215be5b71764 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:59.294032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a7e6301-9c0e-405b-bb16-215be5b71764 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:59.295133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a7e6301-9c0e-405b-bb16-215be5b71764 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:08:59.295793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a7e6301-9c0e-405b-bb16-215be5b71764 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:08:59.362058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7a7e6301-9c0e-405b-bb16-215be5b71764 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:59.370306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7a7e6301-9c0e-405b-bb16-215be5b71764 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:59.371831 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7a7e6301-9c0e-405b-bb16-215be5b71764 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:08:59.372994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7a7e6301-9c0e-405b-bb16-215be5b71764 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.096061 Jul 14 16:08:59.373543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1200/2297] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:08:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:00.308842 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a221356e-f9c4-4ad5-a169-1a2853d7e540 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:00.309374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a221356e-f9c4-4ad5-a169-1a2853d7e540 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:00.316822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a221356e-f9c4-4ad5-a169-1a2853d7e540 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:00.317283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a221356e-f9c4-4ad5-a169-1a2853d7e540 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:00.318057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a221356e-f9c4-4ad5-a169-1a2853d7e540 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:00.318502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a221356e-f9c4-4ad5-a169-1a2853d7e540 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:00.393947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-324aca39-4c6c-4d5f-aa98-ac1f65188301 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:00.395381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-324aca39-4c6c-4d5f-aa98-ac1f65188301 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:00.402301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-324aca39-4c6c-4d5f-aa98-ac1f65188301 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:00.402848 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-324aca39-4c6c-4d5f-aa98-ac1f65188301 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:00.403803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-324aca39-4c6c-4d5f-aa98-ac1f65188301 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:00.404326 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-324aca39-4c6c-4d5f-aa98-ac1f65188301 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:00.464861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a221356e-f9c4-4ad5-a169-1a2853d7e540 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:00.469395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-324aca39-4c6c-4d5f-aa98-ac1f65188301 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:00.473316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a221356e-f9c4-4ad5-a169-1a2853d7e540 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.168387 Jul 14 16:09:00.474001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1098/2298] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:00 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:00.477912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-324aca39-4c6c-4d5f-aa98-ac1f65188301 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:00.479392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-324aca39-4c6c-4d5f-aa98-ac1f65188301 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:00.480548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-324aca39-4c6c-4d5f-aa98-ac1f65188301 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.093703 Jul 14 16:09:00.481092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1201/2299] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:00 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:01.233818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7da3b586-c6a4-4681-b766-d0daddddcdaa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:01.234323 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7da3b586-c6a4-4681-b766-d0daddddcdaa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:01.240415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7da3b586-c6a4-4681-b766-d0daddddcdaa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:01.240864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7da3b586-c6a4-4681-b766-d0daddddcdaa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:01.241625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7da3b586-c6a4-4681-b766-d0daddddcdaa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:01.242057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7da3b586-c6a4-4681-b766-d0daddddcdaa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:01.267961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7da3b586-c6a4-4681-b766-d0daddddcdaa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:09:01.359217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7da3b586-c6a4-4681-b766-d0daddddcdaa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 204 len: 0 microversion: 2.1 time: 0.130041 Jul 14 16:09:01.359884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1099/2300] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:09:01 2022] DELETE /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 0 bytes in 132 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:09:01.368219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-72f31fe2-6793-4cff-af56-bb8c9fd5c56a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:01.368823 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-72f31fe2-6793-4cff-af56-bb8c9fd5c56a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:01.376904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-72f31fe2-6793-4cff-af56-bb8c9fd5c56a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:01.377372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-72f31fe2-6793-4cff-af56-bb8c9fd5c56a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:01.378154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-72f31fe2-6793-4cff-af56-bb8c9fd5c56a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:01.378810 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-72f31fe2-6793-4cff-af56-bb8c9fd5c56a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:01.491548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6167b74a-9bae-44ab-a6a9-4836490b235c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:01.492273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6167b74a-9bae-44ab-a6a9-4836490b235c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:01.499289 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6167b74a-9bae-44ab-a6a9-4836490b235c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:01.499795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6167b74a-9bae-44ab-a6a9-4836490b235c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:01.500592 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6167b74a-9bae-44ab-a6a9-4836490b235c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:01.501024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6167b74a-9bae-44ab-a6a9-4836490b235c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:01.519031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-72f31fe2-6793-4cff-af56-bb8c9fd5c56a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:01.526959 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-72f31fe2-6793-4cff-af56-bb8c9fd5c56a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.162469 Jul 14 16:09:01.527533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1202/2301] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:01 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:01.532645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-efc6f739-f464-480f-981e-9f957c8aea89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:01.533253 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-efc6f739-f464-480f-981e-9f957c8aea89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:01.539589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-efc6f739-f464-480f-981e-9f957c8aea89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:01.540067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-efc6f739-f464-480f-981e-9f957c8aea89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:01.540817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-efc6f739-f464-480f-981e-9f957c8aea89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:01.541508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-efc6f739-f464-480f-981e-9f957c8aea89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:01.616054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-efc6f739-f464-480f-981e-9f957c8aea89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:01.625074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-efc6f739-f464-480f-981e-9f957c8aea89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:01.626577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-efc6f739-f464-480f-981e-9f957c8aea89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:01.627758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-efc6f739-f464-480f-981e-9f957c8aea89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.099272 Jul 14 16:09:01.628353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1203/2302] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:01 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:01.640210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6167b74a-9bae-44ab-a6a9-4836490b235c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:01.648200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6167b74a-9bae-44ab-a6a9-4836490b235c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160892 Jul 14 16:09:01.648760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1100/2303] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:01 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:02.545193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0f57766b-3d3e-4891-b470-9bf49a8d3252 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:02.545831 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0f57766b-3d3e-4891-b470-9bf49a8d3252 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:02.552504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f57766b-3d3e-4891-b470-9bf49a8d3252 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:02.552958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f57766b-3d3e-4891-b470-9bf49a8d3252 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:02.553741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f57766b-3d3e-4891-b470-9bf49a8d3252 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:02.554158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f57766b-3d3e-4891-b470-9bf49a8d3252 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:02.646186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-43d8950a-7a2f-40be-95a8-500c783079af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:02.646811 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-43d8950a-7a2f-40be-95a8-500c783079af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:02.653484 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43d8950a-7a2f-40be-95a8-500c783079af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:02.653944 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43d8950a-7a2f-40be-95a8-500c783079af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:02.654813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43d8950a-7a2f-40be-95a8-500c783079af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:02.655258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43d8950a-7a2f-40be-95a8-500c783079af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:02.692226 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0f57766b-3d3e-4891-b470-9bf49a8d3252 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:02.701029 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0f57766b-3d3e-4891-b470-9bf49a8d3252 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.159278 Jul 14 16:09:02.701822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1204/2304] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:02 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:02.706617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-55628eb7-21d1-4bdb-a12a-53447af6e0e2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:02.707303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-55628eb7-21d1-4bdb-a12a-53447af6e0e2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:02.713447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-55628eb7-21d1-4bdb-a12a-53447af6e0e2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:02.713986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-55628eb7-21d1-4bdb-a12a-53447af6e0e2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:02.714880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-55628eb7-21d1-4bdb-a12a-53447af6e0e2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:02.715321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-55628eb7-21d1-4bdb-a12a-53447af6e0e2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:02.721056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-43d8950a-7a2f-40be-95a8-500c783079af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:02.729562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-43d8950a-7a2f-40be-95a8-500c783079af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:02.731150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-43d8950a-7a2f-40be-95a8-500c783079af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:02.732487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-43d8950a-7a2f-40be-95a8-500c783079af tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090153 Jul 14 16:09:02.733141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1101/2305] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:02.848502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-55628eb7-21d1-4bdb-a12a-53447af6e0e2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:02.857237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-55628eb7-21d1-4bdb-a12a-53447af6e0e2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153762 Jul 14 16:09:02.858175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1205/2306] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:02 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:03.719331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3c540ddc-1103-4f64-b310-81daf89b91d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:03.719955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3c540ddc-1103-4f64-b310-81daf89b91d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:03.726454 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c540ddc-1103-4f64-b310-81daf89b91d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:03.726900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c540ddc-1103-4f64-b310-81daf89b91d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:03.727689 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c540ddc-1103-4f64-b310-81daf89b91d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:03.728156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c540ddc-1103-4f64-b310-81daf89b91d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:03.746536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:03.750880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2be1c96a-0944-4a76-9717-25f7da7b658c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:03.751535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2be1c96a-0944-4a76-9717-25f7da7b658c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:03.757993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2be1c96a-0944-4a76-9717-25f7da7b658c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:03.758446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2be1c96a-0944-4a76-9717-25f7da7b658c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:03.759209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2be1c96a-0944-4a76-9717-25f7da7b658c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:03.759677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2be1c96a-0944-4a76-9717-25f7da7b658c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:03.823670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2be1c96a-0944-4a76-9717-25f7da7b658c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:03.832890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2be1c96a-0944-4a76-9717-25f7da7b658c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:03.834400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2be1c96a-0944-4a76-9717-25f7da7b658c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:03.835551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2be1c96a-0944-4a76-9717-25f7da7b658c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089211 Jul 14 16:09:03.836151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1206/2307] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:03.868715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3c540ddc-1103-4f64-b310-81daf89b91d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:03.875123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-16b9d962-3a97-4de2-b192-6dfb9334be1a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:03.875777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-16b9d962-3a97-4de2-b192-6dfb9334be1a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:03.877610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3c540ddc-1103-4f64-b310-81daf89b91d5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.163172 Jul 14 16:09:03.878189 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1102/2308] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:03 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:03.881917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16b9d962-3a97-4de2-b192-6dfb9334be1a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:03.882365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16b9d962-3a97-4de2-b192-6dfb9334be1a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:03.883124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16b9d962-3a97-4de2-b192-6dfb9334be1a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:03.883563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16b9d962-3a97-4de2-b192-6dfb9334be1a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:04.022573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-16b9d962-3a97-4de2-b192-6dfb9334be1a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:04.030970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-16b9d962-3a97-4de2-b192-6dfb9334be1a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160643 Jul 14 16:09:04.031535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1207/2309] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:03 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:04.853935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3b2b6ac1-6d7c-456e-87bf-352626315136 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:04.854788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3b2b6ac1-6d7c-456e-87bf-352626315136 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:04.864266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b2b6ac1-6d7c-456e-87bf-352626315136 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:04.864714 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b2b6ac1-6d7c-456e-87bf-352626315136 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:04.865483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b2b6ac1-6d7c-456e-87bf-352626315136 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:04.866776 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b2b6ac1-6d7c-456e-87bf-352626315136 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:04.894347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d60ce5f5-ded6-4c67-808c-8cb9dca025c7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:04.894958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d60ce5f5-ded6-4c67-808c-8cb9dca025c7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:04.897324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=62 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:04.902981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d60ce5f5-ded6-4c67-808c-8cb9dca025c7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:04.903982 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d60ce5f5-ded6-4c67-808c-8cb9dca025c7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:04.904734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d60ce5f5-ded6-4c67-808c-8cb9dca025c7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:04.905170 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d60ce5f5-ded6-4c67-808c-8cb9dca025c7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:04.941108 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3b2b6ac1-6d7c-456e-87bf-352626315136 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:04.955004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3b2b6ac1-6d7c-456e-87bf-352626315136 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:04.956650 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3b2b6ac1-6d7c-456e-87bf-352626315136 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:04.957915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3b2b6ac1-6d7c-456e-87bf-352626315136 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.108318 Jul 14 16:09:04.958480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1103/2310] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:05.048177 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a69a873d-fb02-4fe9-80e4-a82111292510 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:05.048798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a69a873d-fb02-4fe9-80e4-a82111292510 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:05.055157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a69a873d-fb02-4fe9-80e4-a82111292510 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:05.055520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a69a873d-fb02-4fe9-80e4-a82111292510 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:05.056321 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a69a873d-fb02-4fe9-80e4-a82111292510 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:05.056763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a69a873d-fb02-4fe9-80e4-a82111292510 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:05.059446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d60ce5f5-ded6-4c67-808c-8cb9dca025c7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:05.068248 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d60ce5f5-ded6-4c67-808c-8cb9dca025c7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.177711 Jul 14 16:09:05.068829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1208/2311] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:04 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:05.197015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a69a873d-fb02-4fe9-80e4-a82111292510 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:05.206325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a69a873d-fb02-4fe9-80e4-a82111292510 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.162153 Jul 14 16:09:05.206897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1104/2312] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:05 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:05.976410 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5a9f84f6-1ac6-4f37-bd71-c366ee264b0c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:05.977024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5a9f84f6-1ac6-4f37-bd71-c366ee264b0c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:05.983922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a9f84f6-1ac6-4f37-bd71-c366ee264b0c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:05.984374 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a9f84f6-1ac6-4f37-bd71-c366ee264b0c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:05.985126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a9f84f6-1ac6-4f37-bd71-c366ee264b0c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:05.985559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a9f84f6-1ac6-4f37-bd71-c366ee264b0c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:06.048608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5a9f84f6-1ac6-4f37-bd71-c366ee264b0c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:06.056951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5a9f84f6-1ac6-4f37-bd71-c366ee264b0c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:06.058475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5a9f84f6-1ac6-4f37-bd71-c366ee264b0c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:06.059951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5a9f84f6-1ac6-4f37-bd71-c366ee264b0c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087165 Jul 14 16:09:06.060728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1209/2313] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:05 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:06.087032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0a9d727c-00ec-4ff2-b668-03e72ba84284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:06.087869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0a9d727c-00ec-4ff2-b668-03e72ba84284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:06.094841 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a9d727c-00ec-4ff2-b668-03e72ba84284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:06.095458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a9d727c-00ec-4ff2-b668-03e72ba84284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:06.096836 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a9d727c-00ec-4ff2-b668-03e72ba84284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:06.097554 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a9d727c-00ec-4ff2-b668-03e72ba84284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:06.224699 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-61ca06fb-a2ed-4d87-8adc-e4c50978f6c0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:06.225305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-61ca06fb-a2ed-4d87-8adc-e4c50978f6c0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:06.231141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61ca06fb-a2ed-4d87-8adc-e4c50978f6c0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:06.231741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61ca06fb-a2ed-4d87-8adc-e4c50978f6c0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:06.232607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61ca06fb-a2ed-4d87-8adc-e4c50978f6c0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:06.232931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-61ca06fb-a2ed-4d87-8adc-e4c50978f6c0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:06.244752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0a9d727c-00ec-4ff2-b668-03e72ba84284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:06.253374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0a9d727c-00ec-4ff2-b668-03e72ba84284 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.171220 Jul 14 16:09:06.253953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1105/2314] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:06 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:06.368416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-61ca06fb-a2ed-4d87-8adc-e4c50978f6c0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:06.376878 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-61ca06fb-a2ed-4d87-8adc-e4c50978f6c0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156347 Jul 14 16:09:06.377453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1210/2315] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:06 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:07.080225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4680f950-4d8d-454e-be2a-39a862a9a7ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:07.081023 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4680f950-4d8d-454e-be2a-39a862a9a7ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:07.087126 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4680f950-4d8d-454e-be2a-39a862a9a7ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:07.087726 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4680f950-4d8d-454e-be2a-39a862a9a7ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:07.088354 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4680f950-4d8d-454e-be2a-39a862a9a7ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:07.088794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4680f950-4d8d-454e-be2a-39a862a9a7ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:07.150849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4680f950-4d8d-454e-be2a-39a862a9a7ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:07.159853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4680f950-4d8d-454e-be2a-39a862a9a7ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:07.161346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4680f950-4d8d-454e-be2a-39a862a9a7ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:07.162481 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4680f950-4d8d-454e-be2a-39a862a9a7ce tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086874 Jul 14 16:09:07.163042 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1106/2316] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:07 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:07.272283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-59c66dc0-8d86-4e5a-b422-e90d3419e89e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:07.272805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-59c66dc0-8d86-4e5a-b422-e90d3419e89e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:07.279452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59c66dc0-8d86-4e5a-b422-e90d3419e89e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:07.280551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59c66dc0-8d86-4e5a-b422-e90d3419e89e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:07.281327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59c66dc0-8d86-4e5a-b422-e90d3419e89e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:07.281762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59c66dc0-8d86-4e5a-b422-e90d3419e89e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:07.394410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ca02743a-88b6-491e-9189-0735cfced697 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:07.395030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ca02743a-88b6-491e-9189-0735cfced697 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:07.400960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca02743a-88b6-491e-9189-0735cfced697 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:07.401403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca02743a-88b6-491e-9189-0735cfced697 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:07.402162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca02743a-88b6-491e-9189-0735cfced697 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:07.402593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca02743a-88b6-491e-9189-0735cfced697 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:07.415839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-59c66dc0-8d86-4e5a-b422-e90d3419e89e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:07.426927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-59c66dc0-8d86-4e5a-b422-e90d3419e89e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157874 Jul 14 16:09:07.428022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1211/2317] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:07 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:07.543104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ca02743a-88b6-491e-9189-0735cfced697 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:07.551532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ca02743a-88b6-491e-9189-0735cfced697 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.162161 Jul 14 16:09:07.552123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1107/2318] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:07 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:08.181285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0e11427a-c53d-4072-b795-e0bc68ea632d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:08.181987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0e11427a-c53d-4072-b795-e0bc68ea632d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:08.188413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e11427a-c53d-4072-b795-e0bc68ea632d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:08.188866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e11427a-c53d-4072-b795-e0bc68ea632d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:08.189621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e11427a-c53d-4072-b795-e0bc68ea632d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:08.190061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e11427a-c53d-4072-b795-e0bc68ea632d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:08.209106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:08.254230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0e11427a-c53d-4072-b795-e0bc68ea632d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:08.265384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0e11427a-c53d-4072-b795-e0bc68ea632d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:08.266931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0e11427a-c53d-4072-b795-e0bc68ea632d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:08.268132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0e11427a-c53d-4072-b795-e0bc68ea632d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090807 Jul 14 16:09:08.268711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1212/2319] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:08 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:08.446023 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-79113892-8038-41d5-8512-5fc782bd994c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:08.446644 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-79113892-8038-41d5-8512-5fc782bd994c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:08.453792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-79113892-8038-41d5-8512-5fc782bd994c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:08.454253 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-79113892-8038-41d5-8512-5fc782bd994c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:08.455020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-79113892-8038-41d5-8512-5fc782bd994c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:08.455461 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-79113892-8038-41d5-8512-5fc782bd994c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:08.568924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8bb4d490-d406-47d2-b06c-05008e5ddbe5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:08.569502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8bb4d490-d406-47d2-b06c-05008e5ddbe5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:08.576470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8bb4d490-d406-47d2-b06c-05008e5ddbe5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:08.576470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8bb4d490-d406-47d2-b06c-05008e5ddbe5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:08.577981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8bb4d490-d406-47d2-b06c-05008e5ddbe5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:08.578416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8bb4d490-d406-47d2-b06c-05008e5ddbe5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:08.589067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-79113892-8038-41d5-8512-5fc782bd994c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:08.597539 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-79113892-8038-41d5-8512-5fc782bd994c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155430 Jul 14 16:09:08.598204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1108/2320] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:08 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:08.709983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8bb4d490-d406-47d2-b06c-05008e5ddbe5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:08.717967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8bb4d490-d406-47d2-b06c-05008e5ddbe5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153085 Jul 14 16:09:08.718539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1213/2321] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:08 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:09.286745 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8900a159-1f5c-4dc4-9a7e-1a3d6370d6b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:09.287396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8900a159-1f5c-4dc4-9a7e-1a3d6370d6b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:09.294125 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8900a159-1f5c-4dc4-9a7e-1a3d6370d6b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:09.294567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8900a159-1f5c-4dc4-9a7e-1a3d6370d6b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:09.295322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8900a159-1f5c-4dc4-9a7e-1a3d6370d6b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:09.296538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8900a159-1f5c-4dc4-9a7e-1a3d6370d6b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:09.359622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8900a159-1f5c-4dc4-9a7e-1a3d6370d6b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:09.368277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8900a159-1f5c-4dc4-9a7e-1a3d6370d6b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:09.369857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8900a159-1f5c-4dc4-9a7e-1a3d6370d6b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:09.371005 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8900a159-1f5c-4dc4-9a7e-1a3d6370d6b0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088547 Jul 14 16:09:09.371566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1109/2322] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:09 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:09.615571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-49275c81-c9af-4797-810d-b2330df384a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:09.616245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-49275c81-c9af-4797-810d-b2330df384a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:09.622727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-49275c81-c9af-4797-810d-b2330df384a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:09.623178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-49275c81-c9af-4797-810d-b2330df384a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:09.624205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-49275c81-c9af-4797-810d-b2330df384a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:09.624659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-49275c81-c9af-4797-810d-b2330df384a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:09.734765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6fcf12c6-f5fc-4d8f-a296-c285f2fe54c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:09.735388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6fcf12c6-f5fc-4d8f-a296-c285f2fe54c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:09.742061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6fcf12c6-f5fc-4d8f-a296-c285f2fe54c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:09.742519 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6fcf12c6-f5fc-4d8f-a296-c285f2fe54c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:09.743291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6fcf12c6-f5fc-4d8f-a296-c285f2fe54c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:09.743770 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6fcf12c6-f5fc-4d8f-a296-c285f2fe54c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:09.761187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-49275c81-c9af-4797-810d-b2330df384a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:09.769124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-49275c81-c9af-4797-810d-b2330df384a5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157521 Jul 14 16:09:09.769694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1214/2323] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:09 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:09.877295 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6fcf12c6-f5fc-4d8f-a296-c285f2fe54c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:09.886140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6fcf12c6-f5fc-4d8f-a296-c285f2fe54c2 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155400 Jul 14 16:09:09.886720 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1110/2324] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:09 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:10.388498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cda9cfed-8610-4dd6-8944-2976628c05d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:10.389108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cda9cfed-8610-4dd6-8944-2976628c05d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:10.395912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cda9cfed-8610-4dd6-8944-2976628c05d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:10.396362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cda9cfed-8610-4dd6-8944-2976628c05d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:10.397121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cda9cfed-8610-4dd6-8944-2976628c05d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:10.397561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cda9cfed-8610-4dd6-8944-2976628c05d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:10.458938 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cda9cfed-8610-4dd6-8944-2976628c05d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:10.467349 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cda9cfed-8610-4dd6-8944-2976628c05d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:10.468863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cda9cfed-8610-4dd6-8944-2976628c05d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:10.469992 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cda9cfed-8610-4dd6-8944-2976628c05d7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.085555 Jul 14 16:09:10.470543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1215/2325] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:10 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:10.786950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-87d4d2a3-2b38-4262-addc-27746ea73365 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:10.787570 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-87d4d2a3-2b38-4262-addc-27746ea73365 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:10.794090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-87d4d2a3-2b38-4262-addc-27746ea73365 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:10.794565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-87d4d2a3-2b38-4262-addc-27746ea73365 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:10.795416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-87d4d2a3-2b38-4262-addc-27746ea73365 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:10.796468 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-87d4d2a3-2b38-4262-addc-27746ea73365 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:10.902339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-154c4878-f7c2-4674-9597-bf7219cb08f9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:10.902957 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-154c4878-f7c2-4674-9597-bf7219cb08f9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:10.910199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-154c4878-f7c2-4674-9597-bf7219cb08f9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:10.910654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-154c4878-f7c2-4674-9597-bf7219cb08f9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:10.911424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-154c4878-f7c2-4674-9597-bf7219cb08f9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:10.911886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-154c4878-f7c2-4674-9597-bf7219cb08f9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:10.931759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-87d4d2a3-2b38-4262-addc-27746ea73365 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:10.940666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-87d4d2a3-2b38-4262-addc-27746ea73365 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157572 Jul 14 16:09:10.941244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1111/2326] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:10 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:11.062048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-154c4878-f7c2-4674-9597-bf7219cb08f9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:11.070074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-154c4878-f7c2-4674-9597-bf7219cb08f9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.171675 Jul 14 16:09:11.070655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1216/2327] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:10 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:11.487677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-35b9ece8-3fa7-4460-a343-7316de9314de tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:11.488316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-35b9ece8-3fa7-4460-a343-7316de9314de tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:11.494356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35b9ece8-3fa7-4460-a343-7316de9314de tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:11.494805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35b9ece8-3fa7-4460-a343-7316de9314de tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:11.495559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35b9ece8-3fa7-4460-a343-7316de9314de tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:11.496019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-35b9ece8-3fa7-4460-a343-7316de9314de tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:11.558527 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-35b9ece8-3fa7-4460-a343-7316de9314de tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:11.567784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-35b9ece8-3fa7-4460-a343-7316de9314de tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:11.569279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-35b9ece8-3fa7-4460-a343-7316de9314de tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:11.570412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-35b9ece8-3fa7-4460-a343-7316de9314de tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086756 Jul 14 16:09:11.570979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1112/2328] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:11 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:11.614435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:09:11.614687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:09:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:09:11.958168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0b56bbf3-7dfc-4b9b-9195-3b7fa759cb80 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:11.958814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0b56bbf3-7dfc-4b9b-9195-3b7fa759cb80 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:11.965489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b56bbf3-7dfc-4b9b-9195-3b7fa759cb80 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:11.965901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b56bbf3-7dfc-4b9b-9195-3b7fa759cb80 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:11.966657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b56bbf3-7dfc-4b9b-9195-3b7fa759cb80 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:11.967090 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b56bbf3-7dfc-4b9b-9195-3b7fa759cb80 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:12.087793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fa905b39-8330-49c9-a6fc-33f1e629a5d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:12.088414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fa905b39-8330-49c9-a6fc-33f1e629a5d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:12.095462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa905b39-8330-49c9-a6fc-33f1e629a5d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:12.095981 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa905b39-8330-49c9-a6fc-33f1e629a5d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:12.096712 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa905b39-8330-49c9-a6fc-33f1e629a5d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:12.097154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fa905b39-8330-49c9-a6fc-33f1e629a5d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:12.098381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0b56bbf3-7dfc-4b9b-9195-3b7fa759cb80 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:12.106279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0b56bbf3-7dfc-4b9b-9195-3b7fa759cb80 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151945 Jul 14 16:09:12.106860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1217/2329] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:11 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:12.225450 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fa905b39-8330-49c9-a6fc-33f1e629a5d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:12.233668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fa905b39-8330-49c9-a6fc-33f1e629a5d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.149659 Jul 14 16:09:12.234501 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1113/2330] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:12 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:12.589595 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d0a3cd26-1a56-4059-9e77-2d0111ce1c1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:12.590122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d0a3cd26-1a56-4059-9e77-2d0111ce1c1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:12.597292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d0a3cd26-1a56-4059-9e77-2d0111ce1c1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:12.597739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d0a3cd26-1a56-4059-9e77-2d0111ce1c1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:12.598486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d0a3cd26-1a56-4059-9e77-2d0111ce1c1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:12.598919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d0a3cd26-1a56-4059-9e77-2d0111ce1c1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:12.661533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d0a3cd26-1a56-4059-9e77-2d0111ce1c1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:12.670597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d0a3cd26-1a56-4059-9e77-2d0111ce1c1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:12.672167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d0a3cd26-1a56-4059-9e77-2d0111ce1c1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:12.673306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d0a3cd26-1a56-4059-9e77-2d0111ce1c1e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087806 Jul 14 16:09:12.673857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1218/2331] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:12 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:13.125129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b3b9a622-b4bd-48df-92be-b265ed5c2e49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:13.125745 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b3b9a622-b4bd-48df-92be-b265ed5c2e49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:13.128072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=67,nova_api:UPDATE=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:13.133459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3b9a622-b4bd-48df-92be-b265ed5c2e49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:13.133912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3b9a622-b4bd-48df-92be-b265ed5c2e49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:13.134673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3b9a622-b4bd-48df-92be-b265ed5c2e49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:13.135110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b3b9a622-b4bd-48df-92be-b265ed5c2e49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:13.251452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bb80a026-7369-444e-9f10-9d78e4c8ef3c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:13.252027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bb80a026-7369-444e-9f10-9d78e4c8ef3c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:13.260647 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb80a026-7369-444e-9f10-9d78e4c8ef3c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:13.261462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb80a026-7369-444e-9f10-9d78e4c8ef3c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:13.262375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb80a026-7369-444e-9f10-9d78e4c8ef3c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:13.263023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bb80a026-7369-444e-9f10-9d78e4c8ef3c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:13.286584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b3b9a622-b4bd-48df-92be-b265ed5c2e49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:13.294782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b3b9a622-b4bd-48df-92be-b265ed5c2e49 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.174114 Jul 14 16:09:13.296359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1114/2332] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:13 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:13.419540 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bb80a026-7369-444e-9f10-9d78e4c8ef3c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:13.428047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bb80a026-7369-444e-9f10-9d78e4c8ef3c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.181518 Jul 14 16:09:13.428621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1219/2333] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:13 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:13.693424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-51017a0e-6811-4e85-bbcd-5a3a5d70ef5e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:13.693765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-51017a0e-6811-4e85-bbcd-5a3a5d70ef5e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:13.699802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-51017a0e-6811-4e85-bbcd-5a3a5d70ef5e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:13.700257 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-51017a0e-6811-4e85-bbcd-5a3a5d70ef5e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:13.701020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-51017a0e-6811-4e85-bbcd-5a3a5d70ef5e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:13.701463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-51017a0e-6811-4e85-bbcd-5a3a5d70ef5e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:13.771426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-51017a0e-6811-4e85-bbcd-5a3a5d70ef5e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:13.779811 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-51017a0e-6811-4e85-bbcd-5a3a5d70ef5e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:13.781920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-51017a0e-6811-4e85-bbcd-5a3a5d70ef5e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:13.783052 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-51017a0e-6811-4e85-bbcd-5a3a5d70ef5e tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.094948 Jul 14 16:09:13.783618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1115/2334] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:13 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:14.313505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8c8ab1a5-4ce4-4cc9-966b-7e2c9492f0fd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:14.314050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8c8ab1a5-4ce4-4cc9-966b-7e2c9492f0fd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:14.320505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8c8ab1a5-4ce4-4cc9-966b-7e2c9492f0fd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:14.320949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8c8ab1a5-4ce4-4cc9-966b-7e2c9492f0fd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:14.321690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8c8ab1a5-4ce4-4cc9-966b-7e2c9492f0fd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:14.322115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8c8ab1a5-4ce4-4cc9-966b-7e2c9492f0fd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:14.445245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fb9d1f27-7244-4dce-bcaa-00212bb5f94c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:14.445864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fb9d1f27-7244-4dce-bcaa-00212bb5f94c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:14.452928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8c8ab1a5-4ce4-4cc9-966b-7e2c9492f0fd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:14.453340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb9d1f27-7244-4dce-bcaa-00212bb5f94c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:14.453794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb9d1f27-7244-4dce-bcaa-00212bb5f94c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:14.454565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb9d1f27-7244-4dce-bcaa-00212bb5f94c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:14.455003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb9d1f27-7244-4dce-bcaa-00212bb5f94c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:14.460817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8c8ab1a5-4ce4-4cc9-966b-7e2c9492f0fd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151838 Jul 14 16:09:14.461378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1220/2335] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:14 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:14.588281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fb9d1f27-7244-4dce-bcaa-00212bb5f94c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:14.596845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fb9d1f27-7244-4dce-bcaa-00212bb5f94c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155576 Jul 14 16:09:14.597421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1116/2336] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:14 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:14.802672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-022fb0f3-2f9b-4bbd-8854-470f4944cf79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:14.804717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-022fb0f3-2f9b-4bbd-8854-470f4944cf79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:14.811212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-022fb0f3-2f9b-4bbd-8854-470f4944cf79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:14.811760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-022fb0f3-2f9b-4bbd-8854-470f4944cf79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:14.812530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-022fb0f3-2f9b-4bbd-8854-470f4944cf79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:14.812971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-022fb0f3-2f9b-4bbd-8854-470f4944cf79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:14.882996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-022fb0f3-2f9b-4bbd-8854-470f4944cf79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:14.892745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-022fb0f3-2f9b-4bbd-8854-470f4944cf79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:14.894232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-022fb0f3-2f9b-4bbd-8854-470f4944cf79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:14.895371 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-022fb0f3-2f9b-4bbd-8854-470f4944cf79 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.098157 Jul 14 16:09:14.895959 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1221/2337] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:14 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:15.477817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4e23d3e3-6e39-4500-a6df-557b1967cfcb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:15.478433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4e23d3e3-6e39-4500-a6df-557b1967cfcb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:15.486638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e23d3e3-6e39-4500-a6df-557b1967cfcb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:15.487107 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e23d3e3-6e39-4500-a6df-557b1967cfcb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:15.487911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e23d3e3-6e39-4500-a6df-557b1967cfcb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:15.488378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e23d3e3-6e39-4500-a6df-557b1967cfcb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:15.614444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1c8ef3ab-29b3-4de0-88c9-6a86c799d503 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:15.615082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1c8ef3ab-29b3-4de0-88c9-6a86c799d503 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:15.621443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1c8ef3ab-29b3-4de0-88c9-6a86c799d503 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:15.622058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1c8ef3ab-29b3-4de0-88c9-6a86c799d503 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:15.622839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1c8ef3ab-29b3-4de0-88c9-6a86c799d503 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:15.623271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1c8ef3ab-29b3-4de0-88c9-6a86c799d503 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:15.629871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4e23d3e3-6e39-4500-a6df-557b1967cfcb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:15.637659 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4e23d3e3-6e39-4500-a6df-557b1967cfcb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.163701 Jul 14 16:09:15.638232 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1117/2338] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:15 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:15.756262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1c8ef3ab-29b3-4de0-88c9-6a86c799d503 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:15.764244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1c8ef3ab-29b3-4de0-88c9-6a86c799d503 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153543 Jul 14 16:09:15.764774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1222/2339] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:15 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:15.916782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c06631f2-15bc-4240-b52e-1deedc386c4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:15.917451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c06631f2-15bc-4240-b52e-1deedc386c4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:15.926117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c06631f2-15bc-4240-b52e-1deedc386c4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:15.926564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c06631f2-15bc-4240-b52e-1deedc386c4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:15.927327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c06631f2-15bc-4240-b52e-1deedc386c4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:15.927802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c06631f2-15bc-4240-b52e-1deedc386c4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:15.994786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c06631f2-15bc-4240-b52e-1deedc386c4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:16.004417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c06631f2-15bc-4240-b52e-1deedc386c4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:16.005841 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c06631f2-15bc-4240-b52e-1deedc386c4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:16.006974 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c06631f2-15bc-4240-b52e-1deedc386c4d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.094825 Jul 14 16:09:16.007528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1118/2340] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:15 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:16.655403 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3cd0b109-c817-4c36-8fd5-4b449f743458 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:16.656034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3cd0b109-c817-4c36-8fd5-4b449f743458 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:16.662641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3cd0b109-c817-4c36-8fd5-4b449f743458 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:16.663089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3cd0b109-c817-4c36-8fd5-4b449f743458 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:16.663869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3cd0b109-c817-4c36-8fd5-4b449f743458 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:16.664305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3cd0b109-c817-4c36-8fd5-4b449f743458 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:16.782406 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8077bcaa-fcc3-4433-b497-96be5e839cda tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:16.783029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8077bcaa-fcc3-4433-b497-96be5e839cda tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:16.789492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8077bcaa-fcc3-4433-b497-96be5e839cda tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:16.789946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8077bcaa-fcc3-4433-b497-96be5e839cda tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:16.790707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8077bcaa-fcc3-4433-b497-96be5e839cda tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:16.791391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8077bcaa-fcc3-4433-b497-96be5e839cda tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:16.795415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:16.799965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3cd0b109-c817-4c36-8fd5-4b449f743458 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:16.808365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3cd0b109-c817-4c36-8fd5-4b449f743458 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.156879 Jul 14 16:09:16.808941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1223/2341] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:16 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:16.925333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8077bcaa-fcc3-4433-b497-96be5e839cda tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:16.933233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8077bcaa-fcc3-4433-b497-96be5e839cda tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155512 Jul 14 16:09:16.933801 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1119/2342] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:16 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:17.024487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3ce1a503-24c9-4049-9198-5ee6a2d04f83 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:17.025201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3ce1a503-24c9-4049-9198-5ee6a2d04f83 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:17.031888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ce1a503-24c9-4049-9198-5ee6a2d04f83 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:17.032331 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ce1a503-24c9-4049-9198-5ee6a2d04f83 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:17.033077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ce1a503-24c9-4049-9198-5ee6a2d04f83 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:17.033506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ce1a503-24c9-4049-9198-5ee6a2d04f83 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:17.102923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3ce1a503-24c9-4049-9198-5ee6a2d04f83 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:17.112460 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3ce1a503-24c9-4049-9198-5ee6a2d04f83 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:17.113987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3ce1a503-24c9-4049-9198-5ee6a2d04f83 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:17.115152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3ce1a503-24c9-4049-9198-5ee6a2d04f83 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.094591 Jul 14 16:09:17.115737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1224/2343] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:17 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:17.825707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2a84810c-e800-4bdb-8648-7d5ffccc7f9a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:17.826357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2a84810c-e800-4bdb-8648-7d5ffccc7f9a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:17.833432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a84810c-e800-4bdb-8648-7d5ffccc7f9a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:17.833891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a84810c-e800-4bdb-8648-7d5ffccc7f9a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:17.834668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a84810c-e800-4bdb-8648-7d5ffccc7f9a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:17.835131 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2a84810c-e800-4bdb-8648-7d5ffccc7f9a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:17.952750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-01374b31-d71d-4d1f-8e32-94f110c3a0fa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:17.953506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-01374b31-d71d-4d1f-8e32-94f110c3a0fa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:17.960270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-01374b31-d71d-4d1f-8e32-94f110c3a0fa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:17.960720 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-01374b31-d71d-4d1f-8e32-94f110c3a0fa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:17.961486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-01374b31-d71d-4d1f-8e32-94f110c3a0fa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:17.961914 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-01374b31-d71d-4d1f-8e32-94f110c3a0fa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:17.962798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2a84810c-e800-4bdb-8648-7d5ffccc7f9a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:17.972611 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2a84810c-e800-4bdb-8648-7d5ffccc7f9a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150733 Jul 14 16:09:17.973191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1120/2344] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:17 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:18.095301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-01374b31-d71d-4d1f-8e32-94f110c3a0fa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:18.103273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-01374b31-d71d-4d1f-8e32-94f110c3a0fa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154948 Jul 14 16:09:18.103956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1225/2345] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:17 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:18.134912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ff7ab4f1-6193-4e07-95f8-f9919093d50c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:18.135521 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ff7ab4f1-6193-4e07-95f8-f9919093d50c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:18.146219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ff7ab4f1-6193-4e07-95f8-f9919093d50c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:18.146693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ff7ab4f1-6193-4e07-95f8-f9919093d50c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:18.147464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ff7ab4f1-6193-4e07-95f8-f9919093d50c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:18.147933 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ff7ab4f1-6193-4e07-95f8-f9919093d50c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:18.222177 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ff7ab4f1-6193-4e07-95f8-f9919093d50c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:18.230566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ff7ab4f1-6193-4e07-95f8-f9919093d50c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:18.232091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ff7ab4f1-6193-4e07-95f8-f9919093d50c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:18.233293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ff7ab4f1-6193-4e07-95f8-f9919093d50c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.103101 Jul 14 16:09:18.234226 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1121/2346] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:18 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:18.990918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-aeb897a0-1e9a-45ab-9ece-ae0f323106fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:18.991646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-aeb897a0-1e9a-45ab-9ece-ae0f323106fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:18.998209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aeb897a0-1e9a-45ab-9ece-ae0f323106fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:18.999362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aeb897a0-1e9a-45ab-9ece-ae0f323106fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:19.000191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aeb897a0-1e9a-45ab-9ece-ae0f323106fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:19.000637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aeb897a0-1e9a-45ab-9ece-ae0f323106fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:19.122365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-40b2c8d8-4831-4e76-8dfb-7d41227da11b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:19.122971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-40b2c8d8-4831-4e76-8dfb-7d41227da11b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:19.129778 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40b2c8d8-4831-4e76-8dfb-7d41227da11b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:19.130150 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40b2c8d8-4831-4e76-8dfb-7d41227da11b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:19.130918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40b2c8d8-4831-4e76-8dfb-7d41227da11b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:19.131359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40b2c8d8-4831-4e76-8dfb-7d41227da11b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:19.132161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-aeb897a0-1e9a-45ab-9ece-ae0f323106fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:19.140121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-aeb897a0-1e9a-45ab-9ece-ae0f323106fa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.153102 Jul 14 16:09:19.140706 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1226/2347] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:18 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:19.251087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b4cce5c1-c867-4ea9-afea-37d76efacef7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:19.251640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b4cce5c1-c867-4ea9-afea-37d76efacef7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:19.257693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4cce5c1-c867-4ea9-afea-37d76efacef7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:19.258138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4cce5c1-c867-4ea9-afea-37d76efacef7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:19.258896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4cce5c1-c867-4ea9-afea-37d76efacef7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:19.259325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4cce5c1-c867-4ea9-afea-37d76efacef7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:19.264955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-40b2c8d8-4831-4e76-8dfb-7d41227da11b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:19.272866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-40b2c8d8-4831-4e76-8dfb-7d41227da11b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154324 Jul 14 16:09:19.273627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1122/2348] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:19 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:19.322492 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b4cce5c1-c867-4ea9-afea-37d76efacef7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:19.331195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b4cce5c1-c867-4ea9-afea-37d76efacef7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:19.332736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b4cce5c1-c867-4ea9-afea-37d76efacef7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:19.333883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b4cce5c1-c867-4ea9-afea-37d76efacef7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086941 Jul 14 16:09:19.334447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1227/2349] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:19 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:20.158033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-80719cce-43e4-404e-8c57-1b319cda5a73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:20.158662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-80719cce-43e4-404e-8c57-1b319cda5a73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:20.166960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80719cce-43e4-404e-8c57-1b319cda5a73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:20.167411 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80719cce-43e4-404e-8c57-1b319cda5a73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:20.168209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80719cce-43e4-404e-8c57-1b319cda5a73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:20.168648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80719cce-43e4-404e-8c57-1b319cda5a73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:20.290804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ab1e4777-e3c5-47df-b5a4-b8f18e60413a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:20.291802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ab1e4777-e3c5-47df-b5a4-b8f18e60413a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:20.299694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ab1e4777-e3c5-47df-b5a4-b8f18e60413a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:20.300250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ab1e4777-e3c5-47df-b5a4-b8f18e60413a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:20.301095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ab1e4777-e3c5-47df-b5a4-b8f18e60413a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:20.301849 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ab1e4777-e3c5-47df-b5a4-b8f18e60413a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:20.324349 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-80719cce-43e4-404e-8c57-1b319cda5a73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:20.333934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-80719cce-43e4-404e-8c57-1b319cda5a73 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.179992 Jul 14 16:09:20.334655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1123/2350] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:20 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:20.353589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f51b05b5-aa6d-4ae7-a288-81c2bd377de8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:20.354200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f51b05b5-aa6d-4ae7-a288-81c2bd377de8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:20.364285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f51b05b5-aa6d-4ae7-a288-81c2bd377de8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:20.364765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f51b05b5-aa6d-4ae7-a288-81c2bd377de8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:20.365580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f51b05b5-aa6d-4ae7-a288-81c2bd377de8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:20.365992 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f51b05b5-aa6d-4ae7-a288-81c2bd377de8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:20.445787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f51b05b5-aa6d-4ae7-a288-81c2bd377de8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:20.457172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f51b05b5-aa6d-4ae7-a288-81c2bd377de8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:20.459932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f51b05b5-aa6d-4ae7-a288-81c2bd377de8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:20.461176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f51b05b5-aa6d-4ae7-a288-81c2bd377de8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.112271 Jul 14 16:09:20.462132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1124/2351] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:20 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:20.464980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ab1e4777-e3c5-47df-b5a4-b8f18e60413a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:20.475544 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ab1e4777-e3c5-47df-b5a4-b8f18e60413a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.189035 Jul 14 16:09:20.476152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1228/2352] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:20 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:21.352610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cd4953a7-bf14-4c1f-ade3-99e81a5395e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:21.353199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cd4953a7-bf14-4c1f-ade3-99e81a5395e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:21.362589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd4953a7-bf14-4c1f-ade3-99e81a5395e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:21.363308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd4953a7-bf14-4c1f-ade3-99e81a5395e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:21.364362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd4953a7-bf14-4c1f-ade3-99e81a5395e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:21.364845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cd4953a7-bf14-4c1f-ade3-99e81a5395e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:21.478954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4a178fcd-0f89-4e73-97e1-8864b7a829ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:21.479715 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4a178fcd-0f89-4e73-97e1-8864b7a829ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:21.487803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a178fcd-0f89-4e73-97e1-8864b7a829ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:21.488282 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a178fcd-0f89-4e73-97e1-8864b7a829ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:21.489160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a178fcd-0f89-4e73-97e1-8864b7a829ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:21.489597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a178fcd-0f89-4e73-97e1-8864b7a829ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:21.495070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:21.521832 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cd4953a7-bf14-4c1f-ade3-99e81a5395e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:21.530943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cd4953a7-bf14-4c1f-ade3-99e81a5395e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.182414 Jul 14 16:09:21.531750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1125/2353] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:21 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:21.546305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4de02041-ebae-4af6-aec4-9a7ead929161 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:21.547050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4de02041-ebae-4af6-aec4-9a7ead929161 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:21.553707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4de02041-ebae-4af6-aec4-9a7ead929161 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:21.554269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4de02041-ebae-4af6-aec4-9a7ead929161 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:21.555069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4de02041-ebae-4af6-aec4-9a7ead929161 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:21.555500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4de02041-ebae-4af6-aec4-9a7ead929161 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:21.563401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4a178fcd-0f89-4e73-97e1-8864b7a829ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:21.572034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4a178fcd-0f89-4e73-97e1-8864b7a829ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:21.573750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4a178fcd-0f89-4e73-97e1-8864b7a829ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:21.575124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4a178fcd-0f89-4e73-97e1-8864b7a829ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.099909 Jul 14 16:09:21.575742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1229/2354] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:21 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:21.722646 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4de02041-ebae-4af6-aec4-9a7ead929161 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:21.730239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4de02041-ebae-4af6-aec4-9a7ead929161 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.188891 Jul 14 16:09:21.730810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1126/2355] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:21 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:22.548550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c10dfda4-79a0-46bf-9c83-6a33a42af432 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:22.549168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c10dfda4-79a0-46bf-9c83-6a33a42af432 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:22.555807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c10dfda4-79a0-46bf-9c83-6a33a42af432 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:22.556264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c10dfda4-79a0-46bf-9c83-6a33a42af432 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:22.557058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c10dfda4-79a0-46bf-9c83-6a33a42af432 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:22.557497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c10dfda4-79a0-46bf-9c83-6a33a42af432 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:22.593991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9e828b39-b56e-4f68-9bf1-7874baa41188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:22.594605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9e828b39-b56e-4f68-9bf1-7874baa41188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:22.601436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e828b39-b56e-4f68-9bf1-7874baa41188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:22.601905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e828b39-b56e-4f68-9bf1-7874baa41188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:22.602853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e828b39-b56e-4f68-9bf1-7874baa41188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:22.603332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e828b39-b56e-4f68-9bf1-7874baa41188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:22.667844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9e828b39-b56e-4f68-9bf1-7874baa41188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:22.676600 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9e828b39-b56e-4f68-9bf1-7874baa41188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:22.678353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9e828b39-b56e-4f68-9bf1-7874baa41188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:22.679496 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9e828b39-b56e-4f68-9bf1-7874baa41188 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090037 Jul 14 16:09:22.680080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1127/2356] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:22 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:22.691126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c10dfda4-79a0-46bf-9c83-6a33a42af432 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:22.698979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c10dfda4-79a0-46bf-9c83-6a33a42af432 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154280 Jul 14 16:09:22.699539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1230/2357] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:22 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:22.748007 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f667cac4-3985-44f5-8812-07b0d68802c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:22.748616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f667cac4-3985-44f5-8812-07b0d68802c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:22.754614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f667cac4-3985-44f5-8812-07b0d68802c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:22.755058 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f667cac4-3985-44f5-8812-07b0d68802c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:22.755846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f667cac4-3985-44f5-8812-07b0d68802c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:22.756283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f667cac4-3985-44f5-8812-07b0d68802c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:22.891270 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f667cac4-3985-44f5-8812-07b0d68802c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:22.899701 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f667cac4-3985-44f5-8812-07b0d68802c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155481 Jul 14 16:09:22.900284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1128/2358] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:22 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:23.698006 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9b562af1-7141-4e67-90d7-9c088dc775cd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:23.699093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9b562af1-7141-4e67-90d7-9c088dc775cd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:23.706394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b562af1-7141-4e67-90d7-9c088dc775cd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:23.706847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b562af1-7141-4e67-90d7-9c088dc775cd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:23.707639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b562af1-7141-4e67-90d7-9c088dc775cd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:23.708086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b562af1-7141-4e67-90d7-9c088dc775cd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:23.716550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1918efd1-9ee1-4f54-93f4-99b7358986b4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:23.717740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1918efd1-9ee1-4f54-93f4-99b7358986b4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:23.724267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1918efd1-9ee1-4f54-93f4-99b7358986b4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:23.724723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1918efd1-9ee1-4f54-93f4-99b7358986b4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:23.725485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1918efd1-9ee1-4f54-93f4-99b7358986b4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:23.725924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1918efd1-9ee1-4f54-93f4-99b7358986b4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:23.778893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9b562af1-7141-4e67-90d7-9c088dc775cd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:23.788120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9b562af1-7141-4e67-90d7-9c088dc775cd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:23.789621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9b562af1-7141-4e67-90d7-9c088dc775cd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:23.790780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9b562af1-7141-4e67-90d7-9c088dc775cd tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.096748 Jul 14 16:09:23.791613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1231/2359] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:23 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:23.858402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1918efd1-9ee1-4f54-93f4-99b7358986b4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:23.866388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1918efd1-9ee1-4f54-93f4-99b7358986b4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.153852 Jul 14 16:09:23.866955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1129/2360] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:23 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:23.916816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-26201ccb-3d6f-4303-a4c6-367ab7db0f34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:23.917425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-26201ccb-3d6f-4303-a4c6-367ab7db0f34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:23.924352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26201ccb-3d6f-4303-a4c6-367ab7db0f34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:23.924799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26201ccb-3d6f-4303-a4c6-367ab7db0f34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:23.925546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26201ccb-3d6f-4303-a4c6-367ab7db0f34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:23.925978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-26201ccb-3d6f-4303-a4c6-367ab7db0f34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:24.053216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-26201ccb-3d6f-4303-a4c6-367ab7db0f34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:24.061909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-26201ccb-3d6f-4303-a4c6-367ab7db0f34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.148600 Jul 14 16:09:24.062481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1232/2361] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:23 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:24.810372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b839287d-bdfb-4f9b-bfaa-98fa59436782 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:24.810962 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b839287d-bdfb-4f9b-bfaa-98fa59436782 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:24.818053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b839287d-bdfb-4f9b-bfaa-98fa59436782 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:24.818499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b839287d-bdfb-4f9b-bfaa-98fa59436782 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:24.819245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b839287d-bdfb-4f9b-bfaa-98fa59436782 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:24.819703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b839287d-bdfb-4f9b-bfaa-98fa59436782 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:24.883226 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a94972b6-6b3a-4743-92e9-e4cce2eb9a93 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:24.883936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a94972b6-6b3a-4743-92e9-e4cce2eb9a93 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:24.884677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b839287d-bdfb-4f9b-bfaa-98fa59436782 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:24.891048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a94972b6-6b3a-4743-92e9-e4cce2eb9a93 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:24.891575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a94972b6-6b3a-4743-92e9-e4cce2eb9a93 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:24.892420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a94972b6-6b3a-4743-92e9-e4cce2eb9a93 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:24.892951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a94972b6-6b3a-4743-92e9-e4cce2eb9a93 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:24.894672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b839287d-bdfb-4f9b-bfaa-98fa59436782 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:24.896275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b839287d-bdfb-4f9b-bfaa-98fa59436782 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:24.897459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b839287d-bdfb-4f9b-bfaa-98fa59436782 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.091390 Jul 14 16:09:24.898029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1130/2362] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:24 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:25.027421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a94972b6-6b3a-4743-92e9-e4cce2eb9a93 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:25.036175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a94972b6-6b3a-4743-92e9-e4cce2eb9a93 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.156940 Jul 14 16:09:25.036736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1233/2363] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:24 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:25.079135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e86fa9d8-f4d1-4c62-9ca2-c66b4cac41de tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:25.079670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e86fa9d8-f4d1-4c62-9ca2-c66b4cac41de tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:25.085668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e86fa9d8-f4d1-4c62-9ca2-c66b4cac41de tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:25.086122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e86fa9d8-f4d1-4c62-9ca2-c66b4cac41de tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:25.086890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e86fa9d8-f4d1-4c62-9ca2-c66b4cac41de tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:25.087330 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e86fa9d8-f4d1-4c62-9ca2-c66b4cac41de tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:25.216279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e86fa9d8-f4d1-4c62-9ca2-c66b4cac41de tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:25.224680 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e86fa9d8-f4d1-4c62-9ca2-c66b4cac41de tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.150430 Jul 14 16:09:25.225251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1131/2364] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:25 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:25.917389 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-53caad21-0cb7-4c74-9261-9c8479762d49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:25.918000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-53caad21-0cb7-4c74-9261-9c8479762d49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:25.926945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-53caad21-0cb7-4c74-9261-9c8479762d49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:25.927671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-53caad21-0cb7-4c74-9261-9c8479762d49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:25.928868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-53caad21-0cb7-4c74-9261-9c8479762d49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:25.929525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-53caad21-0cb7-4c74-9261-9c8479762d49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:26.003385 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-53caad21-0cb7-4c74-9261-9c8479762d49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:26.011857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-53caad21-0cb7-4c74-9261-9c8479762d49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:26.013410 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-53caad21-0cb7-4c74-9261-9c8479762d49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:26.014717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-53caad21-0cb7-4c74-9261-9c8479762d49 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.101809 Jul 14 16:09:26.015275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1234/2365] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:25 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:26.054284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6bf55aae-1e6d-4a0d-9f18-7c182b22a3a8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:26.054912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6bf55aae-1e6d-4a0d-9f18-7c182b22a3a8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:26.061640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6bf55aae-1e6d-4a0d-9f18-7c182b22a3a8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:26.062101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6bf55aae-1e6d-4a0d-9f18-7c182b22a3a8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:26.062873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6bf55aae-1e6d-4a0d-9f18-7c182b22a3a8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:26.063318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6bf55aae-1e6d-4a0d-9f18-7c182b22a3a8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:26.190437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6bf55aae-1e6d-4a0d-9f18-7c182b22a3a8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:26.198298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6bf55aae-1e6d-4a0d-9f18-7c182b22a3a8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.147827 Jul 14 16:09:26.198862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1132/2366] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:26 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:26.242155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4a74521c-c332-4e47-8715-0fd14ea09b01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:26.242769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4a74521c-c332-4e47-8715-0fd14ea09b01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:26.249289 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a74521c-c332-4e47-8715-0fd14ea09b01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:26.249740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a74521c-c332-4e47-8715-0fd14ea09b01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:26.250495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a74521c-c332-4e47-8715-0fd14ea09b01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:26.250929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4a74521c-c332-4e47-8715-0fd14ea09b01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:26.385727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4a74521c-c332-4e47-8715-0fd14ea09b01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:26.394923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4a74521c-c332-4e47-8715-0fd14ea09b01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156580 Jul 14 16:09:26.395494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1235/2367] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:26 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:27.032739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7c477bf9-aab7-492f-ad18-5b2352eb3e0b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:27.033355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7c477bf9-aab7-492f-ad18-5b2352eb3e0b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:27.039363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c477bf9-aab7-492f-ad18-5b2352eb3e0b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:27.039852 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c477bf9-aab7-492f-ad18-5b2352eb3e0b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:27.040624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c477bf9-aab7-492f-ad18-5b2352eb3e0b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:27.041065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7c477bf9-aab7-492f-ad18-5b2352eb3e0b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:27.106602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7c477bf9-aab7-492f-ad18-5b2352eb3e0b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:27.116083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7c477bf9-aab7-492f-ad18-5b2352eb3e0b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:27.117580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7c477bf9-aab7-492f-ad18-5b2352eb3e0b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:27.118720 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7c477bf9-aab7-492f-ad18-5b2352eb3e0b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090129 Jul 14 16:09:27.119277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1133/2368] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:27 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:27.215675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-63948ed0-2d1e-456c-9e4f-f5a23606b958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:27.216290 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-63948ed0-2d1e-456c-9e4f-f5a23606b958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:27.223033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63948ed0-2d1e-456c-9e4f-f5a23606b958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:27.223484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63948ed0-2d1e-456c-9e4f-f5a23606b958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:27.224272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63948ed0-2d1e-456c-9e4f-f5a23606b958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:27.224715 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-63948ed0-2d1e-456c-9e4f-f5a23606b958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:27.357657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-63948ed0-2d1e-456c-9e4f-f5a23606b958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:27.366402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-63948ed0-2d1e-456c-9e4f-f5a23606b958 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154588 Jul 14 16:09:27.366970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1236/2369] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:27 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:27.412093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6c738b76-b8a7-4edb-bb46-7126b3bfd76a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:27.412714 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6c738b76-b8a7-4edb-bb46-7126b3bfd76a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:27.419012 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c738b76-b8a7-4edb-bb46-7126b3bfd76a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:27.419467 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c738b76-b8a7-4edb-bb46-7126b3bfd76a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:27.420999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c738b76-b8a7-4edb-bb46-7126b3bfd76a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:27.421503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c738b76-b8a7-4edb-bb46-7126b3bfd76a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:27.552930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6c738b76-b8a7-4edb-bb46-7126b3bfd76a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:27.560972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6c738b76-b8a7-4edb-bb46-7126b3bfd76a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152653 Jul 14 16:09:27.561471 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1134/2370] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:27 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:28.137485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8188ddd5-2aaa-4916-ba1b-5a6b6be41141 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:28.138092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8188ddd5-2aaa-4916-ba1b-5a6b6be41141 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:28.144223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8188ddd5-2aaa-4916-ba1b-5a6b6be41141 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:28.144663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8188ddd5-2aaa-4916-ba1b-5a6b6be41141 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:28.145401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8188ddd5-2aaa-4916-ba1b-5a6b6be41141 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:28.145830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8188ddd5-2aaa-4916-ba1b-5a6b6be41141 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:28.206882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8188ddd5-2aaa-4916-ba1b-5a6b6be41141 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:28.215152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8188ddd5-2aaa-4916-ba1b-5a6b6be41141 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:28.216674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8188ddd5-2aaa-4916-ba1b-5a6b6be41141 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:28.218349 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8188ddd5-2aaa-4916-ba1b-5a6b6be41141 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.084936 Jul 14 16:09:28.218898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1237/2371] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:28 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:28.383460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c51129b5-0735-4bf4-b910-03acad66ea82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:28.384049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c51129b5-0735-4bf4-b910-03acad66ea82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:28.390882 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c51129b5-0735-4bf4-b910-03acad66ea82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:28.391341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c51129b5-0735-4bf4-b910-03acad66ea82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:28.392144 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c51129b5-0735-4bf4-b910-03acad66ea82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:28.392590 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c51129b5-0735-4bf4-b910-03acad66ea82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:28.523810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c51129b5-0735-4bf4-b910-03acad66ea82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:28.527204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:28.533344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c51129b5-0735-4bf4-b910-03acad66ea82 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.153844 Jul 14 16:09:28.533921 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1135/2372] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:28 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:28.578585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-59703c05-363d-4363-a522-53cdd26174f1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:28.579194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-59703c05-363d-4363-a522-53cdd26174f1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:28.585817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59703c05-363d-4363-a522-53cdd26174f1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:28.586309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59703c05-363d-4363-a522-53cdd26174f1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:28.587034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59703c05-363d-4363-a522-53cdd26174f1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:28.587488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-59703c05-363d-4363-a522-53cdd26174f1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:28.720177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-59703c05-363d-4363-a522-53cdd26174f1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:28.728139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-59703c05-363d-4363-a522-53cdd26174f1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153990 Jul 14 16:09:28.728712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1238/2373] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:28 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:29.236737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c7416e0d-d7d4-404d-85ce-97fa5afd4ee0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:29.237346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c7416e0d-d7d4-404d-85ce-97fa5afd4ee0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:29.243515 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7416e0d-d7d4-404d-85ce-97fa5afd4ee0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:29.243996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7416e0d-d7d4-404d-85ce-97fa5afd4ee0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:29.244761 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7416e0d-d7d4-404d-85ce-97fa5afd4ee0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:29.245203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c7416e0d-d7d4-404d-85ce-97fa5afd4ee0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:29.310812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c7416e0d-d7d4-404d-85ce-97fa5afd4ee0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:29.319350 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c7416e0d-d7d4-404d-85ce-97fa5afd4ee0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:29.320886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c7416e0d-d7d4-404d-85ce-97fa5afd4ee0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:29.322028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c7416e0d-d7d4-404d-85ce-97fa5afd4ee0 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089964 Jul 14 16:09:29.322594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1136/2374] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:29 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:29.551164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-41c69519-d482-43c0-81f8-74bb3972eed5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:29.551875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-41c69519-d482-43c0-81f8-74bb3972eed5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:29.557902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-41c69519-d482-43c0-81f8-74bb3972eed5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:29.558421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-41c69519-d482-43c0-81f8-74bb3972eed5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:29.559119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-41c69519-d482-43c0-81f8-74bb3972eed5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:29.559557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-41c69519-d482-43c0-81f8-74bb3972eed5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:29.697175 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-41c69519-d482-43c0-81f8-74bb3972eed5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:29.705237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-41c69519-d482-43c0-81f8-74bb3972eed5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.158027 Jul 14 16:09:29.705798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1239/2375] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:29 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:29.745559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bf349d51-79de-45bd-87c4-a7ee00ddf16c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:29.746176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bf349d51-79de-45bd-87c4-a7ee00ddf16c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:29.752212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf349d51-79de-45bd-87c4-a7ee00ddf16c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:29.752671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf349d51-79de-45bd-87c4-a7ee00ddf16c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:29.753433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf349d51-79de-45bd-87c4-a7ee00ddf16c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:29.753881 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bf349d51-79de-45bd-87c4-a7ee00ddf16c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:29.881180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bf349d51-79de-45bd-87c4-a7ee00ddf16c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:29.889530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bf349d51-79de-45bd-87c4-a7ee00ddf16c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.147879 Jul 14 16:09:29.890122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1137/2376] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:29 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:30.340748 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a2ef080d-8382-4428-a169-a16319656823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:30.341344 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a2ef080d-8382-4428-a169-a16319656823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:30.349636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2ef080d-8382-4428-a169-a16319656823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:30.350299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2ef080d-8382-4428-a169-a16319656823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:30.351456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2ef080d-8382-4428-a169-a16319656823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:30.352155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a2ef080d-8382-4428-a169-a16319656823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:30.429134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a2ef080d-8382-4428-a169-a16319656823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:30.438529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a2ef080d-8382-4428-a169-a16319656823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:30.440073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a2ef080d-8382-4428-a169-a16319656823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:30.441219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a2ef080d-8382-4428-a169-a16319656823 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.104714 Jul 14 16:09:30.441779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1240/2377] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:30 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:30.723341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-af737533-6237-4a2f-8754-3e44ee1bd936 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:30.724555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-af737533-6237-4a2f-8754-3e44ee1bd936 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:30.733040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-af737533-6237-4a2f-8754-3e44ee1bd936 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:30.733509 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-af737533-6237-4a2f-8754-3e44ee1bd936 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:30.734275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-af737533-6237-4a2f-8754-3e44ee1bd936 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:30.734893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-af737533-6237-4a2f-8754-3e44ee1bd936 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:30.873823 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-af737533-6237-4a2f-8754-3e44ee1bd936 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:30.882346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-af737533-6237-4a2f-8754-3e44ee1bd936 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.163054 Jul 14 16:09:30.882912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1138/2378] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:30 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:30.906353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-50817933-b3a2-4880-9c24-fc3a07dd874b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:30.907401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-50817933-b3a2-4880-9c24-fc3a07dd874b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:30.913967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-50817933-b3a2-4880-9c24-fc3a07dd874b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:30.914417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-50817933-b3a2-4880-9c24-fc3a07dd874b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:30.915174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-50817933-b3a2-4880-9c24-fc3a07dd874b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:30.915628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-50817933-b3a2-4880-9c24-fc3a07dd874b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:31.047828 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-50817933-b3a2-4880-9c24-fc3a07dd874b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:31.055754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-50817933-b3a2-4880-9c24-fc3a07dd874b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153408 Jul 14 16:09:31.056328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1241/2379] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:30 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:31.458550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-507fde89-0619-4d95-8bca-13ee6e72d3a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:31.459154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-507fde89-0619-4d95-8bca-13ee6e72d3a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:31.465410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-507fde89-0619-4d95-8bca-13ee6e72d3a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:31.465860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-507fde89-0619-4d95-8bca-13ee6e72d3a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:31.466626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-507fde89-0619-4d95-8bca-13ee6e72d3a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:31.467147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-507fde89-0619-4d95-8bca-13ee6e72d3a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:31.533334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-507fde89-0619-4d95-8bca-13ee6e72d3a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:31.541866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-507fde89-0619-4d95-8bca-13ee6e72d3a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:31.543343 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-507fde89-0619-4d95-8bca-13ee6e72d3a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:31.544550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-507fde89-0619-4d95-8bca-13ee6e72d3a8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090088 Jul 14 16:09:31.545665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1139/2380] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:31 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:31.900430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d285b476-667f-4041-a2c9-baae40c33c75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:31.901055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d285b476-667f-4041-a2c9-baae40c33c75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:31.908184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d285b476-667f-4041-a2c9-baae40c33c75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:31.908803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d285b476-667f-4041-a2c9-baae40c33c75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:31.909395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d285b476-667f-4041-a2c9-baae40c33c75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:31.909838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d285b476-667f-4041-a2c9-baae40c33c75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:32.043519 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d285b476-667f-4041-a2c9-baae40c33c75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:32.052233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d285b476-667f-4041-a2c9-baae40c33c75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155757 Jul 14 16:09:32.052801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1242/2381] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:31 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:32.077349 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8a479865-07fa-458c-a9c3-8aa1821768c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:32.077968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8a479865-07fa-458c-a9c3-8aa1821768c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:32.084596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a479865-07fa-458c-a9c3-8aa1821768c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:32.085050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a479865-07fa-458c-a9c3-8aa1821768c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:32.085820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a479865-07fa-458c-a9c3-8aa1821768c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:32.086262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a479865-07fa-458c-a9c3-8aa1821768c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:32.220924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8a479865-07fa-458c-a9c3-8aa1821768c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:32.228887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8a479865-07fa-458c-a9c3-8aa1821768c1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155563 Jul 14 16:09:32.229446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1140/2382] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:32 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:32.563989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6ae07cc2-91a5-4fcc-b9d0-f868f6a2a88c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:32.564600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6ae07cc2-91a5-4fcc-b9d0-f868f6a2a88c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:32.571183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6ae07cc2-91a5-4fcc-b9d0-f868f6a2a88c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:32.571661 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6ae07cc2-91a5-4fcc-b9d0-f868f6a2a88c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:32.572416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6ae07cc2-91a5-4fcc-b9d0-f868f6a2a88c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:32.572853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6ae07cc2-91a5-4fcc-b9d0-f868f6a2a88c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:32.634128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6ae07cc2-91a5-4fcc-b9d0-f868f6a2a88c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:32.643936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6ae07cc2-91a5-4fcc-b9d0-f868f6a2a88c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:32.645427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6ae07cc2-91a5-4fcc-b9d0-f868f6a2a88c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:32.646573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6ae07cc2-91a5-4fcc-b9d0-f868f6a2a88c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087195 Jul 14 16:09:32.647131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1243/2383] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:32 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:33.069796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cf91d5be-8d1e-424c-a2fc-d2f0e739218b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:33.070414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cf91d5be-8d1e-424c-a2fc-d2f0e739218b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:33.076651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf91d5be-8d1e-424c-a2fc-d2f0e739218b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:33.077102 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf91d5be-8d1e-424c-a2fc-d2f0e739218b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:33.077867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf91d5be-8d1e-424c-a2fc-d2f0e739218b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:33.078400 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cf91d5be-8d1e-424c-a2fc-d2f0e739218b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:33.205298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cf91d5be-8d1e-424c-a2fc-d2f0e739218b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:33.213396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cf91d5be-8d1e-424c-a2fc-d2f0e739218b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.147516 Jul 14 16:09:33.213969 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1141/2384] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:33 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:33.245819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-422971a6-a61b-4130-8617-8dda1ab3c123 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:33.246485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-422971a6-a61b-4130-8617-8dda1ab3c123 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:33.253807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-422971a6-a61b-4130-8617-8dda1ab3c123 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:33.254255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-422971a6-a61b-4130-8617-8dda1ab3c123 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:33.255003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-422971a6-a61b-4130-8617-8dda1ab3c123 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:33.255439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-422971a6-a61b-4130-8617-8dda1ab3c123 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:33.386424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-422971a6-a61b-4130-8617-8dda1ab3c123 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:33.394613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-422971a6-a61b-4130-8617-8dda1ab3c123 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152672 Jul 14 16:09:33.395184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1244/2385] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:33 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:33.664922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9e79efd8-4df0-45e3-905f-d3defb318e12 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:33.665540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9e79efd8-4df0-45e3-905f-d3defb318e12 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:33.672518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e79efd8-4df0-45e3-905f-d3defb318e12 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:33.672982 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e79efd8-4df0-45e3-905f-d3defb318e12 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:33.673759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e79efd8-4df0-45e3-905f-d3defb318e12 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:33.674201 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9e79efd8-4df0-45e3-905f-d3defb318e12 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:33.743843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9e79efd8-4df0-45e3-905f-d3defb318e12 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:33.752357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9e79efd8-4df0-45e3-905f-d3defb318e12 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:33.753830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9e79efd8-4df0-45e3-905f-d3defb318e12 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:33.754951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9e79efd8-4df0-45e3-905f-d3defb318e12 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.093991 Jul 14 16:09:33.755506 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1142/2386] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:33 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:34.230516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b1950322-18b8-4482-84a9-6d59527f1d7a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:34.231286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b1950322-18b8-4482-84a9-6d59527f1d7a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:34.237634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b1950322-18b8-4482-84a9-6d59527f1d7a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:34.238077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b1950322-18b8-4482-84a9-6d59527f1d7a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:34.238834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b1950322-18b8-4482-84a9-6d59527f1d7a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:34.239266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b1950322-18b8-4482-84a9-6d59527f1d7a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:34.369753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b1950322-18b8-4482-84a9-6d59527f1d7a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:34.373191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:34.379534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b1950322-18b8-4482-84a9-6d59527f1d7a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152922 Jul 14 16:09:34.380130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1245/2387] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:34 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:34.411321 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6ac58cbe-fac0-408b-a84b-717cc5b2fb9e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:34.411965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6ac58cbe-fac0-408b-a84b-717cc5b2fb9e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:34.418848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ac58cbe-fac0-408b-a84b-717cc5b2fb9e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:34.419293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ac58cbe-fac0-408b-a84b-717cc5b2fb9e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:34.420075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ac58cbe-fac0-408b-a84b-717cc5b2fb9e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:34.420507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ac58cbe-fac0-408b-a84b-717cc5b2fb9e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:34.552415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6ac58cbe-fac0-408b-a84b-717cc5b2fb9e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:34.560325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6ac58cbe-fac0-408b-a84b-717cc5b2fb9e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152769 Jul 14 16:09:34.560892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1143/2388] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:34 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:34.774277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-41403d9f-a193-4219-bdda-a464633fd838 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:34.774904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-41403d9f-a193-4219-bdda-a464633fd838 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:34.781576 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-41403d9f-a193-4219-bdda-a464633fd838 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:34.782100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-41403d9f-a193-4219-bdda-a464633fd838 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:34.782852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-41403d9f-a193-4219-bdda-a464633fd838 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:34.783282 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-41403d9f-a193-4219-bdda-a464633fd838 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:34.844688 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-41403d9f-a193-4219-bdda-a464633fd838 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:34.852980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-41403d9f-a193-4219-bdda-a464633fd838 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:34.854471 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-41403d9f-a193-4219-bdda-a464633fd838 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:34.855619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-41403d9f-a193-4219-bdda-a464633fd838 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.085453 Jul 14 16:09:34.856197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1246/2389] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:34 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:35.399261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1d2dda86-ed3d-422d-a4d0-ce0ba5206314 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:35.399985 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1d2dda86-ed3d-422d-a4d0-ce0ba5206314 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:35.406901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1d2dda86-ed3d-422d-a4d0-ce0ba5206314 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:35.407356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1d2dda86-ed3d-422d-a4d0-ce0ba5206314 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:35.408172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1d2dda86-ed3d-422d-a4d0-ce0ba5206314 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:35.408619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1d2dda86-ed3d-422d-a4d0-ce0ba5206314 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:35.539526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1d2dda86-ed3d-422d-a4d0-ce0ba5206314 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:35.548336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1d2dda86-ed3d-422d-a4d0-ce0ba5206314 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154517 Jul 14 16:09:35.548936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1144/2390] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:35 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:35.578756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-08189cf1-cc8b-488e-88cf-d5452a83cb83 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:35.579402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-08189cf1-cc8b-488e-88cf-d5452a83cb83 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:35.581751 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=78 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:35.587165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08189cf1-cc8b-488e-88cf-d5452a83cb83 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:35.587636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08189cf1-cc8b-488e-88cf-d5452a83cb83 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:35.588402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08189cf1-cc8b-488e-88cf-d5452a83cb83 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:35.588839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-08189cf1-cc8b-488e-88cf-d5452a83cb83 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:35.720812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-08189cf1-cc8b-488e-88cf-d5452a83cb83 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:35.728822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-08189cf1-cc8b-488e-88cf-d5452a83cb83 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154609 Jul 14 16:09:35.729401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1247/2391] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:35 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:35.874262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-da61127e-b29b-4952-861d-749f84b50667 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:35.874960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-da61127e-b29b-4952-861d-749f84b50667 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:35.880901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-da61127e-b29b-4952-861d-749f84b50667 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:35.881346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-da61127e-b29b-4952-861d-749f84b50667 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:35.882088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-da61127e-b29b-4952-861d-749f84b50667 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:35.882520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-da61127e-b29b-4952-861d-749f84b50667 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:35.947899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-da61127e-b29b-4952-861d-749f84b50667 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:35.957217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-da61127e-b29b-4952-861d-749f84b50667 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:35.958699 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-da61127e-b29b-4952-861d-749f84b50667 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:35.959860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-da61127e-b29b-4952-861d-749f84b50667 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089615 Jul 14 16:09:35.960408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1145/2392] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:35 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:36.566080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7461500a-0b64-4d47-bc62-965c840a67d9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:36.566755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7461500a-0b64-4d47-bc62-965c840a67d9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:36.572835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7461500a-0b64-4d47-bc62-965c840a67d9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:36.573288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7461500a-0b64-4d47-bc62-965c840a67d9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:36.574040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7461500a-0b64-4d47-bc62-965c840a67d9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:36.574484 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7461500a-0b64-4d47-bc62-965c840a67d9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:36.704576 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7461500a-0b64-4d47-bc62-965c840a67d9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:36.712546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7461500a-0b64-4d47-bc62-965c840a67d9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151152 Jul 14 16:09:36.713115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1248/2393] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:36 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:36.750732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7c49f85-e30b-45c6-b9fd-c860319f9d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:36.751333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d7c49f85-e30b-45c6-b9fd-c860319f9d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:36.757922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7c49f85-e30b-45c6-b9fd-c860319f9d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:36.758366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7c49f85-e30b-45c6-b9fd-c860319f9d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:36.759119 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7c49f85-e30b-45c6-b9fd-c860319f9d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:36.759552 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7c49f85-e30b-45c6-b9fd-c860319f9d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:36.889142 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d7c49f85-e30b-45c6-b9fd-c860319f9d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:36.897324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d7c49f85-e30b-45c6-b9fd-c860319f9d34 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151098 Jul 14 16:09:36.897897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1146/2394] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:36 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:36.977545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d7687fd2-d2c4-4e40-8533-b3cc72ceb13d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:36.978191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d7687fd2-d2c4-4e40-8533-b3cc72ceb13d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:36.984898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d7687fd2-d2c4-4e40-8533-b3cc72ceb13d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:36.985352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d7687fd2-d2c4-4e40-8533-b3cc72ceb13d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:36.986121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d7687fd2-d2c4-4e40-8533-b3cc72ceb13d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:36.986560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d7687fd2-d2c4-4e40-8533-b3cc72ceb13d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:37.052417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d7687fd2-d2c4-4e40-8533-b3cc72ceb13d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:37.060803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d7687fd2-d2c4-4e40-8533-b3cc72ceb13d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:37.062310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d7687fd2-d2c4-4e40-8533-b3cc72ceb13d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:37.063446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d7687fd2-d2c4-4e40-8533-b3cc72ceb13d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089859 Jul 14 16:09:37.064057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1249/2395] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:36 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:37.729568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-be138ec5-7813-45a9-b810-8433a530e8e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:37.730209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-be138ec5-7813-45a9-b810-8433a530e8e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:37.737082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-be138ec5-7813-45a9-b810-8433a530e8e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:37.737536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-be138ec5-7813-45a9-b810-8433a530e8e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:37.738299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-be138ec5-7813-45a9-b810-8433a530e8e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:37.738740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-be138ec5-7813-45a9-b810-8433a530e8e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:37.870563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-be138ec5-7813-45a9-b810-8433a530e8e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:37.878570 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-be138ec5-7813-45a9-b810-8433a530e8e4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152906 Jul 14 16:09:37.879141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1147/2396] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:37 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:37.914118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-95bae4b9-7100-40b5-82b7-e56a8ab9da4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:37.914731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-95bae4b9-7100-40b5-82b7-e56a8ab9da4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:37.922302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-95bae4b9-7100-40b5-82b7-e56a8ab9da4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:37.922752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-95bae4b9-7100-40b5-82b7-e56a8ab9da4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:37.923502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-95bae4b9-7100-40b5-82b7-e56a8ab9da4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:37.923964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-95bae4b9-7100-40b5-82b7-e56a8ab9da4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:38.053717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-95bae4b9-7100-40b5-82b7-e56a8ab9da4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:38.061650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-95bae4b9-7100-40b5-82b7-e56a8ab9da4e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151374 Jul 14 16:09:38.062756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1250/2397] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:37 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:38.085038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-55334ebe-cca6-4c88-8341-9bda0df581ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:38.086051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-55334ebe-cca6-4c88-8341-9bda0df581ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:38.095928 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55334ebe-cca6-4c88-8341-9bda0df581ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:38.096673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55334ebe-cca6-4c88-8341-9bda0df581ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:38.097963 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55334ebe-cca6-4c88-8341-9bda0df581ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:38.098705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55334ebe-cca6-4c88-8341-9bda0df581ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:38.163864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-55334ebe-cca6-4c88-8341-9bda0df581ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:38.174136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-55334ebe-cca6-4c88-8341-9bda0df581ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:38.175662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-55334ebe-cca6-4c88-8341-9bda0df581ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:38.176804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-55334ebe-cca6-4c88-8341-9bda0df581ae tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.099459 Jul 14 16:09:38.177358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1148/2398] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:38 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:38.896424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ff599af9-1754-4770-9b01-bb4b6c4501c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:38.897045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ff599af9-1754-4770-9b01-bb4b6c4501c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:38.903270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ff599af9-1754-4770-9b01-bb4b6c4501c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:38.903758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ff599af9-1754-4770-9b01-bb4b6c4501c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:38.904550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ff599af9-1754-4770-9b01-bb4b6c4501c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:38.904988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ff599af9-1754-4770-9b01-bb4b6c4501c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:39.033845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ff599af9-1754-4770-9b01-bb4b6c4501c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:39.042023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ff599af9-1754-4770-9b01-bb4b6c4501c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.149224 Jul 14 16:09:39.042586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1251/2399] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:38 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:39.080122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3c0e8741-4563-4af7-bab3-372509d382a3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:39.080743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3c0e8741-4563-4af7-bab3-372509d382a3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:39.087274 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c0e8741-4563-4af7-bab3-372509d382a3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:39.087771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c0e8741-4563-4af7-bab3-372509d382a3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:39.088540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c0e8741-4563-4af7-bab3-372509d382a3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:39.088983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c0e8741-4563-4af7-bab3-372509d382a3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:39.196159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-672afa3e-e0b6-434a-ac26-96b1098b09e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:39.196769 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-672afa3e-e0b6-434a-ac26-96b1098b09e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:39.203727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-672afa3e-e0b6-434a-ac26-96b1098b09e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:39.204166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-672afa3e-e0b6-434a-ac26-96b1098b09e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:39.204915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-672afa3e-e0b6-434a-ac26-96b1098b09e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:39.205341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-672afa3e-e0b6-434a-ac26-96b1098b09e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:39.228084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3c0e8741-4563-4af7-bab3-372509d382a3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:39.236002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3c0e8741-4563-4af7-bab3-372509d382a3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160469 Jul 14 16:09:39.236569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1149/2400] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:39 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:39.269550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-672afa3e-e0b6-434a-ac26-96b1098b09e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:39.278082 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-672afa3e-e0b6-434a-ac26-96b1098b09e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:39.279577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-672afa3e-e0b6-434a-ac26-96b1098b09e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:39.281258 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-672afa3e-e0b6-434a-ac26-96b1098b09e6 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.088645 Jul 14 16:09:39.281816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1252/2401] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:39 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:40.059880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-988510bf-7d3b-44eb-a03f-831ff752c375 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:40.060489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-988510bf-7d3b-44eb-a03f-831ff752c375 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:40.066561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-988510bf-7d3b-44eb-a03f-831ff752c375 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:40.067007 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-988510bf-7d3b-44eb-a03f-831ff752c375 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:40.067792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-988510bf-7d3b-44eb-a03f-831ff752c375 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:40.068228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-988510bf-7d3b-44eb-a03f-831ff752c375 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:40.199641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-988510bf-7d3b-44eb-a03f-831ff752c375 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:40.208006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-988510bf-7d3b-44eb-a03f-831ff752c375 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151972 Jul 14 16:09:40.208572 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1150/2402] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:40 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:40.253168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6a8c572d-e21d-4580-8e71-f1abbe8db9aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:40.253782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6a8c572d-e21d-4580-8e71-f1abbe8db9aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:40.260239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a8c572d-e21d-4580-8e71-f1abbe8db9aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:40.260680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a8c572d-e21d-4580-8e71-f1abbe8db9aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:40.261430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a8c572d-e21d-4580-8e71-f1abbe8db9aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:40.262038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6a8c572d-e21d-4580-8e71-f1abbe8db9aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:40.299204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0fa81dd8-8484-4fc6-9aee-f53427d353cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:40.299864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0fa81dd8-8484-4fc6-9aee-f53427d353cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:40.306528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0fa81dd8-8484-4fc6-9aee-f53427d353cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:40.306989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0fa81dd8-8484-4fc6-9aee-f53427d353cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:40.307883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0fa81dd8-8484-4fc6-9aee-f53427d353cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:40.308254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0fa81dd8-8484-4fc6-9aee-f53427d353cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:40.374965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0fa81dd8-8484-4fc6-9aee-f53427d353cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:40.383563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0fa81dd8-8484-4fc6-9aee-f53427d353cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:40.385080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0fa81dd8-8484-4fc6-9aee-f53427d353cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:40.386225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0fa81dd8-8484-4fc6-9aee-f53427d353cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.091672 Jul 14 16:09:40.386792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1151/2403] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:40 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:40.400314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6a8c572d-e21d-4580-8e71-f1abbe8db9aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:40.409169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6a8c572d-e21d-4580-8e71-f1abbe8db9aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.159992 Jul 14 16:09:40.409730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1253/2404] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:40 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:41.225804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cb44e4d8-587e-4d1d-a21f-5831994a7221 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:41.226399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cb44e4d8-587e-4d1d-a21f-5831994a7221 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:41.232763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb44e4d8-587e-4d1d-a21f-5831994a7221 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:41.233240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb44e4d8-587e-4d1d-a21f-5831994a7221 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:41.234627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb44e4d8-587e-4d1d-a21f-5831994a7221 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:41.235072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cb44e4d8-587e-4d1d-a21f-5831994a7221 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:41.253096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:41.364709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cb44e4d8-587e-4d1d-a21f-5831994a7221 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:41.373417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cb44e4d8-587e-4d1d-a21f-5831994a7221 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151689 Jul 14 16:09:41.374166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1152/2405] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:41 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:41.404373 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9b97b783-ee59-47cf-b4fb-af3b828ea27f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:41.404989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9b97b783-ee59-47cf-b4fb-af3b828ea27f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:41.412357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b97b783-ee59-47cf-b4fb-af3b828ea27f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:41.412809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b97b783-ee59-47cf-b4fb-af3b828ea27f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:41.413566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b97b783-ee59-47cf-b4fb-af3b828ea27f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:41.414006 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9b97b783-ee59-47cf-b4fb-af3b828ea27f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:41.426192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b83fc0d7-6d80-4515-897f-008ed03ac879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:41.426870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b83fc0d7-6d80-4515-897f-008ed03ac879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:41.432840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b83fc0d7-6d80-4515-897f-008ed03ac879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:41.433298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b83fc0d7-6d80-4515-897f-008ed03ac879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:41.434062 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b83fc0d7-6d80-4515-897f-008ed03ac879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:41.434507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b83fc0d7-6d80-4515-897f-008ed03ac879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:41.478660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9b97b783-ee59-47cf-b4fb-af3b828ea27f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:41.496633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9b97b783-ee59-47cf-b4fb-af3b828ea27f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:41.496633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9b97b783-ee59-47cf-b4fb-af3b828ea27f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:41.496633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9b97b783-ee59-47cf-b4fb-af3b828ea27f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.094813 Jul 14 16:09:41.497071 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1254/2406] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:41 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:41.569994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b83fc0d7-6d80-4515-897f-008ed03ac879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:41.578593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b83fc0d7-6d80-4515-897f-008ed03ac879 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156268 Jul 14 16:09:41.579180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1153/2407] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:41 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:42.391687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9e9653a5-83bf-45e4-8e01-fc282507b644 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:42.392308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9e9653a5-83bf-45e4-8e01-fc282507b644 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:42.398368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e9653a5-83bf-45e4-8e01-fc282507b644 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:42.398818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e9653a5-83bf-45e4-8e01-fc282507b644 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:42.399571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e9653a5-83bf-45e4-8e01-fc282507b644 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:42.400032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e9653a5-83bf-45e4-8e01-fc282507b644 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:42.513630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3f38e3d8-5222-43af-8cc6-69f4dc6c1d24 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:42.514315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3f38e3d8-5222-43af-8cc6-69f4dc6c1d24 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:42.521568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3f38e3d8-5222-43af-8cc6-69f4dc6c1d24 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:42.522020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3f38e3d8-5222-43af-8cc6-69f4dc6c1d24 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:42.522791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3f38e3d8-5222-43af-8cc6-69f4dc6c1d24 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:42.523229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3f38e3d8-5222-43af-8cc6-69f4dc6c1d24 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:42.529983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9e9653a5-83bf-45e4-8e01-fc282507b644 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:42.537998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9e9653a5-83bf-45e4-8e01-fc282507b644 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151164 Jul 14 16:09:42.538563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1255/2408] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:42 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:42.589464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3f38e3d8-5222-43af-8cc6-69f4dc6c1d24 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:42.595724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-17ba3f7c-2b88-4876-bd40-94666b5f7e37 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:42.596342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-17ba3f7c-2b88-4876-bd40-94666b5f7e37 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:42.598170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3f38e3d8-5222-43af-8cc6-69f4dc6c1d24 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:42.599701 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3f38e3d8-5222-43af-8cc6-69f4dc6c1d24 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:42.600858 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3f38e3d8-5222-43af-8cc6-69f4dc6c1d24 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.091183 Jul 14 16:09:42.601419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1154/2409] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:42 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:42.602377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-17ba3f7c-2b88-4876-bd40-94666b5f7e37 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:42.602828 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-17ba3f7c-2b88-4876-bd40-94666b5f7e37 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:42.603587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-17ba3f7c-2b88-4876-bd40-94666b5f7e37 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:42.604054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-17ba3f7c-2b88-4876-bd40-94666b5f7e37 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:42.741432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-17ba3f7c-2b88-4876-bd40-94666b5f7e37 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:42.750254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-17ba3f7c-2b88-4876-bd40-94666b5f7e37 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157612 Jul 14 16:09:42.750838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1256/2410] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:42 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:43.555758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7760f214-7905-4022-a1b5-29c598da1f71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:43.556421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7760f214-7905-4022-a1b5-29c598da1f71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:43.558749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=82 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:43.564601 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7760f214-7905-4022-a1b5-29c598da1f71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:43.565063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7760f214-7905-4022-a1b5-29c598da1f71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:43.565829 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7760f214-7905-4022-a1b5-29c598da1f71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:43.566273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7760f214-7905-4022-a1b5-29c598da1f71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:43.618822 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fc45b9c7-f171-461d-99b5-21df40cf4e90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:43.619418 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fc45b9c7-f171-461d-99b5-21df40cf4e90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:43.626250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fc45b9c7-f171-461d-99b5-21df40cf4e90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:43.626697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fc45b9c7-f171-461d-99b5-21df40cf4e90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:43.627459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fc45b9c7-f171-461d-99b5-21df40cf4e90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:43.627920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fc45b9c7-f171-461d-99b5-21df40cf4e90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:43.693275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fc45b9c7-f171-461d-99b5-21df40cf4e90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:43.701656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fc45b9c7-f171-461d-99b5-21df40cf4e90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:43.702750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7760f214-7905-4022-a1b5-29c598da1f71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:43.704410 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fc45b9c7-f171-461d-99b5-21df40cf4e90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:43.705693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fc45b9c7-f171-461d-99b5-21df40cf4e90 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090644 Jul 14 16:09:43.706336 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1257/2411] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:43 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:43.711494 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7760f214-7905-4022-a1b5-29c598da1f71 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.159591 Jul 14 16:09:43.712104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1155/2412] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:43 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:43.767005 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-96470e30-6de4-4c78-b102-100232692b24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:43.767650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-96470e30-6de4-4c78-b102-100232692b24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:43.773653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96470e30-6de4-4c78-b102-100232692b24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:43.774105 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96470e30-6de4-4c78-b102-100232692b24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:43.774858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96470e30-6de4-4c78-b102-100232692b24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:43.775298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-96470e30-6de4-4c78-b102-100232692b24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:43.911767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-96470e30-6de4-4c78-b102-100232692b24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:43.919853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-96470e30-6de4-4c78-b102-100232692b24 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156831 Jul 14 16:09:43.920413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1258/2413] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:43 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:44.723742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-32629656-ed2e-4a7e-a2da-3af105837e35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:44.724271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-32629656-ed2e-4a7e-a2da-3af105837e35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:44.728997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bdc059bf-747b-4aa4-813e-b730769b5b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:44.729615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bdc059bf-747b-4aa4-813e-b730769b5b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:44.730799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32629656-ed2e-4a7e-a2da-3af105837e35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:44.731262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32629656-ed2e-4a7e-a2da-3af105837e35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:44.732065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32629656-ed2e-4a7e-a2da-3af105837e35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:44.732507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-32629656-ed2e-4a7e-a2da-3af105837e35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:44.736632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bdc059bf-747b-4aa4-813e-b730769b5b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:44.737084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bdc059bf-747b-4aa4-813e-b730769b5b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:44.737850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bdc059bf-747b-4aa4-813e-b730769b5b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:44.738286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bdc059bf-747b-4aa4-813e-b730769b5b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:44.798705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-32629656-ed2e-4a7e-a2da-3af105837e35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:44.807617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-32629656-ed2e-4a7e-a2da-3af105837e35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:44.809132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-32629656-ed2e-4a7e-a2da-3af105837e35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:44.810281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-32629656-ed2e-4a7e-a2da-3af105837e35 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090593 Jul 14 16:09:44.811028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1156/2414] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:44 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:44.875804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bdc059bf-747b-4aa4-813e-b730769b5b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:44.884738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bdc059bf-747b-4aa4-813e-b730769b5b9d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.159496 Jul 14 16:09:44.885315 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1259/2415] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:44 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:44.938014 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ccccdba4-4f01-4974-93e3-a8afaf0916aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:44.938619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ccccdba4-4f01-4974-93e3-a8afaf0916aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:44.944649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ccccdba4-4f01-4974-93e3-a8afaf0916aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:44.945097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ccccdba4-4f01-4974-93e3-a8afaf0916aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:44.945842 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ccccdba4-4f01-4974-93e3-a8afaf0916aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:44.946270 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ccccdba4-4f01-4974-93e3-a8afaf0916aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:45.084568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ccccdba4-4f01-4974-93e3-a8afaf0916aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:45.092518 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ccccdba4-4f01-4974-93e3-a8afaf0916aa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158720 Jul 14 16:09:45.093687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1157/2416] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:44 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:45.827953 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-84c99971-86eb-42a4-9b8e-f43934ec14e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:45.828565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-84c99971-86eb-42a4-9b8e-f43934ec14e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:45.835104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84c99971-86eb-42a4-9b8e-f43934ec14e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:45.835556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84c99971-86eb-42a4-9b8e-f43934ec14e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:45.836348 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84c99971-86eb-42a4-9b8e-f43934ec14e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:45.836789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84c99971-86eb-42a4-9b8e-f43934ec14e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:45.902426 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b365da83-d22c-4dd3-945a-58456c063fb6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:45.902911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b365da83-d22c-4dd3-945a-58456c063fb6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:45.904272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-84c99971-86eb-42a4-9b8e-f43934ec14e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:45.910097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b365da83-d22c-4dd3-945a-58456c063fb6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:45.910578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b365da83-d22c-4dd3-945a-58456c063fb6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:45.911354 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b365da83-d22c-4dd3-945a-58456c063fb6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:45.911830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b365da83-d22c-4dd3-945a-58456c063fb6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:45.912906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-84c99971-86eb-42a4-9b8e-f43934ec14e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:45.914404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-84c99971-86eb-42a4-9b8e-f43934ec14e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:45.915556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-84c99971-86eb-42a4-9b8e-f43934ec14e7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.091652 Jul 14 16:09:45.916143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1260/2417] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:45 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:46.045767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b365da83-d22c-4dd3-945a-58456c063fb6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:46.054312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b365da83-d22c-4dd3-945a-58456c063fb6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155900 Jul 14 16:09:46.054875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1158/2418] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:45 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:46.110859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d708b65e-63b9-4cef-a1b9-5d501db5cbed tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:46.111476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d708b65e-63b9-4cef-a1b9-5d501db5cbed tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:46.117537 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d708b65e-63b9-4cef-a1b9-5d501db5cbed tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:46.117986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d708b65e-63b9-4cef-a1b9-5d501db5cbed tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:46.118745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d708b65e-63b9-4cef-a1b9-5d501db5cbed tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:46.119181 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d708b65e-63b9-4cef-a1b9-5d501db5cbed tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:46.258783 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d708b65e-63b9-4cef-a1b9-5d501db5cbed tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:46.268246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d708b65e-63b9-4cef-a1b9-5d501db5cbed tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.162018 Jul 14 16:09:46.268834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1261/2419] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:46 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:46.934804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e5b5e7bc-f268-4851-93d1-039cfdc0f2ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:46.935608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e5b5e7bc-f268-4851-93d1-039cfdc0f2ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:46.943371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e5b5e7bc-f268-4851-93d1-039cfdc0f2ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:46.943896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e5b5e7bc-f268-4851-93d1-039cfdc0f2ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:46.944666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e5b5e7bc-f268-4851-93d1-039cfdc0f2ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:46.945103 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e5b5e7bc-f268-4851-93d1-039cfdc0f2ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:47.010572 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e5b5e7bc-f268-4851-93d1-039cfdc0f2ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:47.019761 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e5b5e7bc-f268-4851-93d1-039cfdc0f2ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:47.021231 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e5b5e7bc-f268-4851-93d1-039cfdc0f2ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:47.022356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e5b5e7bc-f268-4851-93d1-039cfdc0f2ca tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.091483 Jul 14 16:09:47.022910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1159/2420] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:46 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:47.070987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0114504e-df0b-4034-af67-09e2d7df07f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:47.071617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0114504e-df0b-4034-af67-09e2d7df07f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:47.078755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0114504e-df0b-4034-af67-09e2d7df07f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:47.079202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0114504e-df0b-4034-af67-09e2d7df07f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:47.079975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0114504e-df0b-4034-af67-09e2d7df07f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:47.080413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0114504e-df0b-4034-af67-09e2d7df07f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:47.098229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:47.209757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0114504e-df0b-4034-af67-09e2d7df07f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:47.217696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0114504e-df0b-4034-af67-09e2d7df07f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150518 Jul 14 16:09:47.218540 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1262/2421] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:47 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:47.286477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-126b926c-ca43-4fa6-b5a9-3f77f3988914 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:47.286477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-126b926c-ca43-4fa6-b5a9-3f77f3988914 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:47.293704 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-126b926c-ca43-4fa6-b5a9-3f77f3988914 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:47.296715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-126b926c-ca43-4fa6-b5a9-3f77f3988914 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:47.297753 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-126b926c-ca43-4fa6-b5a9-3f77f3988914 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:47.298201 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-126b926c-ca43-4fa6-b5a9-3f77f3988914 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:47.438427 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-126b926c-ca43-4fa6-b5a9-3f77f3988914 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:47.446308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-126b926c-ca43-4fa6-b5a9-3f77f3988914 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.164495 Jul 14 16:09:47.446869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1160/2422] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:47 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:48.039397 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b6a67ca9-b8d8-465f-bbd3-2d40d067702d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:48.040042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b6a67ca9-b8d8-465f-bbd3-2d40d067702d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:48.047032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6a67ca9-b8d8-465f-bbd3-2d40d067702d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:48.047438 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6a67ca9-b8d8-465f-bbd3-2d40d067702d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:48.048245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6a67ca9-b8d8-465f-bbd3-2d40d067702d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:48.048680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6a67ca9-b8d8-465f-bbd3-2d40d067702d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:48.109503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b6a67ca9-b8d8-465f-bbd3-2d40d067702d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:48.117923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b6a67ca9-b8d8-465f-bbd3-2d40d067702d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:48.119424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b6a67ca9-b8d8-465f-bbd3-2d40d067702d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:48.120612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b6a67ca9-b8d8-465f-bbd3-2d40d067702d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.085133 Jul 14 16:09:48.121174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1263/2423] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:48 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:48.236151 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0b9091d6-699a-4ead-a48f-ccfb5e99cc6c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:48.236757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0b9091d6-699a-4ead-a48f-ccfb5e99cc6c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:48.243179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0b9091d6-699a-4ead-a48f-ccfb5e99cc6c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:48.243654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0b9091d6-699a-4ead-a48f-ccfb5e99cc6c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:48.244406 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0b9091d6-699a-4ead-a48f-ccfb5e99cc6c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:48.244838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0b9091d6-699a-4ead-a48f-ccfb5e99cc6c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:48.374757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0b9091d6-699a-4ead-a48f-ccfb5e99cc6c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:48.382693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0b9091d6-699a-4ead-a48f-ccfb5e99cc6c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151032 Jul 14 16:09:48.383266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1161/2424] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:48 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:48.463197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-66cf3c6d-1ac2-4e33-8f86-8e3ea7c6d78b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:48.463838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-66cf3c6d-1ac2-4e33-8f86-8e3ea7c6d78b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:48.470294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66cf3c6d-1ac2-4e33-8f86-8e3ea7c6d78b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:48.470808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66cf3c6d-1ac2-4e33-8f86-8e3ea7c6d78b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:48.471556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66cf3c6d-1ac2-4e33-8f86-8e3ea7c6d78b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:48.472009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66cf3c6d-1ac2-4e33-8f86-8e3ea7c6d78b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:48.605551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-66cf3c6d-1ac2-4e33-8f86-8e3ea7c6d78b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:48.614116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-66cf3c6d-1ac2-4e33-8f86-8e3ea7c6d78b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154700 Jul 14 16:09:48.614683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1264/2425] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:48 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:49.139047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b49926d9-e1bc-4854-b97d-170191a87869 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:49.140364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b49926d9-e1bc-4854-b97d-170191a87869 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:49.146429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b49926d9-e1bc-4854-b97d-170191a87869 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:49.146874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b49926d9-e1bc-4854-b97d-170191a87869 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:49.147639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b49926d9-e1bc-4854-b97d-170191a87869 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:49.148074 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b49926d9-e1bc-4854-b97d-170191a87869 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:49.208760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b49926d9-e1bc-4854-b97d-170191a87869 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:49.217770 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b49926d9-e1bc-4854-b97d-170191a87869 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:49.219262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b49926d9-e1bc-4854-b97d-170191a87869 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:49.220456 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b49926d9-e1bc-4854-b97d-170191a87869 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.085359 Jul 14 16:09:49.221021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1162/2426] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:49 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:49.399810 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2ada3c3f-4485-487b-b5b4-6b2feb5fb68f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:49.400424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2ada3c3f-4485-487b-b5b4-6b2feb5fb68f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:49.407512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2ada3c3f-4485-487b-b5b4-6b2feb5fb68f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:49.407998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2ada3c3f-4485-487b-b5b4-6b2feb5fb68f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:49.408754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2ada3c3f-4485-487b-b5b4-6b2feb5fb68f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:49.409192 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2ada3c3f-4485-487b-b5b4-6b2feb5fb68f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:49.539566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2ada3c3f-4485-487b-b5b4-6b2feb5fb68f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:49.548448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2ada3c3f-4485-487b-b5b4-6b2feb5fb68f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152513 Jul 14 16:09:49.549035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1265/2427] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:49 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:49.630985 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6cc2a8c1-6ef2-4c42-a573-1a9194ba72bc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:49.631617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6cc2a8c1-6ef2-4c42-a573-1a9194ba72bc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:49.638127 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6cc2a8c1-6ef2-4c42-a573-1a9194ba72bc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:49.638642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6cc2a8c1-6ef2-4c42-a573-1a9194ba72bc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:49.639398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6cc2a8c1-6ef2-4c42-a573-1a9194ba72bc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:49.639947 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6cc2a8c1-6ef2-4c42-a573-1a9194ba72bc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:49.771729 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6cc2a8c1-6ef2-4c42-a573-1a9194ba72bc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:49.779641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6cc2a8c1-6ef2-4c42-a573-1a9194ba72bc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152458 Jul 14 16:09:49.780870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1163/2428] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:49 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:50.238166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-68d6b1fd-ce36-4ee9-90e2-04cf40c32c6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:50.238767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-68d6b1fd-ce36-4ee9-90e2-04cf40c32c6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:50.244719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-68d6b1fd-ce36-4ee9-90e2-04cf40c32c6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:50.245197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-68d6b1fd-ce36-4ee9-90e2-04cf40c32c6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:50.246114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-68d6b1fd-ce36-4ee9-90e2-04cf40c32c6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:50.246475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-68d6b1fd-ce36-4ee9-90e2-04cf40c32c6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:50.308291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-68d6b1fd-ce36-4ee9-90e2-04cf40c32c6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:50.317397 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-68d6b1fd-ce36-4ee9-90e2-04cf40c32c6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:50.318879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-68d6b1fd-ce36-4ee9-90e2-04cf40c32c6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:50.320158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-68d6b1fd-ce36-4ee9-90e2-04cf40c32c6b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086121 Jul 14 16:09:50.320726 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1266/2429] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:50 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:50.566787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3c030d9f-2476-4c26-8972-a6b7e7131c5d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:50.567453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3c030d9f-2476-4c26-8972-a6b7e7131c5d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:50.573496 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c030d9f-2476-4c26-8972-a6b7e7131c5d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:50.573960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c030d9f-2476-4c26-8972-a6b7e7131c5d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:50.574734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c030d9f-2476-4c26-8972-a6b7e7131c5d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:50.575173 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c030d9f-2476-4c26-8972-a6b7e7131c5d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:50.709560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3c030d9f-2476-4c26-8972-a6b7e7131c5d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:50.717671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3c030d9f-2476-4c26-8972-a6b7e7131c5d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155043 Jul 14 16:09:50.718248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1164/2430] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:50 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:50.797744 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0073bdba-54de-44c8-94f4-399200a91b70 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:50.798356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0073bdba-54de-44c8-94f4-399200a91b70 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:50.805080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0073bdba-54de-44c8-94f4-399200a91b70 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:50.805524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0073bdba-54de-44c8-94f4-399200a91b70 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:50.806274 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0073bdba-54de-44c8-94f4-399200a91b70 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:50.806705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0073bdba-54de-44c8-94f4-399200a91b70 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:50.940015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0073bdba-54de-44c8-94f4-399200a91b70 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:50.948015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0073bdba-54de-44c8-94f4-399200a91b70 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154127 Jul 14 16:09:50.948589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1267/2431] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:50 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:51.338667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-06749dab-3254-49d9-bf4d-5a77c5fac049 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:51.339282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-06749dab-3254-49d9-bf4d-5a77c5fac049 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:51.346159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06749dab-3254-49d9-bf4d-5a77c5fac049 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:51.346672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06749dab-3254-49d9-bf4d-5a77c5fac049 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:51.347449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06749dab-3254-49d9-bf4d-5a77c5fac049 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:51.347914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06749dab-3254-49d9-bf4d-5a77c5fac049 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:51.411938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-06749dab-3254-49d9-bf4d-5a77c5fac049 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:51.420410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-06749dab-3254-49d9-bf4d-5a77c5fac049 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:51.422716 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-06749dab-3254-49d9-bf4d-5a77c5fac049 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:51.423879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-06749dab-3254-49d9-bf4d-5a77c5fac049 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089206 Jul 14 16:09:51.424440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1165/2432] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:51 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:51.734731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b101a808-1e00-430b-9f98-78e90caa20d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:51.735376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b101a808-1e00-430b-9f98-78e90caa20d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:51.741611 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b101a808-1e00-430b-9f98-78e90caa20d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:51.742055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b101a808-1e00-430b-9f98-78e90caa20d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:51.742813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b101a808-1e00-430b-9f98-78e90caa20d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:51.743245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b101a808-1e00-430b-9f98-78e90caa20d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:51.958421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b101a808-1e00-430b-9f98-78e90caa20d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:51.965388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d451e363-92aa-41e2-b1d5-92e59781e648 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:51.966597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b101a808-1e00-430b-9f98-78e90caa20d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.236047 Jul 14 16:09:51.967367 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d451e363-92aa-41e2-b1d5-92e59781e648 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:51.967549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1268/2433] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:51 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:51.978137 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d451e363-92aa-41e2-b1d5-92e59781e648 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:51.978635 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d451e363-92aa-41e2-b1d5-92e59781e648 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:51.979411 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d451e363-92aa-41e2-b1d5-92e59781e648 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:51.979879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d451e363-92aa-41e2-b1d5-92e59781e648 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:52.118693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d451e363-92aa-41e2-b1d5-92e59781e648 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:52.127372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d451e363-92aa-41e2-b1d5-92e59781e648 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.165841 Jul 14 16:09:52.127982 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1166/2434] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:51 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:52.441859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-37b587be-c9e0-495a-acd1-395eaa61003f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:52.442568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-37b587be-c9e0-495a-acd1-395eaa61003f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:52.448547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37b587be-c9e0-495a-acd1-395eaa61003f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:52.448995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37b587be-c9e0-495a-acd1-395eaa61003f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:52.449861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37b587be-c9e0-495a-acd1-395eaa61003f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:52.450302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37b587be-c9e0-495a-acd1-395eaa61003f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:52.512119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37b587be-c9e0-495a-acd1-395eaa61003f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:52.521055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37b587be-c9e0-495a-acd1-395eaa61003f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:52.522560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37b587be-c9e0-495a-acd1-395eaa61003f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:52.523737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-37b587be-c9e0-495a-acd1-395eaa61003f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.085784 Jul 14 16:09:52.524298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1269/2435] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:52 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:52.985589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cddecede-7b7e-403c-8b44-87972e76bbc6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:52.986209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cddecede-7b7e-403c-8b44-87972e76bbc6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:52.992863 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cddecede-7b7e-403c-8b44-87972e76bbc6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:52.993319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cddecede-7b7e-403c-8b44-87972e76bbc6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:52.994090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cddecede-7b7e-403c-8b44-87972e76bbc6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:52.994535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cddecede-7b7e-403c-8b44-87972e76bbc6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:53.128979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cddecede-7b7e-403c-8b44-87972e76bbc6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:53.141674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cddecede-7b7e-403c-8b44-87972e76bbc6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.160070 Jul 14 16:09:53.142263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1167/2436] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:52 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:53.144462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-69964486-2dfc-4ce5-906b-ec307dcf866b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:53.145344 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-69964486-2dfc-4ce5-906b-ec307dcf866b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:53.151768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69964486-2dfc-4ce5-906b-ec307dcf866b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:53.152220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69964486-2dfc-4ce5-906b-ec307dcf866b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:53.152971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69964486-2dfc-4ce5-906b-ec307dcf866b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:53.153406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-69964486-2dfc-4ce5-906b-ec307dcf866b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:53.280644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-69964486-2dfc-4ce5-906b-ec307dcf866b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:53.288783 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-69964486-2dfc-4ce5-906b-ec307dcf866b tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.148241 Jul 14 16:09:53.289358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1270/2437] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:53 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:53.543561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-38637927-951f-4890-947c-3276204f2b57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:53.544117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-38637927-951f-4890-947c-3276204f2b57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:53.551215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-38637927-951f-4890-947c-3276204f2b57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:53.551758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-38637927-951f-4890-947c-3276204f2b57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:53.552520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-38637927-951f-4890-947c-3276204f2b57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:53.552952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-38637927-951f-4890-947c-3276204f2b57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:53.617830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-38637927-951f-4890-947c-3276204f2b57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:53.626487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-38637927-951f-4890-947c-3276204f2b57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:53.628017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-38637927-951f-4890-947c-3276204f2b57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:53.629183 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-38637927-951f-4890-947c-3276204f2b57 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090281 Jul 14 16:09:53.629748 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1168/2438] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:53 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:54.158890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c4eeb6bc-d906-4a8f-84b9-5ee0733a678f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:54.159529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c4eeb6bc-d906-4a8f-84b9-5ee0733a678f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:54.166247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4eeb6bc-d906-4a8f-84b9-5ee0733a678f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:54.166697 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4eeb6bc-d906-4a8f-84b9-5ee0733a678f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:54.167762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4eeb6bc-d906-4a8f-84b9-5ee0733a678f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:54.168597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4eeb6bc-d906-4a8f-84b9-5ee0733a678f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:54.301213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c4eeb6bc-d906-4a8f-84b9-5ee0733a678f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:54.306640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-aabfce65-34b4-48a5-81f3-c39a0f24268e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:54.307211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-aabfce65-34b4-48a5-81f3-c39a0f24268e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:54.309270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c4eeb6bc-d906-4a8f-84b9-5ee0733a678f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155062 Jul 14 16:09:54.309845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1271/2439] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:54 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:54.313959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aabfce65-34b4-48a5-81f3-c39a0f24268e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:54.314376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aabfce65-34b4-48a5-81f3-c39a0f24268e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:54.315158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aabfce65-34b4-48a5-81f3-c39a0f24268e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:54.315617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aabfce65-34b4-48a5-81f3-c39a0f24268e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:54.319946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:09:54.446366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aabfce65-34b4-48a5-81f3-c39a0f24268e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:54.454587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-aabfce65-34b4-48a5-81f3-c39a0f24268e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151760 Jul 14 16:09:54.455156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1169/2440] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:54 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:54.647069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-eb55da11-fc41-4e38-9b1e-6baecb98f6b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:54.647702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eb55da11-fc41-4e38-9b1e-6baecb98f6b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:54.653741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb55da11-fc41-4e38-9b1e-6baecb98f6b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:54.654194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb55da11-fc41-4e38-9b1e-6baecb98f6b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:54.654944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb55da11-fc41-4e38-9b1e-6baecb98f6b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:54.656394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb55da11-fc41-4e38-9b1e-6baecb98f6b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:54.721611 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-eb55da11-fc41-4e38-9b1e-6baecb98f6b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:54.730293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-eb55da11-fc41-4e38-9b1e-6baecb98f6b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:54.731835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-eb55da11-fc41-4e38-9b1e-6baecb98f6b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:54.732974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-eb55da11-fc41-4e38-9b1e-6baecb98f6b8 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089882 Jul 14 16:09:54.734035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1272/2441] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:54 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:55.328116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f52f442e-2e85-40b2-b6f8-7f04d75acf35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:55.329642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f52f442e-2e85-40b2-b6f8-7f04d75acf35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:55.336194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f52f442e-2e85-40b2-b6f8-7f04d75acf35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:55.336648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f52f442e-2e85-40b2-b6f8-7f04d75acf35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:55.337440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f52f442e-2e85-40b2-b6f8-7f04d75acf35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:55.337889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f52f442e-2e85-40b2-b6f8-7f04d75acf35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:55.469789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f52f442e-2e85-40b2-b6f8-7f04d75acf35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:55.473585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f8832478-d48d-451b-bf40-2b72a007275f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:55.474203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f8832478-d48d-451b-bf40-2b72a007275f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:55.480019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f52f442e-2e85-40b2-b6f8-7f04d75acf35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155882 Jul 14 16:09:55.480619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1170/2442] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:55 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:55.481574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8832478-d48d-451b-bf40-2b72a007275f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:55.482236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8832478-d48d-451b-bf40-2b72a007275f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:55.483014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8832478-d48d-451b-bf40-2b72a007275f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:55.483483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8832478-d48d-451b-bf40-2b72a007275f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:55.752453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6a2f50ae-9781-4746-8ab9-f96e3a476220 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:55.753106 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6a2f50ae-9781-4746-8ab9-f96e3a476220 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:55.758985 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a2f50ae-9781-4746-8ab9-f96e3a476220 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:55.759437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a2f50ae-9781-4746-8ab9-f96e3a476220 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:55.760234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a2f50ae-9781-4746-8ab9-f96e3a476220 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:55.760671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a2f50ae-9781-4746-8ab9-f96e3a476220 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:55.767383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f8832478-d48d-451b-bf40-2b72a007275f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:55.775687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f8832478-d48d-451b-bf40-2b72a007275f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.307107 Jul 14 16:09:55.776269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1273/2443] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:55 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:55.835735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6a2f50ae-9781-4746-8ab9-f96e3a476220 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:55.844778 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6a2f50ae-9781-4746-8ab9-f96e3a476220 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:55.846281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6a2f50ae-9781-4746-8ab9-f96e3a476220 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:55.847428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6a2f50ae-9781-4746-8ab9-f96e3a476220 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.099112 Jul 14 16:09:55.848017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1171/2444] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:55 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:56.498032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d212bc90-12fb-443c-b8b7-5952b45de463 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:56.498630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d212bc90-12fb-443c-b8b7-5952b45de463 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:56.505778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d212bc90-12fb-443c-b8b7-5952b45de463 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:56.506218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d212bc90-12fb-443c-b8b7-5952b45de463 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:56.506972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d212bc90-12fb-443c-b8b7-5952b45de463 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:56.507403 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d212bc90-12fb-443c-b8b7-5952b45de463 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:56.646199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d212bc90-12fb-443c-b8b7-5952b45de463 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:56.654602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d212bc90-12fb-443c-b8b7-5952b45de463 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.160491 Jul 14 16:09:56.655187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1274/2445] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:56 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:56.797146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f6e785c7-6247-48e4-8975-0539bffd8add tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:56.797730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f6e785c7-6247-48e4-8975-0539bffd8add tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:56.804861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f6e785c7-6247-48e4-8975-0539bffd8add tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:56.805312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f6e785c7-6247-48e4-8975-0539bffd8add tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:56.806104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f6e785c7-6247-48e4-8975-0539bffd8add tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:56.806545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f6e785c7-6247-48e4-8975-0539bffd8add tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:56.865532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-628d2fd4-9805-4396-b34e-f5ede1bf3e43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:56.866142 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-628d2fd4-9805-4396-b34e-f5ede1bf3e43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:56.872202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-628d2fd4-9805-4396-b34e-f5ede1bf3e43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:56.872938 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-628d2fd4-9805-4396-b34e-f5ede1bf3e43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:56.873733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-628d2fd4-9805-4396-b34e-f5ede1bf3e43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:56.874167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-628d2fd4-9805-4396-b34e-f5ede1bf3e43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:56.937561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-628d2fd4-9805-4396-b34e-f5ede1bf3e43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:56.939510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f6e785c7-6247-48e4-8975-0539bffd8add tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:56.946384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-628d2fd4-9805-4396-b34e-f5ede1bf3e43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:56.947408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f6e785c7-6247-48e4-8975-0539bffd8add tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154222 Jul 14 16:09:56.947912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-628d2fd4-9805-4396-b34e-f5ede1bf3e43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:56.948049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1172/2446] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:56 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:09:56.949360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-628d2fd4-9805-4396-b34e-f5ede1bf3e43 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.087653 Jul 14 16:09:56.949916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1275/2447] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:56 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:57.673744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4efa87ad-728f-44c2-9eb0-e5515a779d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:57.674357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4efa87ad-728f-44c2-9eb0-e5515a779d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:57.680488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4efa87ad-728f-44c2-9eb0-e5515a779d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:57.680945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4efa87ad-728f-44c2-9eb0-e5515a779d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:57.681705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4efa87ad-728f-44c2-9eb0-e5515a779d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:57.682147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4efa87ad-728f-44c2-9eb0-e5515a779d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:57.817142 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4efa87ad-728f-44c2-9eb0-e5515a779d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:57.825040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4efa87ad-728f-44c2-9eb0-e5515a779d88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155701 Jul 14 16:09:57.825604 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1173/2448] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:57 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:57.965355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-91165794-4aa3-40dd-bd2e-189d27a486ae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:57.965904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-91165794-4aa3-40dd-bd2e-189d27a486ae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:57.969374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1ec64cc5-44fa-4665-b3c1-198e1e849ad1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:57.970617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1ec64cc5-44fa-4665-b3c1-198e1e849ad1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:57.972900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91165794-4aa3-40dd-bd2e-189d27a486ae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:57.973352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91165794-4aa3-40dd-bd2e-189d27a486ae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:57.974115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91165794-4aa3-40dd-bd2e-189d27a486ae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:57.974554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-91165794-4aa3-40dd-bd2e-189d27a486ae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:57.976565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1ec64cc5-44fa-4665-b3c1-198e1e849ad1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:57.977013 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1ec64cc5-44fa-4665-b3c1-198e1e849ad1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:57.977773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1ec64cc5-44fa-4665-b3c1-198e1e849ad1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:57.978211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1ec64cc5-44fa-4665-b3c1-198e1e849ad1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:58.050708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1ec64cc5-44fa-4665-b3c1-198e1e849ad1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:58.060313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1ec64cc5-44fa-4665-b3c1-198e1e849ad1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:58.061852 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1ec64cc5-44fa-4665-b3c1-198e1e849ad1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:58.063040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1ec64cc5-44fa-4665-b3c1-198e1e849ad1 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.097522 Jul 14 16:09:58.064310 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1174/2449] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:57 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:09:58.115188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-91165794-4aa3-40dd-bd2e-189d27a486ae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:58.123236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-91165794-4aa3-40dd-bd2e-189d27a486ae tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161875 Jul 14 16:09:58.123838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1276/2450] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:57 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:58.843401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-92add8a2-e6b0-43c2-8ec5-f3ffb6aa58df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:58.844111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-92add8a2-e6b0-43c2-8ec5-f3ffb6aa58df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:58.851128 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92add8a2-e6b0-43c2-8ec5-f3ffb6aa58df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:58.851585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92add8a2-e6b0-43c2-8ec5-f3ffb6aa58df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:58.852405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92add8a2-e6b0-43c2-8ec5-f3ffb6aa58df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:58.852849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-92add8a2-e6b0-43c2-8ec5-f3ffb6aa58df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:58.992049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-92add8a2-e6b0-43c2-8ec5-f3ffb6aa58df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:59.000371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-92add8a2-e6b0-43c2-8ec5-f3ffb6aa58df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.161805 Jul 14 16:09:59.001017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1175/2451] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:58 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:09:59.081867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f256572b-edc4-4ae7-a9d7-1518f465d205 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:59.082481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f256572b-edc4-4ae7-a9d7-1518f465d205 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:59.089052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f256572b-edc4-4ae7-a9d7-1518f465d205 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:59.089499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f256572b-edc4-4ae7-a9d7-1518f465d205 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:59.090256 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f256572b-edc4-4ae7-a9d7-1518f465d205 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:59.090690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f256572b-edc4-4ae7-a9d7-1518f465d205 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:59.142048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-356b6d67-fe0b-436d-bab6-dc8f6772df1d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:09:59.142675 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-356b6d67-fe0b-436d-bab6-dc8f6772df1d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:09:59.148924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-356b6d67-fe0b-436d-bab6-dc8f6772df1d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:59.149370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-356b6d67-fe0b-436d-bab6-dc8f6772df1d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:59.150133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-356b6d67-fe0b-436d-bab6-dc8f6772df1d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:09:59.150565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-356b6d67-fe0b-436d-bab6-dc8f6772df1d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:09:59.159778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f256572b-edc4-4ae7-a9d7-1518f465d205 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:59.169539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f256572b-edc4-4ae7-a9d7-1518f465d205 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:59.171038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f256572b-edc4-4ae7-a9d7-1518f465d205 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:59.172244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f256572b-edc4-4ae7-a9d7-1518f465d205 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.095277 Jul 14 16:09:59.172835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1277/2452] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:09:59 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:09:59.289755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-356b6d67-fe0b-436d-bab6-dc8f6772df1d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:09:59.298166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-356b6d67-fe0b-436d-bab6-dc8f6772df1d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160607 Jul 14 16:09:59.298749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1176/2453] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:09:59 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:00.018026 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-29a1b896-6d1a-4542-bdc0-a2af3e4e97d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:00.018639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-29a1b896-6d1a-4542-bdc0-a2af3e4e97d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:00.024751 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29a1b896-6d1a-4542-bdc0-a2af3e4e97d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:00.025208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29a1b896-6d1a-4542-bdc0-a2af3e4e97d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:00.025965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29a1b896-6d1a-4542-bdc0-a2af3e4e97d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:00.026405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29a1b896-6d1a-4542-bdc0-a2af3e4e97d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:00.161995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-29a1b896-6d1a-4542-bdc0-a2af3e4e97d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:00.171565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-29a1b896-6d1a-4542-bdc0-a2af3e4e97d6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157538 Jul 14 16:10:00.172252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1278/2454] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:00 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:00.190901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1f69acab-34d9-46de-8cc2-5e74b5de64fc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:00.191543 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1f69acab-34d9-46de-8cc2-5e74b5de64fc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:00.197993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f69acab-34d9-46de-8cc2-5e74b5de64fc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:00.198446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f69acab-34d9-46de-8cc2-5e74b5de64fc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:00.199207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f69acab-34d9-46de-8cc2-5e74b5de64fc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:00.199670 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f69acab-34d9-46de-8cc2-5e74b5de64fc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:00.264992 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1f69acab-34d9-46de-8cc2-5e74b5de64fc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:00.273589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1f69acab-34d9-46de-8cc2-5e74b5de64fc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:00.275089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1f69acab-34d9-46de-8cc2-5e74b5de64fc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:00.276254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1f69acab-34d9-46de-8cc2-5e74b5de64fc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.090009 Jul 14 16:10:00.276817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1177/2455] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:00 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:00.315463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c43a8194-3f6e-4aa5-84d8-a458f5ca2179 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:00.316107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c43a8194-3f6e-4aa5-84d8-a458f5ca2179 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:00.322286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c43a8194-3f6e-4aa5-84d8-a458f5ca2179 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:00.322729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c43a8194-3f6e-4aa5-84d8-a458f5ca2179 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:00.323478 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c43a8194-3f6e-4aa5-84d8-a458f5ca2179 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:00.324104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c43a8194-3f6e-4aa5-84d8-a458f5ca2179 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:00.328104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:00.457370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c43a8194-3f6e-4aa5-84d8-a458f5ca2179 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:00.469010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c43a8194-3f6e-4aa5-84d8-a458f5ca2179 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157444 Jul 14 16:10:00.469618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1279/2456] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:00 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:00.530097 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:10:00.530328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:10:00 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:10:01.190135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d30611ea-2ad8-4e54-8d8a-6cc1f9500734 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:01.190759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d30611ea-2ad8-4e54-8d8a-6cc1f9500734 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:01.197471 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d30611ea-2ad8-4e54-8d8a-6cc1f9500734 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:01.198088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d30611ea-2ad8-4e54-8d8a-6cc1f9500734 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:01.198682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d30611ea-2ad8-4e54-8d8a-6cc1f9500734 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:01.199129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d30611ea-2ad8-4e54-8d8a-6cc1f9500734 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:01.294529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d860d4a0-7794-49ad-a11a-1e4a4887e140 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:01.295146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d860d4a0-7794-49ad-a11a-1e4a4887e140 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:01.302461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d860d4a0-7794-49ad-a11a-1e4a4887e140 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:01.303045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d860d4a0-7794-49ad-a11a-1e4a4887e140 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:01.303894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d860d4a0-7794-49ad-a11a-1e4a4887e140 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:01.304443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d860d4a0-7794-49ad-a11a-1e4a4887e140 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:01.330575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d30611ea-2ad8-4e54-8d8a-6cc1f9500734 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:01.338824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d30611ea-2ad8-4e54-8d8a-6cc1f9500734 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.153214 Jul 14 16:10:01.339468 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1178/2457] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:01 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:01.370524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d860d4a0-7794-49ad-a11a-1e4a4887e140 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:01.379690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d860d4a0-7794-49ad-a11a-1e4a4887e140 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:01.381182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d860d4a0-7794-49ad-a11a-1e4a4887e140 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:01.382339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d860d4a0-7794-49ad-a11a-1e4a4887e140 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.092033 Jul 14 16:10:01.382893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1280/2458] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:01 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:10:01.490323 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0635d652-96bb-46c3-aa05-3dd3ae32cacc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:01.490926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0635d652-96bb-46c3-aa05-3dd3ae32cacc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:01.496975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0635d652-96bb-46c3-aa05-3dd3ae32cacc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:01.497421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0635d652-96bb-46c3-aa05-3dd3ae32cacc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:01.498167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0635d652-96bb-46c3-aa05-3dd3ae32cacc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:01.498600 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0635d652-96bb-46c3-aa05-3dd3ae32cacc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:01.629895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0635d652-96bb-46c3-aa05-3dd3ae32cacc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:01.637649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0635d652-96bb-46c3-aa05-3dd3ae32cacc tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151315 Jul 14 16:10:01.638214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1179/2459] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:01 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:02.355113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f528ac7f-6dd0-471d-82a5-30d11d4f8faa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:02.355686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f528ac7f-6dd0-471d-82a5-30d11d4f8faa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:02.363068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f528ac7f-6dd0-471d-82a5-30d11d4f8faa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:02.363499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f528ac7f-6dd0-471d-82a5-30d11d4f8faa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:02.364291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f528ac7f-6dd0-471d-82a5-30d11d4f8faa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:02.364730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f528ac7f-6dd0-471d-82a5-30d11d4f8faa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:02.400953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-514eb5f3-e90c-4581-bc01-45fe50fbbdbb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:02.401707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-514eb5f3-e90c-4581-bc01-45fe50fbbdbb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:02.409530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-514eb5f3-e90c-4581-bc01-45fe50fbbdbb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:02.410095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-514eb5f3-e90c-4581-bc01-45fe50fbbdbb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:02.411030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-514eb5f3-e90c-4581-bc01-45fe50fbbdbb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:02.411542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-514eb5f3-e90c-4581-bc01-45fe50fbbdbb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:02.489046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-514eb5f3-e90c-4581-bc01-45fe50fbbdbb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:02.499209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-514eb5f3-e90c-4581-bc01-45fe50fbbdbb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:02.500766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-514eb5f3-e90c-4581-bc01-45fe50fbbdbb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:02.502546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-514eb5f3-e90c-4581-bc01-45fe50fbbdbb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.105195 Jul 14 16:10:02.503206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1180/2460] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:02 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:10:02.654297 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d6112309-b88d-46ee-b97b-11e91b82b840 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:02.655208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d6112309-b88d-46ee-b97b-11e91b82b840 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:02.662068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d6112309-b88d-46ee-b97b-11e91b82b840 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:02.662520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d6112309-b88d-46ee-b97b-11e91b82b840 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:02.663272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d6112309-b88d-46ee-b97b-11e91b82b840 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:02.663730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d6112309-b88d-46ee-b97b-11e91b82b840 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:02.734880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f528ac7f-6dd0-471d-82a5-30d11d4f8faa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:02.743897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f528ac7f-6dd0-471d-82a5-30d11d4f8faa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.392768 Jul 14 16:10:02.744462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1281/2461] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:02 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:02.794754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d6112309-b88d-46ee-b97b-11e91b82b840 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:02.803958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d6112309-b88d-46ee-b97b-11e91b82b840 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153448 Jul 14 16:10:02.804534 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1181/2462] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:02 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:03.522686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-47636cd0-d075-4bd5-925a-afbe0a2339cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:03.523323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-47636cd0-d075-4bd5-925a-afbe0a2339cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:03.529835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-47636cd0-d075-4bd5-925a-afbe0a2339cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:03.530296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-47636cd0-d075-4bd5-925a-afbe0a2339cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:03.531074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-47636cd0-d075-4bd5-925a-afbe0a2339cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:03.531522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-47636cd0-d075-4bd5-925a-afbe0a2339cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:03.687405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-47636cd0-d075-4bd5-925a-afbe0a2339cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:03.698298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-47636cd0-d075-4bd5-925a-afbe0a2339cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:03.700178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-47636cd0-d075-4bd5-925a-afbe0a2339cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:03.701328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-47636cd0-d075-4bd5-925a-afbe0a2339cb tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.183505 Jul 14 16:10:03.701926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1282/2463] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:03 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:03.761025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-898246f6-bbe0-4351-935e-6da94b139364 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:03.761615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-898246f6-bbe0-4351-935e-6da94b139364 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:03.768632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-898246f6-bbe0-4351-935e-6da94b139364 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:03.769083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-898246f6-bbe0-4351-935e-6da94b139364 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:03.769854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-898246f6-bbe0-4351-935e-6da94b139364 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:03.770415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-898246f6-bbe0-4351-935e-6da94b139364 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:03.821524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-588984d9-0d07-40a0-8071-76c785023275 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:03.822247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-588984d9-0d07-40a0-8071-76c785023275 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:03.829326 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-588984d9-0d07-40a0-8071-76c785023275 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:03.830035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-588984d9-0d07-40a0-8071-76c785023275 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:03.830812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-588984d9-0d07-40a0-8071-76c785023275 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:03.831243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-588984d9-0d07-40a0-8071-76c785023275 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:03.983488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-898246f6-bbe0-4351-935e-6da94b139364 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:03.984222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-588984d9-0d07-40a0-8071-76c785023275 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:03.993268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-898246f6-bbe0-4351-935e-6da94b139364 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.236103 Jul 14 16:10:03.993522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-588984d9-0d07-40a0-8071-76c785023275 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.175744 Jul 14 16:10:03.999722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1283/2464] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:03 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:04.000490 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1182/2465] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:03 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:04.721232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c0479874-fd9a-4b4b-8937-61e555d2a499 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:04.721795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c0479874-fd9a-4b4b-8937-61e555d2a499 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:04.728278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0479874-fd9a-4b4b-8937-61e555d2a499 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:04.728731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0479874-fd9a-4b4b-8937-61e555d2a499 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:04.729491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0479874-fd9a-4b4b-8937-61e555d2a499 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:04.730067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c0479874-fd9a-4b4b-8937-61e555d2a499 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:04.791521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c0479874-fd9a-4b4b-8937-61e555d2a499 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:04.803439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c0479874-fd9a-4b4b-8937-61e555d2a499 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:04.805520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c0479874-fd9a-4b4b-8937-61e555d2a499 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:04.806818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c0479874-fd9a-4b4b-8937-61e555d2a499 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.089582 Jul 14 16:10:04.807411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1284/2466] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:04 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:05.010268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e77a4738-05d5-444c-b5e4-adbcea806ac4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:05.010858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1f90020e-04a2-4e87-ae41-80b5ecd0d216 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:05.010858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1f90020e-04a2-4e87-ae41-80b5ecd0d216 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:05.011091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e77a4738-05d5-444c-b5e4-adbcea806ac4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:05.017916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e77a4738-05d5-444c-b5e4-adbcea806ac4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.018138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f90020e-04a2-4e87-ae41-80b5ecd0d216 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.018415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f90020e-04a2-4e87-ae41-80b5ecd0d216 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.018596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e77a4738-05d5-444c-b5e4-adbcea806ac4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.019178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f90020e-04a2-4e87-ae41-80b5ecd0d216 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.019303 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e77a4738-05d5-444c-b5e4-adbcea806ac4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.019639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f90020e-04a2-4e87-ae41-80b5ecd0d216 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.019780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e77a4738-05d5-444c-b5e4-adbcea806ac4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.163022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1f90020e-04a2-4e87-ae41-80b5ecd0d216 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:05.174491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1f90020e-04a2-4e87-ae41-80b5ecd0d216 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.167195 Jul 14 16:10:05.174905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e77a4738-05d5-444c-b5e4-adbcea806ac4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:05.176920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1285/2467] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:05 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:05.190129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e77a4738-05d5-444c-b5e4-adbcea806ac4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.182638 Jul 14 16:10:05.191177 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1183/2468] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:05 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:05.828246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-11e9142c-e76e-43ed-b4b1-46912bab821b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:05.829167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-11e9142c-e76e-43ed-b4b1-46912bab821b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:05.832778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=78 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:05.842651 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11e9142c-e76e-43ed-b4b1-46912bab821b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.843320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11e9142c-e76e-43ed-b4b1-46912bab821b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.844562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11e9142c-e76e-43ed-b4b1-46912bab821b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:05.845121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11e9142c-e76e-43ed-b4b1-46912bab821b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:05.918844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-11e9142c-e76e-43ed-b4b1-46912bab821b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:05.929524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-11e9142c-e76e-43ed-b4b1-46912bab821b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:05.931027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-11e9142c-e76e-43ed-b4b1-46912bab821b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:05.932217 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-11e9142c-e76e-43ed-b4b1-46912bab821b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.110213 Jul 14 16:10:05.932787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1286/2469] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:05 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:06.202176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-40219014-4cb0-4744-b9a5-b46172cbf671 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:06.202801 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-40219014-4cb0-4744-b9a5-b46172cbf671 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:06.210907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40219014-4cb0-4744-b9a5-b46172cbf671 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:06.211360 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40219014-4cb0-4744-b9a5-b46172cbf671 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:06.212165 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40219014-4cb0-4744-b9a5-b46172cbf671 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:06.212606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40219014-4cb0-4744-b9a5-b46172cbf671 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:06.213210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f8ed722f-540c-42f9-b0a0-134a38396fc1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:06.214271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f8ed722f-540c-42f9-b0a0-134a38396fc1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:06.222199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8ed722f-540c-42f9-b0a0-134a38396fc1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:06.222639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8ed722f-540c-42f9-b0a0-134a38396fc1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:06.223398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8ed722f-540c-42f9-b0a0-134a38396fc1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:06.223859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8ed722f-540c-42f9-b0a0-134a38396fc1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:06.359244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-40219014-4cb0-4744-b9a5-b46172cbf671 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:06.368823 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-40219014-4cb0-4744-b9a5-b46172cbf671 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.170542 Jul 14 16:10:06.369415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1184/2470] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:06 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:06.381486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f8ed722f-540c-42f9-b0a0-134a38396fc1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:06.389459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f8ed722f-540c-42f9-b0a0-134a38396fc1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.182624 Jul 14 16:10:06.390019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1287/2471] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:06 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:06.955985 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8130f7cf-8fb5-4356-945d-9c938212084f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:06.956615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8130f7cf-8fb5-4356-945d-9c938212084f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:06.962826 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8130f7cf-8fb5-4356-945d-9c938212084f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:06.963280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8130f7cf-8fb5-4356-945d-9c938212084f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:06.964083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8130f7cf-8fb5-4356-945d-9c938212084f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:06.964525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8130f7cf-8fb5-4356-945d-9c938212084f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:07.025831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8130f7cf-8fb5-4356-945d-9c938212084f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:07.029283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:07.034978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8130f7cf-8fb5-4356-945d-9c938212084f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:07.036590 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8130f7cf-8fb5-4356-945d-9c938212084f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:07.038048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8130f7cf-8fb5-4356-945d-9c938212084f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.086405 Jul 14 16:10:07.038617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1185/2472] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:06 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:07.386637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0e1714fb-1e3b-4d2b-a532-e503e2a1e7f0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:07.387222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0e1714fb-1e3b-4d2b-a532-e503e2a1e7f0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:07.393936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e1714fb-1e3b-4d2b-a532-e503e2a1e7f0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:07.394387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e1714fb-1e3b-4d2b-a532-e503e2a1e7f0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:07.395152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e1714fb-1e3b-4d2b-a532-e503e2a1e7f0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:07.395612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0e1714fb-1e3b-4d2b-a532-e503e2a1e7f0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:07.406260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-949a7de1-2210-491f-b9db-7fdc0b4861a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:07.406968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-949a7de1-2210-491f-b9db-7fdc0b4861a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:07.413906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-949a7de1-2210-491f-b9db-7fdc0b4861a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:07.414363 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-949a7de1-2210-491f-b9db-7fdc0b4861a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:07.415127 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-949a7de1-2210-491f-b9db-7fdc0b4861a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:07.415562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-949a7de1-2210-491f-b9db-7fdc0b4861a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:07.530727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0e1714fb-1e3b-4d2b-a532-e503e2a1e7f0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:07.539439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0e1714fb-1e3b-4d2b-a532-e503e2a1e7f0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156710 Jul 14 16:10:07.540068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1288/2473] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:07 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:07.555529 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-949a7de1-2210-491f-b9db-7fdc0b4861a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:07.563493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-949a7de1-2210-491f-b9db-7fdc0b4861a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.161197 Jul 14 16:10:07.564860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1186/2474] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:07 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:08.056375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-74d1540a-154d-457e-a986-e5f076c87788 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:08.056987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-74d1540a-154d-457e-a986-e5f076c87788 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:08.063146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74d1540a-154d-457e-a986-e5f076c87788 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:08.063625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74d1540a-154d-457e-a986-e5f076c87788 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:08.064504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74d1540a-154d-457e-a986-e5f076c87788 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:08.065049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-74d1540a-154d-457e-a986-e5f076c87788 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:08.145351 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-74d1540a-154d-457e-a986-e5f076c87788 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:08.153696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-74d1540a-154d-457e-a986-e5f076c87788 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:08.155171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-74d1540a-154d-457e-a986-e5f076c87788 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:08.156320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-74d1540a-154d-457e-a986-e5f076c87788 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 200 len: 1443 microversion: 2.20 time: 0.103899 Jul 14 16:10:08.156875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1289/2475] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:08 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 1443 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:08.180526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2b66f8a5-ec87-40e8-bbf6-e4fdf1982539 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '.version_select at 0x7f357ff12790>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:08.199173 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2b66f8a5-ec87-40e8-bbf6-e4fdf1982539 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-782876498" status: 204 len: 0 microversion: 2.20 time: 0.028239 Jul 14 16:10:08.199773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1187/2476] 10.222.0.99 () {60 vars in 1258 bytes} [Thu Jul 14 16:10:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-782876498 => generated 0 bytes in 29 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 16:10:08.557652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-84a6206e-da57-4eea-ac90-86b442ccaded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:08.558216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-84a6206e-da57-4eea-ac90-86b442ccaded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:08.565367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84a6206e-da57-4eea-ac90-86b442ccaded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:08.565810 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84a6206e-da57-4eea-ac90-86b442ccaded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:08.566567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84a6206e-da57-4eea-ac90-86b442ccaded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:08.566995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-84a6206e-da57-4eea-ac90-86b442ccaded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:08.582608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6ac478d1-4d21-4c44-b2d7-b39fd5467675 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:08.583227 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6ac478d1-4d21-4c44-b2d7-b39fd5467675 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:08.590262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ac478d1-4d21-4c44-b2d7-b39fd5467675 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:08.590952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ac478d1-4d21-4c44-b2d7-b39fd5467675 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:08.591942 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ac478d1-4d21-4c44-b2d7-b39fd5467675 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:08.592601 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ac478d1-4d21-4c44-b2d7-b39fd5467675 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:08.746470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-84a6206e-da57-4eea-ac90-86b442ccaded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:08.771943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-84a6206e-da57-4eea-ac90-86b442ccaded tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.217617 Jul 14 16:10:08.780062 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1290/2477] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:08 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:08.789261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ffa77c5a-e334-4cba-a042-884843d4cfaf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:08.790296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ffa77c5a-e334-4cba-a042-884843d4cfaf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:08.798874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffa77c5a-e334-4cba-a042-884843d4cfaf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:08.799911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffa77c5a-e334-4cba-a042-884843d4cfaf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:08.800985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffa77c5a-e334-4cba-a042-884843d4cfaf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:08.801447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffa77c5a-e334-4cba-a042-884843d4cfaf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:08.819711 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6ac478d1-4d21-4c44-b2d7-b39fd5467675 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:08.827960 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6ac478d1-4d21-4c44-b2d7-b39fd5467675 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.249987 Jul 14 16:10:08.828685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1188/2478] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:08 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:08.837050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ffa77c5a-e334-4cba-a042-884843d4cfaf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Going to try to terminate instance {{(pid=124503) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:10:08.882089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:10:08.882252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:10:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:10:08.933019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ffa77c5a-e334-4cba-a042-884843d4cfaf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 204 len: 0 microversion: 2.1 time: 0.150513 Jul 14 16:10:08.933605 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1291/2479] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:10:08 2022] DELETE /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:10:08.942736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8774d117-34cd-4aba-9ef9-96aa4235f980 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:08.943625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8774d117-34cd-4aba-9ef9-96aa4235f980 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:08.949706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8774d117-34cd-4aba-9ef9-96aa4235f980 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:08.950158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8774d117-34cd-4aba-9ef9-96aa4235f980 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:08.950931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8774d117-34cd-4aba-9ef9-96aa4235f980 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:08.951375 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8774d117-34cd-4aba-9ef9-96aa4235f980 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:09.125240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9fe10c49-4dc7-40bc-a4b1-3d2d2b21a29c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Action: 'create', calling method: .version_select at 0x7f357fec71f0>, body: {"keypair": {"name": "tempest-keypair-1132635853", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDwRL7jQArK/+bqadHaOdL2t28tVKhcoO/Obgv7mgxBQ66dqFzvNWsJtRjQAoqRsUIFyQHdFVJeJyNvi6fQF+RepCYvEIQ5mv4zq5EV97MonC3fxApUiB5u1C4TzpRCJMg=="}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:09.141715 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-9fe10c49-4dc7-40bc-a4b1-3d2d2b21a29c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Getting quotas for project 636b923a8a58435484086dc8394ccc23. Resources: {'key_pairs'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:10:09.146201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-9fe10c49-4dc7-40bc-a4b1-3d2d2b21a29c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Getting quotas for user 781567471d0f4ca4add4331d405febd4 and project 636b923a8a58435484086dc8394ccc23. Resources: {'key_pairs'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:10:09.174673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9fe10c49-4dc7-40bc-a4b1-3d2d2b21a29c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.053743 Jul 14 16:10:09.180481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1292/2480] 10.222.0.99 () {62 vars in 1199 bytes} [Thu Jul 14 16:10:09 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 56 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jul 14 16:10:09.286086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8774d117-34cd-4aba-9ef9-96aa4235f980 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:09.294156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8774d117-34cd-4aba-9ef9-96aa4235f980 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1718 microversion: 2.1 time: 0.356055 Jul 14 16:10:09.294812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1189/2481] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:08 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1718 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:09.797597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-05cb80fd-f3ad-44aa-93ad-7043880286a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:09.798565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-05cb80fd-f3ad-44aa-93ad-7043880286a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:09.805382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05cb80fd-f3ad-44aa-93ad-7043880286a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:09.805928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05cb80fd-f3ad-44aa-93ad-7043880286a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:09.806787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05cb80fd-f3ad-44aa-93ad-7043880286a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:09.807296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-05cb80fd-f3ad-44aa-93ad-7043880286a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:09.847242 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-71f499b2-7c2e-481f-8f9f-c8a056092362 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:09.847904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-71f499b2-7c2e-481f-8f9f-c8a056092362 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:09.859320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71f499b2-7c2e-481f-8f9f-c8a056092362 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:09.859901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71f499b2-7c2e-481f-8f9f-c8a056092362 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:09.860847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71f499b2-7c2e-481f-8f9f-c8a056092362 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:09.861638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71f499b2-7c2e-481f-8f9f-c8a056092362 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:10.002148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-71f499b2-7c2e-481f-8f9f-c8a056092362 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:10.010627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-71f499b2-7c2e-481f-8f9f-c8a056092362 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.168453 Jul 14 16:10:10.011272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1190/2482] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:09 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:10.140743 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-05cb80fd-f3ad-44aa-93ad-7043880286a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:10.149614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-05cb80fd-f3ad-44aa-93ad-7043880286a1 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.356411 Jul 14 16:10:10.150187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1293/2483] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:09 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:10.313225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-027cf3e3-f2d5-45f6-95b8-ac5214471b57 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:10.315234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-027cf3e3-f2d5-45f6-95b8-ac5214471b57 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:10.321627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-027cf3e3-f2d5-45f6-95b8-ac5214471b57 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:10.322080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-027cf3e3-f2d5-45f6-95b8-ac5214471b57 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:10.322849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-027cf3e3-f2d5-45f6-95b8-ac5214471b57 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:10.323290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-027cf3e3-f2d5-45f6-95b8-ac5214471b57 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:10.461873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-027cf3e3-f2d5-45f6-95b8-ac5214471b57 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:10.470561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-027cf3e3-f2d5-45f6-95b8-ac5214471b57 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1718 microversion: 2.1 time: 0.161241 Jul 14 16:10:10.471121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1191/2484] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:10 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1718 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:11.033488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-37e7eafd-b55e-4413-bb19-a3db903b978b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:11.037237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-37e7eafd-b55e-4413-bb19-a3db903b978b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:11.050266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37e7eafd-b55e-4413-bb19-a3db903b978b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:11.050789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37e7eafd-b55e-4413-bb19-a3db903b978b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:11.051886 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37e7eafd-b55e-4413-bb19-a3db903b978b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:11.052672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37e7eafd-b55e-4413-bb19-a3db903b978b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:11.133351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1215123327", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "5937a23f-e004-4882-8a0a-065fcac79e3e"}], "security_groups": [{"name": "tempest-securitygroup--1940998451"}], "key_name": "tempest-keypair-1132635853", "user_data": "}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:11.251193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.network.neutron [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] validate_networks() for [('5937a23f-e004-4882-8a0a-065fcac79e3e', None, None, None, None, None)] {{(pid=124502) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:10:11.318997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37e7eafd-b55e-4413-bb19-a3db903b978b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:11.351661 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-37e7eafd-b55e-4413-bb19-a3db903b978b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.325935 Jul 14 16:10:11.352579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1294/2485] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:11 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:11.362177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-03fc67eb-723f-48c3-94c6-127eec51036e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:11.364224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-03fc67eb-723f-48c3-94c6-127eec51036e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:11.373331 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03fc67eb-723f-48c3-94c6-127eec51036e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:11.374526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03fc67eb-723f-48c3-94c6-127eec51036e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:11.377924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03fc67eb-723f-48c3-94c6-127eec51036e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:11.378702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-03fc67eb-723f-48c3-94c6-127eec51036e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:11.385492 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:11.573494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-03fc67eb-723f-48c3-94c6-127eec51036e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:11.584393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-03fc67eb-723f-48c3-94c6-127eec51036e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.229380 Jul 14 16:10:11.585135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1295/2486] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:11 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:11.590107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-0e2c5a67-89dc-429f-a062-5607c9a61abd req-250d0780-3036-404f-82ea-7a452e362cde service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f3d96a86-d045-44b2-b298-75df12f65c86", "name": "network-vif-deleted", "tag": "c5725421-8115-49e0-9dc8-6b9ccd639dcd"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:11.600019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-0e2c5a67-89dc-429f-a062-5607c9a61abd req-250d0780-3036-404f-82ea-7a452e362cde service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:11.600593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-0e2c5a67-89dc-429f-a062-5607c9a61abd req-250d0780-3036-404f-82ea-7a452e362cde service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:11.612894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-0e2c5a67-89dc-429f-a062-5607c9a61abd req-250d0780-3036-404f-82ea-7a452e362cde service nova] Creating event network-vif-deleted:c5725421-8115-49e0-9dc8-6b9ccd639dcd for instance f3d96a86-d045-44b2-b298-75df12f65c86 on hv-cinder-82651 Jul 14 16:10:11.618163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-0e2c5a67-89dc-429f-a062-5607c9a61abd req-250d0780-3036-404f-82ea-7a452e362cde service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031457 Jul 14 16:10:11.619388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1296/2487] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:10:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:10:11.625874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dc7cd12a-be98-4865-9231-cefb41c0ae47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:11.627509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dc7cd12a-be98-4865-9231-cefb41c0ae47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:11.633895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dc7cd12a-be98-4865-9231-cefb41c0ae47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:11.635059 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dc7cd12a-be98-4865-9231-cefb41c0ae47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:11.635337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dc7cd12a-be98-4865-9231-cefb41c0ae47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:11.635903 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dc7cd12a-be98-4865-9231-cefb41c0ae47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:11.706816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dc7cd12a-be98-4865-9231-cefb41c0ae47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:11.715209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dc7cd12a-be98-4865-9231-cefb41c0ae47 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.094276 Jul 14 16:10:11.715830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1297/2488] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:11 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:12.039520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Flavor limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:10:12.039971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Image limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:10:12.040446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Flavor pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:10:12.040859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Image pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:10:12.041807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:10:12.051959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:12.052408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:12.053231 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:12.053671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:12.071206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Getting quotas for project 636b923a8a58435484086dc8394ccc23. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:10:12.076990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Getting quotas for user 781567471d0f4ca4add4331d405febd4 and project 636b923a8a58435484086dc8394ccc23. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:10:12.090122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Going to run 1 instances... {{(pid=124502) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:10:12.092420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124502) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:10:12.147532 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4659016c-78f0-4101-af11-f481f5353536 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.018071 Jul 14 16:10:12.152020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1192/2489] 10.222.0.99 () {62 vars in 1187 bytes} [Thu Jul 14 16:10:11 2022] POST /compute/v2.1/servers => generated 402 bytes in 1024 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Jul 14 16:10:12.159726 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bd4dbd62-2549-4696-adbb-bfa61f7aa952 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:12.160989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bd4dbd62-2549-4696-adbb-bfa61f7aa952 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:12.224435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd4dbd62-2549-4696-adbb-bfa61f7aa952 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:12.232770 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd4dbd62-2549-4696-adbb-bfa61f7aa952 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:12.238132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd4dbd62-2549-4696-adbb-bfa61f7aa952 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:12.239521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bd4dbd62-2549-4696-adbb-bfa61f7aa952 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1282 microversion: 2.20 time: 0.084503 Jul 14 16:10:12.240566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1298/2490] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:12 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1282 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:12.370210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-55ee39c0-3b3c-410c-bbab-96aecc88bf0d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:12.371448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-55ee39c0-3b3c-410c-bbab-96aecc88bf0d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:12.380064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55ee39c0-3b3c-410c-bbab-96aecc88bf0d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:12.380605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55ee39c0-3b3c-410c-bbab-96aecc88bf0d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:12.381461 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55ee39c0-3b3c-410c-bbab-96aecc88bf0d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:12.381964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-55ee39c0-3b3c-410c-bbab-96aecc88bf0d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:12.541070 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-55ee39c0-3b3c-410c-bbab-96aecc88bf0d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:12.551735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-55ee39c0-3b3c-410c-bbab-96aecc88bf0d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.185451 Jul 14 16:10:12.552477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1193/2491] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:12 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:12.606773 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bc4b9cae-2f98-4c8f-9cd4-6ebb7193f038 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:12.607397 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bc4b9cae-2f98-4c8f-9cd4-6ebb7193f038 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:12.614955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc4b9cae-2f98-4c8f-9cd4-6ebb7193f038 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:12.615303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc4b9cae-2f98-4c8f-9cd4-6ebb7193f038 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:12.616113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc4b9cae-2f98-4c8f-9cd4-6ebb7193f038 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:12.616653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bc4b9cae-2f98-4c8f-9cd4-6ebb7193f038 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:12.733255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-940499f7-38ce-4b97-991e-e1e5f1f3552e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:12.734245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-940499f7-38ce-4b97-991e-e1e5f1f3552e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:12.744642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-940499f7-38ce-4b97-991e-e1e5f1f3552e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:12.745273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-940499f7-38ce-4b97-991e-e1e5f1f3552e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:12.746005 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-940499f7-38ce-4b97-991e-e1e5f1f3552e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:12.746445 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-940499f7-38ce-4b97-991e-e1e5f1f3552e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:12.772872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bc4b9cae-2f98-4c8f-9cd4-6ebb7193f038 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:12.785157 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bc4b9cae-2f98-4c8f-9cd4-6ebb7193f038 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.182266 Jul 14 16:10:12.786206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1299/2492] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:12 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:12.818070 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-940499f7-38ce-4b97-991e-e1e5f1f3552e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:12.826232 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-940499f7-38ce-4b97-991e-e1e5f1f3552e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.097678 Jul 14 16:10:12.826896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1194/2493] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:12 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:13.259093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6f38ab32-1b87-456d-9d39-e9ac1bc61956 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:13.259687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6f38ab32-1b87-456d-9d39-e9ac1bc61956 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:13.268797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6f38ab32-1b87-456d-9d39-e9ac1bc61956 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:13.269252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6f38ab32-1b87-456d-9d39-e9ac1bc61956 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:13.270036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6f38ab32-1b87-456d-9d39-e9ac1bc61956 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:13.270482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6f38ab32-1b87-456d-9d39-e9ac1bc61956 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:13.401138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6f38ab32-1b87-456d-9d39-e9ac1bc61956 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:13.415462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6f38ab32-1b87-456d-9d39-e9ac1bc61956 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:13.417608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6f38ab32-1b87-456d-9d39-e9ac1bc61956 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:13.419040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6f38ab32-1b87-456d-9d39-e9ac1bc61956 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1342 microversion: 2.20 time: 0.164961 Jul 14 16:10:13.419693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1300/2494] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:13 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1342 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:13.571548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-02c1f306-4700-4f37-9841-c9dfa93c011b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:13.572190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-02c1f306-4700-4f37-9841-c9dfa93c011b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:13.574503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:13.580837 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-02c1f306-4700-4f37-9841-c9dfa93c011b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:13.581563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-02c1f306-4700-4f37-9841-c9dfa93c011b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:13.582327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-02c1f306-4700-4f37-9841-c9dfa93c011b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:13.582763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-02c1f306-4700-4f37-9841-c9dfa93c011b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:13.737043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-02c1f306-4700-4f37-9841-c9dfa93c011b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:13.746771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-02c1f306-4700-4f37-9841-c9dfa93c011b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.180657 Jul 14 16:10:13.759827 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1195/2495] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:13 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:13.805304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-955f51f0-0571-49a5-be71-518818fe65ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:13.805854 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-955f51f0-0571-49a5-be71-518818fe65ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:13.812971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-955f51f0-0571-49a5-be71-518818fe65ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:13.813411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-955f51f0-0571-49a5-be71-518818fe65ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:13.814693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-955f51f0-0571-49a5-be71-518818fe65ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:13.815221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-955f51f0-0571-49a5-be71-518818fe65ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:13.843647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8f1d8c93-87f5-42e1-b5aa-99c8a66fbcdb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:13.844536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8f1d8c93-87f5-42e1-b5aa-99c8a66fbcdb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:13.851133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f1d8c93-87f5-42e1-b5aa-99c8a66fbcdb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:13.851580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f1d8c93-87f5-42e1-b5aa-99c8a66fbcdb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:13.852369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f1d8c93-87f5-42e1-b5aa-99c8a66fbcdb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:13.852804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f1d8c93-87f5-42e1-b5aa-99c8a66fbcdb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:13.926907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8f1d8c93-87f5-42e1-b5aa-99c8a66fbcdb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:13.936148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8f1d8c93-87f5-42e1-b5aa-99c8a66fbcdb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.096219 Jul 14 16:10:13.936872 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1196/2496] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:13 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:14.064986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-955f51f0-0571-49a5-be71-518818fe65ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:14.072638 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-955f51f0-0571-49a5-be71-518818fe65ef tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.272204 Jul 14 16:10:14.073206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1301/2497] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:13 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:14.453147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cddc18de-0755-4530-a501-8c492eaf024f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:14.453790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cddc18de-0755-4530-a501-8c492eaf024f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:14.464768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cddc18de-0755-4530-a501-8c492eaf024f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:14.465489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cddc18de-0755-4530-a501-8c492eaf024f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:14.466235 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cddc18de-0755-4530-a501-8c492eaf024f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:14.466678 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cddc18de-0755-4530-a501-8c492eaf024f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:14.600167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cddc18de-0755-4530-a501-8c492eaf024f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:14.608394 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cddc18de-0755-4530-a501-8c492eaf024f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:14.609882 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cddc18de-0755-4530-a501-8c492eaf024f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:14.611722 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cddc18de-0755-4530-a501-8c492eaf024f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1408 microversion: 2.20 time: 0.167175 Jul 14 16:10:14.612374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1197/2498] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:14 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:14.768885 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e8c0d34-5930-4092-bccc-bad32c29601f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:14.769470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e8c0d34-5930-4092-bccc-bad32c29601f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:14.775982 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e8c0d34-5930-4092-bccc-bad32c29601f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:14.776671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e8c0d34-5930-4092-bccc-bad32c29601f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:14.777439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e8c0d34-5930-4092-bccc-bad32c29601f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:14.777870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e8c0d34-5930-4092-bccc-bad32c29601f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:14.954245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a0701761-eecc-486d-bf11-c1cffe3341a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:14.955544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a0701761-eecc-486d-bf11-c1cffe3341a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:14.962201 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a0701761-eecc-486d-bf11-c1cffe3341a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:14.962668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a0701761-eecc-486d-bf11-c1cffe3341a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:14.963446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a0701761-eecc-486d-bf11-c1cffe3341a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:14.963911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a0701761-eecc-486d-bf11-c1cffe3341a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:15.028591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a0701761-eecc-486d-bf11-c1cffe3341a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:15.037950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a0701761-eecc-486d-bf11-c1cffe3341a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087521 Jul 14 16:10:15.038544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1198/2499] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:14 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:15.092051 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-587922e7-fa9b-49dd-8557-e286d093c354 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:15.092787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-587922e7-fa9b-49dd-8557-e286d093c354 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:15.099698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-587922e7-fa9b-49dd-8557-e286d093c354 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:15.100149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-587922e7-fa9b-49dd-8557-e286d093c354 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:15.101557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-587922e7-fa9b-49dd-8557-e286d093c354 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:15.102249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-587922e7-fa9b-49dd-8557-e286d093c354 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:15.241344 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e8c0d34-5930-4092-bccc-bad32c29601f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:15.271086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-587922e7-fa9b-49dd-8557-e286d093c354 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:15.276833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e8c0d34-5930-4092-bccc-bad32c29601f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.511068 Jul 14 16:10:15.279235 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1302/2500] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:14 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:15.291412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-3906e689-d3f6-49fe-9f0e-9dcda833859f req-d799372f-a6ab-4348-9a6e-6d46b4213707 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b384c419-d19a-4564-9c70-ae40273487bf", "tag": "dfba5691-18bb-4970-9d97-f67ef9081351"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:15.296234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-587922e7-fa9b-49dd-8557-e286d093c354 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.207973 Jul 14 16:10:15.308619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1199/2501] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:15 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:15.316213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-3906e689-d3f6-49fe-9f0e-9dcda833859f req-d799372f-a6ab-4348-9a6e-6d46b4213707 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:15.317972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-3906e689-d3f6-49fe-9f0e-9dcda833859f req-d799372f-a6ab-4348-9a6e-6d46b4213707 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:15.334417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-3906e689-d3f6-49fe-9f0e-9dcda833859f req-d799372f-a6ab-4348-9a6e-6d46b4213707 service nova] Creating event network-changed:dfba5691-18bb-4970-9d97-f67ef9081351 for instance b384c419-d19a-4564-9c70-ae40273487bf on hv-cinder-82651 Jul 14 16:10:15.340999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-3906e689-d3f6-49fe-9f0e-9dcda833859f req-d799372f-a6ab-4348-9a6e-6d46b4213707 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059579 Jul 14 16:10:15.341867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1303/2502] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:10:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:10:15.631577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b78d7cfc-d8b5-406f-a66b-ae5222d68079 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:15.632838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b78d7cfc-d8b5-406f-a66b-ae5222d68079 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:15.639500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b78d7cfc-d8b5-406f-a66b-ae5222d68079 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:15.639987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b78d7cfc-d8b5-406f-a66b-ae5222d68079 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:15.640754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b78d7cfc-d8b5-406f-a66b-ae5222d68079 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:15.641193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b78d7cfc-d8b5-406f-a66b-ae5222d68079 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:15.774561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b78d7cfc-d8b5-406f-a66b-ae5222d68079 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:15.782785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b78d7cfc-d8b5-406f-a66b-ae5222d68079 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:15.793404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b78d7cfc-d8b5-406f-a66b-ae5222d68079 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:15.794621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b78d7cfc-d8b5-406f-a66b-ae5222d68079 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1408 microversion: 2.20 time: 0.168519 Jul 14 16:10:15.795188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1200/2503] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:15 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1408 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:16.056302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f24e6f27-3cb0-4213-9c0b-21b0e8d7b41b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:16.057010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f24e6f27-3cb0-4213-9c0b-21b0e8d7b41b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:16.063201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f24e6f27-3cb0-4213-9c0b-21b0e8d7b41b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:16.063727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f24e6f27-3cb0-4213-9c0b-21b0e8d7b41b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:16.065001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f24e6f27-3cb0-4213-9c0b-21b0e8d7b41b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:16.065440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f24e6f27-3cb0-4213-9c0b-21b0e8d7b41b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:16.130499 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f24e6f27-3cb0-4213-9c0b-21b0e8d7b41b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:16.138460 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f24e6f27-3cb0-4213-9c0b-21b0e8d7b41b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086936 Jul 14 16:10:16.139023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1304/2504] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:16 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:16.297169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ca42071c-4565-428f-a792-06597b239130 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:16.297694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ca42071c-4565-428f-a792-06597b239130 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:16.304789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca42071c-4565-428f-a792-06597b239130 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:16.305241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca42071c-4565-428f-a792-06597b239130 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:16.305999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca42071c-4565-428f-a792-06597b239130 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:16.306442 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ca42071c-4565-428f-a792-06597b239130 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:16.320337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f3d39536-acee-4a5e-b02c-1c9e608118cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:16.320937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f3d39536-acee-4a5e-b02c-1c9e608118cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:16.326923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3d39536-acee-4a5e-b02c-1c9e608118cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:16.327367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3d39536-acee-4a5e-b02c-1c9e608118cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:16.328147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3d39536-acee-4a5e-b02c-1c9e608118cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:16.328617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f3d39536-acee-4a5e-b02c-1c9e608118cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:16.442057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ca42071c-4565-428f-a792-06597b239130 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:16.452242 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ca42071c-4565-428f-a792-06597b239130 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.158754 Jul 14 16:10:16.452718 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1201/2505] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:16 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:16.469715 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f3d39536-acee-4a5e-b02c-1c9e608118cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:16.479006 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f3d39536-acee-4a5e-b02c-1c9e608118cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.162504 Jul 14 16:10:16.479571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1305/2506] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:16 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:16.813611 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-883e91eb-33f6-4068-b8ca-7028e30f201b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:16.814205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-883e91eb-33f6-4068-b8ca-7028e30f201b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:16.821606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-883e91eb-33f6-4068-b8ca-7028e30f201b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:16.822047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-883e91eb-33f6-4068-b8ca-7028e30f201b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:16.822797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-883e91eb-33f6-4068-b8ca-7028e30f201b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:16.823228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-883e91eb-33f6-4068-b8ca-7028e30f201b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:16.984639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-883e91eb-33f6-4068-b8ca-7028e30f201b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:16.993265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-883e91eb-33f6-4068-b8ca-7028e30f201b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:16.994830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-883e91eb-33f6-4068-b8ca-7028e30f201b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:16.996123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-883e91eb-33f6-4068-b8ca-7028e30f201b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1408 microversion: 2.20 time: 0.186295 Jul 14 16:10:17.004592 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1202/2507] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:16 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:17.157214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ff91e3cf-2762-4ab1-8939-bd3c846c5fab tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:17.158214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ff91e3cf-2762-4ab1-8939-bd3c846c5fab tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:17.165365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ff91e3cf-2762-4ab1-8939-bd3c846c5fab tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:17.165811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ff91e3cf-2762-4ab1-8939-bd3c846c5fab tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:17.166566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ff91e3cf-2762-4ab1-8939-bd3c846c5fab tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:17.166997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ff91e3cf-2762-4ab1-8939-bd3c846c5fab tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:17.261656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ff91e3cf-2762-4ab1-8939-bd3c846c5fab tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:17.271222 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ff91e3cf-2762-4ab1-8939-bd3c846c5fab tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.118846 Jul 14 16:10:17.274894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1306/2508] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:17 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:17.470038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-52a115b7-910c-4ef8-9769-09daca9ae883 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:17.470657 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-52a115b7-910c-4ef8-9769-09daca9ae883 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:17.476956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52a115b7-910c-4ef8-9769-09daca9ae883 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:17.477413 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52a115b7-910c-4ef8-9769-09daca9ae883 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:17.478186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52a115b7-910c-4ef8-9769-09daca9ae883 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:17.478626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52a115b7-910c-4ef8-9769-09daca9ae883 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:17.503413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e200cd9-0db0-44dd-a368-eb1906c789b5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:17.504067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e200cd9-0db0-44dd-a368-eb1906c789b5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:17.510545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e200cd9-0db0-44dd-a368-eb1906c789b5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:17.510991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e200cd9-0db0-44dd-a368-eb1906c789b5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:17.511784 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e200cd9-0db0-44dd-a368-eb1906c789b5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:17.512224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e200cd9-0db0-44dd-a368-eb1906c789b5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:17.617520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-52a115b7-910c-4ef8-9769-09daca9ae883 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:17.625545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-52a115b7-910c-4ef8-9769-09daca9ae883 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.159379 Jul 14 16:10:17.626167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1203/2509] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:17 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:17.646176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e200cd9-0db0-44dd-a368-eb1906c789b5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:17.654228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e200cd9-0db0-44dd-a368-eb1906c789b5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156891 Jul 14 16:10:17.654790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1307/2510] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:17 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:18.013644 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c5b3af46-434e-48b3-93b2-8f9fa415d11c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:18.014234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c5b3af46-434e-48b3-93b2-8f9fa415d11c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:18.021423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c5b3af46-434e-48b3-93b2-8f9fa415d11c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:18.021868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c5b3af46-434e-48b3-93b2-8f9fa415d11c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:18.022621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c5b3af46-434e-48b3-93b2-8f9fa415d11c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:18.023055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c5b3af46-434e-48b3-93b2-8f9fa415d11c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:18.026855 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:18.162157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c5b3af46-434e-48b3-93b2-8f9fa415d11c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:18.170520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c5b3af46-434e-48b3-93b2-8f9fa415d11c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:18.172070 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c5b3af46-434e-48b3-93b2-8f9fa415d11c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:18.173216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c5b3af46-434e-48b3-93b2-8f9fa415d11c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1408 microversion: 2.20 time: 0.163455 Jul 14 16:10:18.173924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1204/2511] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:18 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:18.290081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3bb4197f-6f69-479d-bf97-337675abd726 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:18.290623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3bb4197f-6f69-479d-bf97-337675abd726 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:18.297333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3bb4197f-6f69-479d-bf97-337675abd726 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:18.297781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3bb4197f-6f69-479d-bf97-337675abd726 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:18.299689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3bb4197f-6f69-479d-bf97-337675abd726 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:18.300131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3bb4197f-6f69-479d-bf97-337675abd726 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:18.363861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3bb4197f-6f69-479d-bf97-337675abd726 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:18.371863 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3bb4197f-6f69-479d-bf97-337675abd726 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085754 Jul 14 16:10:18.372716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1308/2512] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:18 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:18.643316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-213a1b6d-c386-4c85-a8b3-eca6695c59ab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:18.643958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-213a1b6d-c386-4c85-a8b3-eca6695c59ab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:18.650353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-213a1b6d-c386-4c85-a8b3-eca6695c59ab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:18.650795 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-213a1b6d-c386-4c85-a8b3-eca6695c59ab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:18.651551 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-213a1b6d-c386-4c85-a8b3-eca6695c59ab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:18.652018 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-213a1b6d-c386-4c85-a8b3-eca6695c59ab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:18.672802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-97f2b07f-5846-41d7-95bb-9e8822597923 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:18.674548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-97f2b07f-5846-41d7-95bb-9e8822597923 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:18.680686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97f2b07f-5846-41d7-95bb-9e8822597923 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:18.681125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97f2b07f-5846-41d7-95bb-9e8822597923 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:18.681877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97f2b07f-5846-41d7-95bb-9e8822597923 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:18.682306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97f2b07f-5846-41d7-95bb-9e8822597923 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:18.797873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-213a1b6d-c386-4c85-a8b3-eca6695c59ab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:18.806809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-213a1b6d-c386-4c85-a8b3-eca6695c59ab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.167393 Jul 14 16:10:18.807398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1205/2513] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:18 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:18.821324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-97f2b07f-5846-41d7-95bb-9e8822597923 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:18.829765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-97f2b07f-5846-41d7-95bb-9e8822597923 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160730 Jul 14 16:10:18.830345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1309/2514] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:18 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:19.192344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9767f09c-92c6-4908-8123-566315a76f89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:19.192936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9767f09c-92c6-4908-8123-566315a76f89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:19.200181 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9767f09c-92c6-4908-8123-566315a76f89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:19.200641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9767f09c-92c6-4908-8123-566315a76f89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:19.201401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9767f09c-92c6-4908-8123-566315a76f89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:19.201834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9767f09c-92c6-4908-8123-566315a76f89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:19.348770 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9767f09c-92c6-4908-8123-566315a76f89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:19.356724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9767f09c-92c6-4908-8123-566315a76f89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:19.358238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9767f09c-92c6-4908-8123-566315a76f89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:19.359351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9767f09c-92c6-4908-8123-566315a76f89 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1408 microversion: 2.20 time: 0.170895 Jul 14 16:10:19.359974 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1206/2515] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:19 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:19.388889 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2b64110c-4ab4-479f-ad78-46ab8384ab86 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:19.389497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2b64110c-4ab4-479f-ad78-46ab8384ab86 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:19.396997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b64110c-4ab4-479f-ad78-46ab8384ab86 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:19.397447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b64110c-4ab4-479f-ad78-46ab8384ab86 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:19.398217 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b64110c-4ab4-479f-ad78-46ab8384ab86 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:19.398650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b64110c-4ab4-479f-ad78-46ab8384ab86 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:19.469306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2b64110c-4ab4-479f-ad78-46ab8384ab86 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:19.479133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2b64110c-4ab4-479f-ad78-46ab8384ab86 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.094245 Jul 14 16:10:19.479742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1310/2516] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:19 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:19.825422 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cca4d340-8746-494a-b75e-7fa7643caa08 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:19.826033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cca4d340-8746-494a-b75e-7fa7643caa08 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:19.833359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cca4d340-8746-494a-b75e-7fa7643caa08 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:19.833815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cca4d340-8746-494a-b75e-7fa7643caa08 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:19.834602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cca4d340-8746-494a-b75e-7fa7643caa08 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:19.835063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cca4d340-8746-494a-b75e-7fa7643caa08 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:19.847146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-545d9a63-10b7-443e-96bd-7a311d8920e9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:19.847792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-545d9a63-10b7-443e-96bd-7a311d8920e9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:19.853855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-545d9a63-10b7-443e-96bd-7a311d8920e9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:19.854312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-545d9a63-10b7-443e-96bd-7a311d8920e9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:19.855075 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-545d9a63-10b7-443e-96bd-7a311d8920e9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:19.855641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-545d9a63-10b7-443e-96bd-7a311d8920e9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:19.979037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cca4d340-8746-494a-b75e-7fa7643caa08 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:19.988359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cca4d340-8746-494a-b75e-7fa7643caa08 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.166794 Jul 14 16:10:19.997859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1207/2517] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:19 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:19.998865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-545d9a63-10b7-443e-96bd-7a311d8920e9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:20.008083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-545d9a63-10b7-443e-96bd-7a311d8920e9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.165431 Jul 14 16:10:20.008639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1311/2518] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:19 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:20.378113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1f0e6659-5131-44e9-9327-22a589778d70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:20.378715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1f0e6659-5131-44e9-9327-22a589778d70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:20.385301 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f0e6659-5131-44e9-9327-22a589778d70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:20.385694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f0e6659-5131-44e9-9327-22a589778d70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:20.386558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f0e6659-5131-44e9-9327-22a589778d70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:20.386993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1f0e6659-5131-44e9-9327-22a589778d70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:20.498472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bd464edc-6f03-4978-88ef-d6ea7b0790f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:20.499359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bd464edc-6f03-4978-88ef-d6ea7b0790f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:20.506683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd464edc-6f03-4978-88ef-d6ea7b0790f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:20.507129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd464edc-6f03-4978-88ef-d6ea7b0790f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:20.507909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd464edc-6f03-4978-88ef-d6ea7b0790f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:20.508345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd464edc-6f03-4978-88ef-d6ea7b0790f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:20.533802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1f0e6659-5131-44e9-9327-22a589778d70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:20.545427 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1f0e6659-5131-44e9-9327-22a589778d70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:20.546936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1f0e6659-5131-44e9-9327-22a589778d70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:20.548625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1f0e6659-5131-44e9-9327-22a589778d70 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1408 microversion: 2.20 time: 0.174402 Jul 14 16:10:20.549182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1208/2519] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:20 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1408 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:20.588443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd464edc-6f03-4978-88ef-d6ea7b0790f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:20.598641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bd464edc-6f03-4978-88ef-d6ea7b0790f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.103706 Jul 14 16:10:20.599232 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1312/2520] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:20 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:21.006033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ced05b2d-1664-43b3-ac30-3be7b597c5da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:21.006642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ced05b2d-1664-43b3-ac30-3be7b597c5da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:21.013210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ced05b2d-1664-43b3-ac30-3be7b597c5da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:21.013668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ced05b2d-1664-43b3-ac30-3be7b597c5da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:21.014432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ced05b2d-1664-43b3-ac30-3be7b597c5da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:21.014875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ced05b2d-1664-43b3-ac30-3be7b597c5da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:21.025468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ef2f43e2-b04a-4665-88d8-2e52876e5c89 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:21.026081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ef2f43e2-b04a-4665-88d8-2e52876e5c89 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:21.033213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef2f43e2-b04a-4665-88d8-2e52876e5c89 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:21.033961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef2f43e2-b04a-4665-88d8-2e52876e5c89 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:21.035033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef2f43e2-b04a-4665-88d8-2e52876e5c89 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:21.035477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef2f43e2-b04a-4665-88d8-2e52876e5c89 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:21.156069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ced05b2d-1664-43b3-ac30-3be7b597c5da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:21.164460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ced05b2d-1664-43b3-ac30-3be7b597c5da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.162259 Jul 14 16:10:21.165036 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1209/2521] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:21 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:21.177597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ef2f43e2-b04a-4665-88d8-2e52876e5c89 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:21.185861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ef2f43e2-b04a-4665-88d8-2e52876e5c89 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.164104 Jul 14 16:10:21.186415 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1313/2522] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:21 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:21.566805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-91dd1d80-2e52-4827-ab07-f5480570bba7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:21.567410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-91dd1d80-2e52-4827-ab07-f5480570bba7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:21.573952 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91dd1d80-2e52-4827-ab07-f5480570bba7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:21.574396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91dd1d80-2e52-4827-ab07-f5480570bba7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:21.575242 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91dd1d80-2e52-4827-ab07-f5480570bba7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:21.575714 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91dd1d80-2e52-4827-ab07-f5480570bba7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:21.616488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6d91758d-02c4-4a22-814b-a5511e3e8d14 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:21.617126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6d91758d-02c4-4a22-814b-a5511e3e8d14 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:21.624751 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6d91758d-02c4-4a22-814b-a5511e3e8d14 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:21.625199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6d91758d-02c4-4a22-814b-a5511e3e8d14 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:21.625967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6d91758d-02c4-4a22-814b-a5511e3e8d14 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:21.627166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6d91758d-02c4-4a22-814b-a5511e3e8d14 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:21.631767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:21.697376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6d91758d-02c4-4a22-814b-a5511e3e8d14 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:21.706441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6d91758d-02c4-4a22-814b-a5511e3e8d14 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.093782 Jul 14 16:10:21.707018 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1314/2523] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:21 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:21.715742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-91dd1d80-2e52-4827-ab07-f5480570bba7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:21.724077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-91dd1d80-2e52-4827-ab07-f5480570bba7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:21.725566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-91dd1d80-2e52-4827-ab07-f5480570bba7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:21.726660 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-91dd1d80-2e52-4827-ab07-f5480570bba7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1408 microversion: 2.20 time: 0.164267 Jul 14 16:10:21.727205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1210/2524] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:21 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:22.182962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e6e16b94-deed-4ef7-9b7c-81480d2569e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:22.183573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e6e16b94-deed-4ef7-9b7c-81480d2569e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:22.183934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:22.185080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=6 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:22.200195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6e16b94-deed-4ef7-9b7c-81480d2569e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:22.200642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6e16b94-deed-4ef7-9b7c-81480d2569e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:22.202013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6e16b94-deed-4ef7-9b7c-81480d2569e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:22.202013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e6e16b94-deed-4ef7-9b7c-81480d2569e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:22.229970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=6 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:22.264711 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-3a536b02-27d0-49d5-9877-d2496e4c46ba req-e7c2011e-564e-463b-844e-2b6ef149d902 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b384c419-d19a-4564-9c70-ae40273487bf", "name": "network-vif-plugged", "status": "completed", "tag": "dfba5691-18bb-4970-9d97-f67ef9081351"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:22.273686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-3a536b02-27d0-49d5-9877-d2496e4c46ba req-e7c2011e-564e-463b-844e-2b6ef149d902 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:22.274220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-3a536b02-27d0-49d5-9877-d2496e4c46ba req-e7c2011e-564e-463b-844e-2b6ef149d902 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:22.286553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-3a536b02-27d0-49d5-9877-d2496e4c46ba req-e7c2011e-564e-463b-844e-2b6ef149d902 service nova] Creating event network-vif-plugged:dfba5691-18bb-4970-9d97-f67ef9081351 for instance b384c419-d19a-4564-9c70-ae40273487bf on hv-cinder-82651 Jul 14 16:10:22.291905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-3a536b02-27d0-49d5-9877-d2496e4c46ba req-e7c2011e-564e-463b-844e-2b6ef149d902 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.112287 Jul 14 16:10:22.292765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1211/2525] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:10:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:10:22.297821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-83aac5a9-3665-4a16-b647-c392a4a76159 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:22.298844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-83aac5a9-3665-4a16-b647-c392a4a76159 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:22.305222 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83aac5a9-3665-4a16-b647-c392a4a76159 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:22.305685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83aac5a9-3665-4a16-b647-c392a4a76159 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:22.306455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83aac5a9-3665-4a16-b647-c392a4a76159 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:22.306998 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-83aac5a9-3665-4a16-b647-c392a4a76159 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:22.367264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e6e16b94-deed-4ef7-9b7c-81480d2569e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:22.377306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e6e16b94-deed-4ef7-9b7c-81480d2569e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.197604 Jul 14 16:10:22.378314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1315/2526] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:22 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:22.481486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-83aac5a9-3665-4a16-b647-c392a4a76159 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:22.489928 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-83aac5a9-3665-4a16-b647-c392a4a76159 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.195993 Jul 14 16:10:22.490710 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1212/2527] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:22 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:22.723240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d940c5da-e57e-4eed-96a2-467b1c8427ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:22.723875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d940c5da-e57e-4eed-96a2-467b1c8427ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:22.730485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d940c5da-e57e-4eed-96a2-467b1c8427ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:22.730943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d940c5da-e57e-4eed-96a2-467b1c8427ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:22.731768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d940c5da-e57e-4eed-96a2-467b1c8427ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:22.732241 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d940c5da-e57e-4eed-96a2-467b1c8427ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:22.744935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0a64292b-7062-410a-8d5a-9876ac19477d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:22.745543 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0a64292b-7062-410a-8d5a-9876ac19477d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:22.753019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a64292b-7062-410a-8d5a-9876ac19477d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:22.753389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a64292b-7062-410a-8d5a-9876ac19477d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:22.754154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a64292b-7062-410a-8d5a-9876ac19477d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:22.754587 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a64292b-7062-410a-8d5a-9876ac19477d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:22.798414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d940c5da-e57e-4eed-96a2-467b1c8427ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:22.807114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d940c5da-e57e-4eed-96a2-467b1c8427ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087946 Jul 14 16:10:22.807714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1316/2528] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:22 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:22.891067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0a64292b-7062-410a-8d5a-9876ac19477d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:22.899995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0a64292b-7062-410a-8d5a-9876ac19477d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:22.901500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0a64292b-7062-410a-8d5a-9876ac19477d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:22.902607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0a64292b-7062-410a-8d5a-9876ac19477d tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1408 microversion: 2.20 time: 0.161605 Jul 14 16:10:22.903163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1213/2529] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:22 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:10:23.394853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e4e41421-98fd-4c25-9d19-692efa0dc1cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:23.395506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e4e41421-98fd-4c25-9d19-692efa0dc1cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:23.401743 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4e41421-98fd-4c25-9d19-692efa0dc1cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:23.402194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4e41421-98fd-4c25-9d19-692efa0dc1cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:23.402969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4e41421-98fd-4c25-9d19-692efa0dc1cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:23.403407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4e41421-98fd-4c25-9d19-692efa0dc1cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:23.507437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1e6058a9-5726-408f-b696-706099916990 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:23.508083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1e6058a9-5726-408f-b696-706099916990 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:23.514389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1e6058a9-5726-408f-b696-706099916990 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:23.515002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1e6058a9-5726-408f-b696-706099916990 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:23.515838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1e6058a9-5726-408f-b696-706099916990 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:23.516320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1e6058a9-5726-408f-b696-706099916990 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:23.542903 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e4e41421-98fd-4c25-9d19-692efa0dc1cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:23.552911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e4e41421-98fd-4c25-9d19-692efa0dc1cc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.162665 Jul 14 16:10:23.553709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1317/2530] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:23 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:23.663247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1e6058a9-5726-408f-b696-706099916990 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:23.672281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1e6058a9-5726-408f-b696-706099916990 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.168655 Jul 14 16:10:23.673384 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1214/2531] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:23 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:23.825147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c71d68e0-d965-421f-a17d-ae4767d61934 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:23.825815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c71d68e0-d965-421f-a17d-ae4767d61934 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:23.832987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c71d68e0-d965-421f-a17d-ae4767d61934 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:23.833436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c71d68e0-d965-421f-a17d-ae4767d61934 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:23.834195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c71d68e0-d965-421f-a17d-ae4767d61934 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:23.834656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c71d68e0-d965-421f-a17d-ae4767d61934 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:23.898846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c71d68e0-d965-421f-a17d-ae4767d61934 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:23.910259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c71d68e0-d965-421f-a17d-ae4767d61934 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.089077 Jul 14 16:10:23.910770 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1318/2532] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:23 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:23.921306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-80d193c8-a432-4e26-8f71-cf357a2c4de4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:23.921956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-80d193c8-a432-4e26-8f71-cf357a2c4de4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:23.929027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80d193c8-a432-4e26-8f71-cf357a2c4de4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:23.929505 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80d193c8-a432-4e26-8f71-cf357a2c4de4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:23.930293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80d193c8-a432-4e26-8f71-cf357a2c4de4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:23.930735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-80d193c8-a432-4e26-8f71-cf357a2c4de4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:24.067897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-80d193c8-a432-4e26-8f71-cf357a2c4de4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:24.075915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-80d193c8-a432-4e26-8f71-cf357a2c4de4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:24.077420 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-80d193c8-a432-4e26-8f71-cf357a2c4de4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:24.078527 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-80d193c8-a432-4e26-8f71-cf357a2c4de4 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1408 microversion: 2.20 time: 0.161559 Jul 14 16:10:24.079094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1215/2533] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:23 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:24.570809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1c6e8eba-ae7a-4f50-b89d-8127b8faa2b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:24.571417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1c6e8eba-ae7a-4f50-b89d-8127b8faa2b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:24.577733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1c6e8eba-ae7a-4f50-b89d-8127b8faa2b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:24.578185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1c6e8eba-ae7a-4f50-b89d-8127b8faa2b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:24.578972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1c6e8eba-ae7a-4f50-b89d-8127b8faa2b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:24.580165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1c6e8eba-ae7a-4f50-b89d-8127b8faa2b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:24.693148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d9c6b25d-9d5b-4757-86eb-3f0143b644a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:24.693986 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d9c6b25d-9d5b-4757-86eb-3f0143b644a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:24.700968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9c6b25d-9d5b-4757-86eb-3f0143b644a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:24.701417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9c6b25d-9d5b-4757-86eb-3f0143b644a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:24.702653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9c6b25d-9d5b-4757-86eb-3f0143b644a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:24.703088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9c6b25d-9d5b-4757-86eb-3f0143b644a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:24.712694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1c6e8eba-ae7a-4f50-b89d-8127b8faa2b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:24.721573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1c6e8eba-ae7a-4f50-b89d-8127b8faa2b1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154634 Jul 14 16:10:24.722048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1319/2534] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:24 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:24.845972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d9c6b25d-9d5b-4757-86eb-3f0143b644a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:24.853899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d9c6b25d-9d5b-4757-86eb-3f0143b644a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.166856 Jul 14 16:10:24.854457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1216/2535] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:24 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:24.927294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f5aeaacb-54db-4bf6-85dd-8307aaff6f94 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:24.927979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f5aeaacb-54db-4bf6-85dd-8307aaff6f94 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:24.934393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5aeaacb-54db-4bf6-85dd-8307aaff6f94 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:24.934834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5aeaacb-54db-4bf6-85dd-8307aaff6f94 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:24.935578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5aeaacb-54db-4bf6-85dd-8307aaff6f94 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:24.936034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5aeaacb-54db-4bf6-85dd-8307aaff6f94 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:25.005072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f5aeaacb-54db-4bf6-85dd-8307aaff6f94 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:25.013471 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f5aeaacb-54db-4bf6-85dd-8307aaff6f94 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.090265 Jul 14 16:10:25.014031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1320/2536] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:24 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:25.097655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f8ba21c5-9fd0-4f2f-a8a4-c6636bec446b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:25.098296 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f8ba21c5-9fd0-4f2f-a8a4-c6636bec446b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:25.104844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8ba21c5-9fd0-4f2f-a8a4-c6636bec446b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:25.105291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8ba21c5-9fd0-4f2f-a8a4-c6636bec446b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:25.106045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8ba21c5-9fd0-4f2f-a8a4-c6636bec446b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:25.106489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8ba21c5-9fd0-4f2f-a8a4-c6636bec446b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:25.245817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f8ba21c5-9fd0-4f2f-a8a4-c6636bec446b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:25.254404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f8ba21c5-9fd0-4f2f-a8a4-c6636bec446b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:25.255854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f8ba21c5-9fd0-4f2f-a8a4-c6636bec446b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:25.257030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f8ba21c5-9fd0-4f2f-a8a4-c6636bec446b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1600 microversion: 2.20 time: 0.163959 Jul 14 16:10:25.257593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1217/2537] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:10:25 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1600 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:10:25.274770 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9c8be5b5-3184-4d62-8bd4-ea5e580862dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:25.275268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9c8be5b5-3184-4d62-8bd4-ea5e580862dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:25.281567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c8be5b5-3184-4d62-8bd4-ea5e580862dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:25.282018 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c8be5b5-3184-4d62-8bd4-ea5e580862dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:25.282852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c8be5b5-3184-4d62-8bd4-ea5e580862dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:25.283318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c8be5b5-3184-4d62-8bd4-ea5e580862dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:25.364870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9c8be5b5-3184-4d62-8bd4-ea5e580862dc tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.093974 Jul 14 16:10:25.365473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1321/2538] 10.222.0.99 () {60 vars in 1315 bytes} [Thu Jul 14 16:10:25 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jul 14 16:10:25.746857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-743e8734-b60a-4fd1-9a71-cd6956cb10ef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:25.747533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-743e8734-b60a-4fd1-9a71-cd6956cb10ef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:25.754894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-743e8734-b60a-4fd1-9a71-cd6956cb10ef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:25.755390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-743e8734-b60a-4fd1-9a71-cd6956cb10ef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:25.756224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-743e8734-b60a-4fd1-9a71-cd6956cb10ef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:25.757735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-743e8734-b60a-4fd1-9a71-cd6956cb10ef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:25.871741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ab1f3192-23a4-4e63-88fe-859cf28bcfa4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:25.873046 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ab1f3192-23a4-4e63-88fe-859cf28bcfa4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:25.879298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ab1f3192-23a4-4e63-88fe-859cf28bcfa4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:25.879795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ab1f3192-23a4-4e63-88fe-859cf28bcfa4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:25.880574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ab1f3192-23a4-4e63-88fe-859cf28bcfa4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:25.881013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ab1f3192-23a4-4e63-88fe-859cf28bcfa4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:25.898304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-743e8734-b60a-4fd1-9a71-cd6956cb10ef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:25.908697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-743e8734-b60a-4fd1-9a71-cd6956cb10ef tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.165843 Jul 14 16:10:25.917159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1218/2539] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:25 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:26.030307 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a4570583-6a91-4f0f-90e1-ba943c29806e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:26.030903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a4570583-6a91-4f0f-90e1-ba943c29806e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:26.038079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a4570583-6a91-4f0f-90e1-ba943c29806e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:26.038529 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a4570583-6a91-4f0f-90e1-ba943c29806e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:26.039297 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a4570583-6a91-4f0f-90e1-ba943c29806e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:26.039773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a4570583-6a91-4f0f-90e1-ba943c29806e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:26.106500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a4570583-6a91-4f0f-90e1-ba943c29806e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:26.114975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a4570583-6a91-4f0f-90e1-ba943c29806e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088470 Jul 14 16:10:26.115564 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1219/2540] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:26 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:26.124521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ab1f3192-23a4-4e63-88fe-859cf28bcfa4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:26.133437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ab1f3192-23a4-4e63-88fe-859cf28bcfa4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.265480 Jul 14 16:10:26.134018 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1322/2541] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:25 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:26.437122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-3276b24d-9f9f-474d-9a2f-2892709202c3 req-b336afc6-aee3-43d4-8a0a-86c99f905c56 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b384c419-d19a-4564-9c70-ae40273487bf", "tag": "dfba5691-18bb-4970-9d97-f67ef9081351"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:10:26.446196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-3276b24d-9f9f-474d-9a2f-2892709202c3 req-b336afc6-aee3-43d4-8a0a-86c99f905c56 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:26.446648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-3276b24d-9f9f-474d-9a2f-2892709202c3 req-b336afc6-aee3-43d4-8a0a-86c99f905c56 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:26.459546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-3276b24d-9f9f-474d-9a2f-2892709202c3 req-b336afc6-aee3-43d4-8a0a-86c99f905c56 service nova] Creating event network-changed:dfba5691-18bb-4970-9d97-f67ef9081351 for instance b384c419-d19a-4564-9c70-ae40273487bf on hv-cinder-82651 Jul 14 16:10:26.464681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-3276b24d-9f9f-474d-9a2f-2892709202c3 req-b336afc6-aee3-43d4-8a0a-86c99f905c56 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031167 Jul 14 16:10:26.465541 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1220/2542] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:10:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:10:26.926139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-214dc629-bbcc-495a-91cc-f4c2666ded65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:26.926752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-214dc629-bbcc-495a-91cc-f4c2666ded65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:26.933599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-214dc629-bbcc-495a-91cc-f4c2666ded65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:26.934365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-214dc629-bbcc-495a-91cc-f4c2666ded65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:26.934737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-214dc629-bbcc-495a-91cc-f4c2666ded65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:26.935483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-214dc629-bbcc-495a-91cc-f4c2666ded65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:27.113781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-214dc629-bbcc-495a-91cc-f4c2666ded65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:27.122387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-214dc629-bbcc-495a-91cc-f4c2666ded65 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.199996 Jul 14 16:10:27.123066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1323/2543] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:26 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:27.139667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-18fd8349-ad63-4d39-9ea7-2b6b3e113b9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:27.140369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-18fd8349-ad63-4d39-9ea7-2b6b3e113b9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:27.148273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-18fd8349-ad63-4d39-9ea7-2b6b3e113b9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:27.148810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-18fd8349-ad63-4d39-9ea7-2b6b3e113b9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:27.149645 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-18fd8349-ad63-4d39-9ea7-2b6b3e113b9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:27.150359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-18fd8349-ad63-4d39-9ea7-2b6b3e113b9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:27.158098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-da03e978-2e7b-4850-ad6e-67551053df36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:27.158707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-da03e978-2e7b-4850-ad6e-67551053df36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:27.174131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da03e978-2e7b-4850-ad6e-67551053df36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:27.174589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da03e978-2e7b-4850-ad6e-67551053df36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:27.175517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da03e978-2e7b-4850-ad6e-67551053df36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:27.176049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da03e978-2e7b-4850-ad6e-67551053df36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:27.233441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-18fd8349-ad63-4d39-9ea7-2b6b3e113b9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:27.243436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-18fd8349-ad63-4d39-9ea7-2b6b3e113b9a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.114307 Jul 14 16:10:27.244050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1221/2544] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:27 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:27.335888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-da03e978-2e7b-4850-ad6e-67551053df36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:27.344312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-da03e978-2e7b-4850-ad6e-67551053df36 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.191178 Jul 14 16:10:27.344931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1324/2545] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:27 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:28.143724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d8229030-abe9-424a-ac66-6a301f33c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:28.144336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d8229030-abe9-424a-ac66-6a301f33c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:28.151152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8229030-abe9-424a-ac66-6a301f33c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:28.151627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8229030-abe9-424a-ac66-6a301f33c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:28.152392 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8229030-abe9-424a-ac66-6a301f33c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:28.152825 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8229030-abe9-424a-ac66-6a301f33c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:28.157004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:28.263081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ac436212-21cf-4628-a7e4-1f1d804dc94d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:28.263703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ac436212-21cf-4628-a7e4-1f1d804dc94d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:28.271532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac436212-21cf-4628-a7e4-1f1d804dc94d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:28.272016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac436212-21cf-4628-a7e4-1f1d804dc94d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:28.273187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac436212-21cf-4628-a7e4-1f1d804dc94d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:28.274014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac436212-21cf-4628-a7e4-1f1d804dc94d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:28.305447 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d8229030-abe9-424a-ac66-6a301f33c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:28.314446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d8229030-abe9-424a-ac66-6a301f33c97c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.174097 Jul 14 16:10:28.315370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1222/2546] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:28 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:28.342648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ac436212-21cf-4628-a7e4-1f1d804dc94d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:28.351866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ac436212-21cf-4628-a7e4-1f1d804dc94d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.094329 Jul 14 16:10:28.352443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1325/2547] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:28 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:28.362578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1bfbb55b-a507-4482-a15d-2d5788e44316 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:28.363260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1bfbb55b-a507-4482-a15d-2d5788e44316 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:28.369320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1bfbb55b-a507-4482-a15d-2d5788e44316 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:28.369779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1bfbb55b-a507-4482-a15d-2d5788e44316 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:28.370585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1bfbb55b-a507-4482-a15d-2d5788e44316 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:28.371019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1bfbb55b-a507-4482-a15d-2d5788e44316 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:28.509047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1bfbb55b-a507-4482-a15d-2d5788e44316 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:28.517390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1bfbb55b-a507-4482-a15d-2d5788e44316 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.159675 Jul 14 16:10:28.517896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1223/2548] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:28 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:29.332986 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4369781a-adf0-41fb-a3ad-05865d2a8b01 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:29.333632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4369781a-adf0-41fb-a3ad-05865d2a8b01 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:29.340390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4369781a-adf0-41fb-a3ad-05865d2a8b01 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:29.340844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4369781a-adf0-41fb-a3ad-05865d2a8b01 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:29.341611 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4369781a-adf0-41fb-a3ad-05865d2a8b01 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:29.342053 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4369781a-adf0-41fb-a3ad-05865d2a8b01 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:29.369483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8128c5c8-af9e-4ad8-b331-fa1f4994ed5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:29.370069 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8128c5c8-af9e-4ad8-b331-fa1f4994ed5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:29.377619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8128c5c8-af9e-4ad8-b331-fa1f4994ed5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:29.378044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8128c5c8-af9e-4ad8-b331-fa1f4994ed5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:29.378849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8128c5c8-af9e-4ad8-b331-fa1f4994ed5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:29.379284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8128c5c8-af9e-4ad8-b331-fa1f4994ed5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:29.446809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8128c5c8-af9e-4ad8-b331-fa1f4994ed5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:29.456548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8128c5c8-af9e-4ad8-b331-fa1f4994ed5d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.090786 Jul 14 16:10:29.457792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1224/2549] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:29 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:29.481862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4369781a-adf0-41fb-a3ad-05865d2a8b01 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:29.495581 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4369781a-adf0-41fb-a3ad-05865d2a8b01 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.167395 Jul 14 16:10:29.496190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1326/2550] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:29 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:29.534487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f264426a-c135-4195-8ca0-c84ac8f0dd18 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:29.535103 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f264426a-c135-4195-8ca0-c84ac8f0dd18 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:29.541227 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f264426a-c135-4195-8ca0-c84ac8f0dd18 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:29.541684 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f264426a-c135-4195-8ca0-c84ac8f0dd18 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:29.542710 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f264426a-c135-4195-8ca0-c84ac8f0dd18 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:29.543154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f264426a-c135-4195-8ca0-c84ac8f0dd18 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:29.679499 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f264426a-c135-4195-8ca0-c84ac8f0dd18 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:29.687863 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f264426a-c135-4195-8ca0-c84ac8f0dd18 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157379 Jul 14 16:10:29.689164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1225/2551] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:29 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:30.474319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d630ef8a-f1ca-4f3c-b7e2-01a67b2dd0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:30.474932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d630ef8a-f1ca-4f3c-b7e2-01a67b2dd0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:30.477304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:30.482726 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d630ef8a-f1ca-4f3c-b7e2-01a67b2dd0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:30.483170 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d630ef8a-f1ca-4f3c-b7e2-01a67b2dd0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:30.483961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d630ef8a-f1ca-4f3c-b7e2-01a67b2dd0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:30.484392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d630ef8a-f1ca-4f3c-b7e2-01a67b2dd0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:30.514120 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9de9486b-63fd-4717-939f-a0ab16bd223a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:30.514944 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9de9486b-63fd-4717-939f-a0ab16bd223a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:30.524038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9de9486b-63fd-4717-939f-a0ab16bd223a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:30.524640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9de9486b-63fd-4717-939f-a0ab16bd223a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:30.525949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9de9486b-63fd-4717-939f-a0ab16bd223a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:30.526409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9de9486b-63fd-4717-939f-a0ab16bd223a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:30.553527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d630ef8a-f1ca-4f3c-b7e2-01a67b2dd0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:30.562293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d630ef8a-f1ca-4f3c-b7e2-01a67b2dd0c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.091881 Jul 14 16:10:30.563111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1327/2552] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:30 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:30.672821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9de9486b-63fd-4717-939f-a0ab16bd223a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:30.681490 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9de9486b-63fd-4717-939f-a0ab16bd223a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.171566 Jul 14 16:10:30.682067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1226/2553] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:30 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:30.707562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d232638a-400e-4378-8c05-ea9b68aad91e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:30.708265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d232638a-400e-4378-8c05-ea9b68aad91e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:30.714642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d232638a-400e-4378-8c05-ea9b68aad91e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:30.715118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d232638a-400e-4378-8c05-ea9b68aad91e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:30.716052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d232638a-400e-4378-8c05-ea9b68aad91e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:30.716576 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d232638a-400e-4378-8c05-ea9b68aad91e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:30.854663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d232638a-400e-4378-8c05-ea9b68aad91e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:30.864206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d232638a-400e-4378-8c05-ea9b68aad91e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160883 Jul 14 16:10:30.864788 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1328/2554] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:30 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:31.580414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-513edc16-218b-41ae-bde9-cecbc1f15388 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:31.581008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-513edc16-218b-41ae-bde9-cecbc1f15388 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:31.587436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-513edc16-218b-41ae-bde9-cecbc1f15388 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:31.587923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-513edc16-218b-41ae-bde9-cecbc1f15388 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:31.588707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-513edc16-218b-41ae-bde9-cecbc1f15388 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:31.589140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-513edc16-218b-41ae-bde9-cecbc1f15388 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:31.658347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-513edc16-218b-41ae-bde9-cecbc1f15388 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:31.666230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-513edc16-218b-41ae-bde9-cecbc1f15388 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.090470 Jul 14 16:10:31.666786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1227/2555] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:31 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:31.700294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d2737092-53e1-4842-9ed4-e6dbc3aa05da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:31.700934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d2737092-53e1-4842-9ed4-e6dbc3aa05da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:31.708361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2737092-53e1-4842-9ed4-e6dbc3aa05da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:31.708808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2737092-53e1-4842-9ed4-e6dbc3aa05da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:31.709567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2737092-53e1-4842-9ed4-e6dbc3aa05da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:31.710032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d2737092-53e1-4842-9ed4-e6dbc3aa05da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:31.845667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d2737092-53e1-4842-9ed4-e6dbc3aa05da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:31.854364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d2737092-53e1-4842-9ed4-e6dbc3aa05da tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.158038 Jul 14 16:10:31.854954 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1329/2556] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:31 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:31.882454 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-332b8626-98a8-4d45-817b-aaa6809801b0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:31.883068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-332b8626-98a8-4d45-817b-aaa6809801b0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:31.889233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-332b8626-98a8-4d45-817b-aaa6809801b0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:31.889681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-332b8626-98a8-4d45-817b-aaa6809801b0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:31.890443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-332b8626-98a8-4d45-817b-aaa6809801b0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:31.890883 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-332b8626-98a8-4d45-817b-aaa6809801b0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:32.022585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-332b8626-98a8-4d45-817b-aaa6809801b0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:32.030758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-332b8626-98a8-4d45-817b-aaa6809801b0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152111 Jul 14 16:10:32.031338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1228/2557] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:31 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:32.683672 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7af39eaf-2801-4537-b6cb-7394e53a89d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:32.684296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7af39eaf-2801-4537-b6cb-7394e53a89d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:32.691563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7af39eaf-2801-4537-b6cb-7394e53a89d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:32.692112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7af39eaf-2801-4537-b6cb-7394e53a89d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:32.692882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7af39eaf-2801-4537-b6cb-7394e53a89d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:32.693324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7af39eaf-2801-4537-b6cb-7394e53a89d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:32.759559 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7af39eaf-2801-4537-b6cb-7394e53a89d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:32.768119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7af39eaf-2801-4537-b6cb-7394e53a89d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088411 Jul 14 16:10:32.768688 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1330/2558] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:32 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:32.872916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-40a1063d-6d9e-4896-9c1d-febb67cfb550 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:32.873554 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-40a1063d-6d9e-4896-9c1d-febb67cfb550 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:32.880430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40a1063d-6d9e-4896-9c1d-febb67cfb550 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:32.880889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40a1063d-6d9e-4896-9c1d-febb67cfb550 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:32.881655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40a1063d-6d9e-4896-9c1d-febb67cfb550 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:32.882097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-40a1063d-6d9e-4896-9c1d-febb67cfb550 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:33.023936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-40a1063d-6d9e-4896-9c1d-febb67cfb550 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:33.033181 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-40a1063d-6d9e-4896-9c1d-febb67cfb550 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.164116 Jul 14 16:10:33.033841 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1229/2559] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:32 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:33.049580 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fcff8d3c-fcd7-4350-82fe-103597caa0f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:33.050196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fcff8d3c-fcd7-4350-82fe-103597caa0f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:33.056489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcff8d3c-fcd7-4350-82fe-103597caa0f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:33.056941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcff8d3c-fcd7-4350-82fe-103597caa0f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:33.057737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcff8d3c-fcd7-4350-82fe-103597caa0f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:33.058176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fcff8d3c-fcd7-4350-82fe-103597caa0f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:33.062512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:33.194313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fcff8d3c-fcd7-4350-82fe-103597caa0f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:33.203730 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fcff8d3c-fcd7-4350-82fe-103597caa0f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158878 Jul 14 16:10:33.205098 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1331/2560] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:33 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:33.785757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-13015399-0de8-4641-9a31-7487df1fe5f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:33.786286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-13015399-0de8-4641-9a31-7487df1fe5f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:33.792877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13015399-0de8-4641-9a31-7487df1fe5f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:33.793323 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13015399-0de8-4641-9a31-7487df1fe5f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:33.794159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13015399-0de8-4641-9a31-7487df1fe5f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:33.794642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-13015399-0de8-4641-9a31-7487df1fe5f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:33.862681 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-13015399-0de8-4641-9a31-7487df1fe5f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:33.870671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-13015399-0de8-4641-9a31-7487df1fe5f8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.089642 Jul 14 16:10:33.871254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1230/2561] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:33 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:34.052527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5e37d8ef-fecd-4121-bda9-332147987c45 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:34.053084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5e37d8ef-fecd-4121-bda9-332147987c45 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:34.059798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5e37d8ef-fecd-4121-bda9-332147987c45 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:34.060250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5e37d8ef-fecd-4121-bda9-332147987c45 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:34.061335 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5e37d8ef-fecd-4121-bda9-332147987c45 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:34.061781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5e37d8ef-fecd-4121-bda9-332147987c45 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:34.207493 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5e37d8ef-fecd-4121-bda9-332147987c45 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:34.215430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5e37d8ef-fecd-4121-bda9-332147987c45 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.167528 Jul 14 16:10:34.216037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1332/2562] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:34 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:34.223967 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-934ce332-97f6-4698-bce2-e1362113744f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:34.224616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-934ce332-97f6-4698-bce2-e1362113744f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:34.231117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-934ce332-97f6-4698-bce2-e1362113744f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:34.231576 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-934ce332-97f6-4698-bce2-e1362113744f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:34.232381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-934ce332-97f6-4698-bce2-e1362113744f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:34.232823 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-934ce332-97f6-4698-bce2-e1362113744f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:34.369581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-934ce332-97f6-4698-bce2-e1362113744f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:34.379010 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-934ce332-97f6-4698-bce2-e1362113744f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158991 Jul 14 16:10:34.379588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1231/2563] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:34 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:34.888913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0b9364a8-c714-4fcf-a736-7abbd3c0963f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:34.889590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0b9364a8-c714-4fcf-a736-7abbd3c0963f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:34.895860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b9364a8-c714-4fcf-a736-7abbd3c0963f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:34.896302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b9364a8-c714-4fcf-a736-7abbd3c0963f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:34.897060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b9364a8-c714-4fcf-a736-7abbd3c0963f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:34.897488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b9364a8-c714-4fcf-a736-7abbd3c0963f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:34.966995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0b9364a8-c714-4fcf-a736-7abbd3c0963f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:34.977894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0b9364a8-c714-4fcf-a736-7abbd3c0963f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.092621 Jul 14 16:10:34.978639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1333/2564] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:34 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:35.234965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c16d6a7a-a3fc-490c-ad46-2d9db2407934 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:35.236311 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c16d6a7a-a3fc-490c-ad46-2d9db2407934 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:35.243229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c16d6a7a-a3fc-490c-ad46-2d9db2407934 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:35.243735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c16d6a7a-a3fc-490c-ad46-2d9db2407934 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:35.244558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c16d6a7a-a3fc-490c-ad46-2d9db2407934 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:35.245104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c16d6a7a-a3fc-490c-ad46-2d9db2407934 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:35.384248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c16d6a7a-a3fc-490c-ad46-2d9db2407934 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:35.393208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c16d6a7a-a3fc-490c-ad46-2d9db2407934 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.163776 Jul 14 16:10:35.393798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1232/2565] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:35 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:35.397779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-049278ad-ed02-465e-aa19-840c9df6f64a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:35.398853 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-049278ad-ed02-465e-aa19-840c9df6f64a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:35.406425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-049278ad-ed02-465e-aa19-840c9df6f64a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:35.406872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-049278ad-ed02-465e-aa19-840c9df6f64a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:35.407702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-049278ad-ed02-465e-aa19-840c9df6f64a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:35.408141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-049278ad-ed02-465e-aa19-840c9df6f64a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:35.554580 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-049278ad-ed02-465e-aa19-840c9df6f64a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:35.562796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-049278ad-ed02-465e-aa19-840c9df6f64a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.170497 Jul 14 16:10:35.564031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1334/2566] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:35 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:36.000677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bba62743-646d-444e-9517-d48b93d670df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:36.001488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bba62743-646d-444e-9517-d48b93d670df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:36.008305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bba62743-646d-444e-9517-d48b93d670df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:36.009277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bba62743-646d-444e-9517-d48b93d670df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:36.009782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bba62743-646d-444e-9517-d48b93d670df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:36.010254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bba62743-646d-444e-9517-d48b93d670df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:36.078203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bba62743-646d-444e-9517-d48b93d670df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:36.087224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bba62743-646d-444e-9517-d48b93d670df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.090521 Jul 14 16:10:36.087828 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1233/2567] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:35 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:36.410830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cbf3c73f-a660-477b-b7cc-5daf3d79beac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:36.412283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cbf3c73f-a660-477b-b7cc-5daf3d79beac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:36.419214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cbf3c73f-a660-477b-b7cc-5daf3d79beac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:36.419687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cbf3c73f-a660-477b-b7cc-5daf3d79beac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:36.420450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cbf3c73f-a660-477b-b7cc-5daf3d79beac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:36.420887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cbf3c73f-a660-477b-b7cc-5daf3d79beac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:36.568521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cbf3c73f-a660-477b-b7cc-5daf3d79beac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:36.576501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cbf3c73f-a660-477b-b7cc-5daf3d79beac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.169534 Jul 14 16:10:36.577066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1335/2568] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:36 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:36.582733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d9d4b85f-6a92-4caf-8a15-b37fb0c0d4a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:36.583342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d9d4b85f-6a92-4caf-8a15-b37fb0c0d4a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:36.589903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9d4b85f-6a92-4caf-8a15-b37fb0c0d4a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:36.590353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9d4b85f-6a92-4caf-8a15-b37fb0c0d4a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:36.591104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9d4b85f-6a92-4caf-8a15-b37fb0c0d4a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:36.591535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9d4b85f-6a92-4caf-8a15-b37fb0c0d4a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:36.725791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d9d4b85f-6a92-4caf-8a15-b37fb0c0d4a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:36.733683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d9d4b85f-6a92-4caf-8a15-b37fb0c0d4a8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155913 Jul 14 16:10:36.734239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1234/2569] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:36 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:37.104839 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-90ba7c71-5340-421b-97e3-2e17c0d62386 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:37.105486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-90ba7c71-5340-421b-97e3-2e17c0d62386 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:37.112751 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90ba7c71-5340-421b-97e3-2e17c0d62386 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:37.113196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90ba7c71-5340-421b-97e3-2e17c0d62386 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:37.113947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90ba7c71-5340-421b-97e3-2e17c0d62386 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:37.114389 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-90ba7c71-5340-421b-97e3-2e17c0d62386 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:37.180649 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-90ba7c71-5340-421b-97e3-2e17c0d62386 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:37.188660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-90ba7c71-5340-421b-97e3-2e17c0d62386 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087709 Jul 14 16:10:37.189223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1336/2570] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:37 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:37.595076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-078ffe48-0397-4f5d-8bc2-d33fedaf4548 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:37.596014 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-078ffe48-0397-4f5d-8bc2-d33fedaf4548 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:37.602247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-078ffe48-0397-4f5d-8bc2-d33fedaf4548 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:37.602694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-078ffe48-0397-4f5d-8bc2-d33fedaf4548 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:37.603447 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-078ffe48-0397-4f5d-8bc2-d33fedaf4548 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:37.603918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-078ffe48-0397-4f5d-8bc2-d33fedaf4548 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:37.743419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-078ffe48-0397-4f5d-8bc2-d33fedaf4548 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:37.750262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-095237c8-0041-4a1d-a16a-dd696dc1b4cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:37.750917 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-095237c8-0041-4a1d-a16a-dd696dc1b4cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:37.751876 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-078ffe48-0397-4f5d-8bc2-d33fedaf4548 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.161222 Jul 14 16:10:37.752441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1235/2571] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:37 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:37.757494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-095237c8-0041-4a1d-a16a-dd696dc1b4cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:37.757947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-095237c8-0041-4a1d-a16a-dd696dc1b4cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:37.758711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-095237c8-0041-4a1d-a16a-dd696dc1b4cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:37.759150 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-095237c8-0041-4a1d-a16a-dd696dc1b4cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:37.890212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-095237c8-0041-4a1d-a16a-dd696dc1b4cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:37.898785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-095237c8-0041-4a1d-a16a-dd696dc1b4cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152429 Jul 14 16:10:37.899367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1337/2572] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:37 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:38.206018 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d65f96a7-738f-410c-9350-a9dad89bbfb0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:38.206736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d65f96a7-738f-410c-9350-a9dad89bbfb0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:38.212718 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d65f96a7-738f-410c-9350-a9dad89bbfb0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:38.213172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d65f96a7-738f-410c-9350-a9dad89bbfb0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:38.213939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d65f96a7-738f-410c-9350-a9dad89bbfb0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:38.214468 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d65f96a7-738f-410c-9350-a9dad89bbfb0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:38.283942 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d65f96a7-738f-410c-9350-a9dad89bbfb0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:38.291959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d65f96a7-738f-410c-9350-a9dad89bbfb0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.090456 Jul 14 16:10:38.292789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1236/2573] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:38 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:38.770398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cff46631-b6c5-4491-8c9e-7225807703a2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:38.770965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cff46631-b6c5-4491-8c9e-7225807703a2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:38.777572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cff46631-b6c5-4491-8c9e-7225807703a2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:38.778047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cff46631-b6c5-4491-8c9e-7225807703a2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:38.778832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cff46631-b6c5-4491-8c9e-7225807703a2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:38.779239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cff46631-b6c5-4491-8c9e-7225807703a2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:38.916655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6af75051-31f0-436c-a321-998693e83751 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:38.917279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6af75051-31f0-436c-a321-998693e83751 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:38.920841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cff46631-b6c5-4491-8c9e-7225807703a2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:38.924915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6af75051-31f0-436c-a321-998693e83751 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:38.925362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6af75051-31f0-436c-a321-998693e83751 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:38.926129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6af75051-31f0-436c-a321-998693e83751 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:38.926563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6af75051-31f0-436c-a321-998693e83751 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:38.937881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cff46631-b6c5-4491-8c9e-7225807703a2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.172384 Jul 14 16:10:38.939128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1338/2574] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:38 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:39.061573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6af75051-31f0-436c-a321-998693e83751 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:39.070732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6af75051-31f0-436c-a321-998693e83751 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157890 Jul 14 16:10:39.071311 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1237/2575] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:38 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:39.309912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-73de20ca-448d-47cc-9441-38da6dd23d0a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:39.310438 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-73de20ca-448d-47cc-9441-38da6dd23d0a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:39.317895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73de20ca-448d-47cc-9441-38da6dd23d0a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:39.318352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73de20ca-448d-47cc-9441-38da6dd23d0a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:39.319153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73de20ca-448d-47cc-9441-38da6dd23d0a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:39.319648 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73de20ca-448d-47cc-9441-38da6dd23d0a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:39.384775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-73de20ca-448d-47cc-9441-38da6dd23d0a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:39.393189 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-73de20ca-448d-47cc-9441-38da6dd23d0a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087306 Jul 14 16:10:39.393958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1339/2576] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:39 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:39.959578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-06d5eb08-e4d9-4e77-9c68-9b3ea41c1950 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:39.960209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-06d5eb08-e4d9-4e77-9c68-9b3ea41c1950 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:39.966898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06d5eb08-e4d9-4e77-9c68-9b3ea41c1950 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:39.967378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06d5eb08-e4d9-4e77-9c68-9b3ea41c1950 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:39.968190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06d5eb08-e4d9-4e77-9c68-9b3ea41c1950 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:39.968638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-06d5eb08-e4d9-4e77-9c68-9b3ea41c1950 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:40.089613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b03dc024-319c-4faa-93b3-7010d7074194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:40.090585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b03dc024-319c-4faa-93b3-7010d7074194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:40.097437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b03dc024-319c-4faa-93b3-7010d7074194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:40.097890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b03dc024-319c-4faa-93b3-7010d7074194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:40.098670 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b03dc024-319c-4faa-93b3-7010d7074194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:40.099108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b03dc024-319c-4faa-93b3-7010d7074194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:40.101601 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-06d5eb08-e4d9-4e77-9c68-9b3ea41c1950 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:40.105097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:40.110789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-06d5eb08-e4d9-4e77-9c68-9b3ea41c1950 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155028 Jul 14 16:10:40.111483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1238/2577] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:39 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:40.238479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b03dc024-319c-4faa-93b3-7010d7074194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:40.246511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b03dc024-319c-4faa-93b3-7010d7074194 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161062 Jul 14 16:10:40.247083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1340/2578] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:40 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:40.410914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0c5445d1-28ed-460c-a300-9df898c5e942 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:40.411527 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0c5445d1-28ed-460c-a300-9df898c5e942 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:40.417961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c5445d1-28ed-460c-a300-9df898c5e942 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:40.418399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c5445d1-28ed-460c-a300-9df898c5e942 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:40.419369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c5445d1-28ed-460c-a300-9df898c5e942 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:40.419656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0c5445d1-28ed-460c-a300-9df898c5e942 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:40.490988 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0c5445d1-28ed-460c-a300-9df898c5e942 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:40.499046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0c5445d1-28ed-460c-a300-9df898c5e942 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.092792 Jul 14 16:10:40.499639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1239/2579] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:40 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:41.127898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c144b0ad-0a6e-4c8a-9f7c-be718ed071b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:41.128505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c144b0ad-0a6e-4c8a-9f7c-be718ed071b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:41.135033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c144b0ad-0a6e-4c8a-9f7c-be718ed071b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:41.135480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c144b0ad-0a6e-4c8a-9f7c-be718ed071b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:41.136265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c144b0ad-0a6e-4c8a-9f7c-be718ed071b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:41.136790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c144b0ad-0a6e-4c8a-9f7c-be718ed071b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:41.264314 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-418baee2-5b77-49c5-80d6-02437f6e3036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:41.265054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-418baee2-5b77-49c5-80d6-02437f6e3036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:41.271696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-418baee2-5b77-49c5-80d6-02437f6e3036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:41.272147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-418baee2-5b77-49c5-80d6-02437f6e3036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:41.272910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-418baee2-5b77-49c5-80d6-02437f6e3036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:41.273345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-418baee2-5b77-49c5-80d6-02437f6e3036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:41.273485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c144b0ad-0a6e-4c8a-9f7c-be718ed071b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:41.281738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c144b0ad-0a6e-4c8a-9f7c-be718ed071b5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157988 Jul 14 16:10:41.283070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1341/2580] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:41 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:41.414372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-418baee2-5b77-49c5-80d6-02437f6e3036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:41.424004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-418baee2-5b77-49c5-80d6-02437f6e3036 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.162868 Jul 14 16:10:41.424606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1240/2581] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:41 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:41.517729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cb234057-f8fd-4e0f-9b52-0ef58ab75568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:41.518324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cb234057-f8fd-4e0f-9b52-0ef58ab75568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:41.525626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cb234057-f8fd-4e0f-9b52-0ef58ab75568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:41.526422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cb234057-f8fd-4e0f-9b52-0ef58ab75568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:41.527813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cb234057-f8fd-4e0f-9b52-0ef58ab75568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:41.528269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cb234057-f8fd-4e0f-9b52-0ef58ab75568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:41.596139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cb234057-f8fd-4e0f-9b52-0ef58ab75568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:41.604177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cb234057-f8fd-4e0f-9b52-0ef58ab75568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.090819 Jul 14 16:10:41.604752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1342/2582] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:41 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:42.302182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-93377e10-aa66-4379-88c0-151c5ea50951 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:42.302738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-93377e10-aa66-4379-88c0-151c5ea50951 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:42.309691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93377e10-aa66-4379-88c0-151c5ea50951 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:42.310147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93377e10-aa66-4379-88c0-151c5ea50951 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:42.310905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93377e10-aa66-4379-88c0-151c5ea50951 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:42.311347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-93377e10-aa66-4379-88c0-151c5ea50951 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:42.442039 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f7a0db2b-36a4-4283-9d3d-935c05850012 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:42.442652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f7a0db2b-36a4-4283-9d3d-935c05850012 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:42.449024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f7a0db2b-36a4-4283-9d3d-935c05850012 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:42.449476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f7a0db2b-36a4-4283-9d3d-935c05850012 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:42.450230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f7a0db2b-36a4-4283-9d3d-935c05850012 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:42.450365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-93377e10-aa66-4379-88c0-151c5ea50951 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:42.450728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f7a0db2b-36a4-4283-9d3d-935c05850012 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:42.460938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-93377e10-aa66-4379-88c0-151c5ea50951 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.163709 Jul 14 16:10:42.461516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1241/2583] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:42 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:42.623042 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-47e00189-cde7-44d0-90b7-c1606497584d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:42.623580 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-47e00189-cde7-44d0-90b7-c1606497584d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:42.630987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-47e00189-cde7-44d0-90b7-c1606497584d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:42.631447 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-47e00189-cde7-44d0-90b7-c1606497584d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:42.632262 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-47e00189-cde7-44d0-90b7-c1606497584d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:42.632703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-47e00189-cde7-44d0-90b7-c1606497584d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:42.703320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-47e00189-cde7-44d0-90b7-c1606497584d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:42.711589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-47e00189-cde7-44d0-90b7-c1606497584d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.092555 Jul 14 16:10:42.712193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1242/2584] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:42 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:42.833354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f7a0db2b-36a4-4283-9d3d-935c05850012 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:42.841637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f7a0db2b-36a4-4283-9d3d-935c05850012 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.404261 Jul 14 16:10:42.842204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1343/2585] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:42 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:43.478609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a7ecf4c5-27c4-47cd-8ded-ebe2370327c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:43.479967 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a7ecf4c5-27c4-47cd-8ded-ebe2370327c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:43.486567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a7ecf4c5-27c4-47cd-8ded-ebe2370327c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:43.486943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a7ecf4c5-27c4-47cd-8ded-ebe2370327c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:43.487740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a7ecf4c5-27c4-47cd-8ded-ebe2370327c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:43.488175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a7ecf4c5-27c4-47cd-8ded-ebe2370327c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:43.618711 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a7ecf4c5-27c4-47cd-8ded-ebe2370327c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:43.627453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a7ecf4c5-27c4-47cd-8ded-ebe2370327c5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152939 Jul 14 16:10:43.628056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1243/2586] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:43 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:43.729103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-28d766a3-8faf-49de-b906-3a14543bccde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:43.729749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-28d766a3-8faf-49de-b906-3a14543bccde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:43.736735 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28d766a3-8faf-49de-b906-3a14543bccde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:43.737183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28d766a3-8faf-49de-b906-3a14543bccde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:43.737948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28d766a3-8faf-49de-b906-3a14543bccde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:43.738379 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-28d766a3-8faf-49de-b906-3a14543bccde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:43.802019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-28d766a3-8faf-49de-b906-3a14543bccde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:43.809867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-28d766a3-8faf-49de-b906-3a14543bccde tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084592 Jul 14 16:10:43.810428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1344/2587] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:43 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:43.859181 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2ee3eb89-6c07-4ccf-b7e2-9b8cb8b7a772 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:43.859833 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2ee3eb89-6c07-4ccf-b7e2-9b8cb8b7a772 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:43.861992 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=98 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:43.867422 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2ee3eb89-6c07-4ccf-b7e2-9b8cb8b7a772 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:43.868026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2ee3eb89-6c07-4ccf-b7e2-9b8cb8b7a772 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:43.868835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2ee3eb89-6c07-4ccf-b7e2-9b8cb8b7a772 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:43.869278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2ee3eb89-6c07-4ccf-b7e2-9b8cb8b7a772 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:44.005899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2ee3eb89-6c07-4ccf-b7e2-9b8cb8b7a772 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:44.014105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2ee3eb89-6c07-4ccf-b7e2-9b8cb8b7a772 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158931 Jul 14 16:10:44.014747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1244/2588] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:43 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:44.644698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c1730f05-b630-4e68-a73a-7f087dd3b2b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:44.645395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c1730f05-b630-4e68-a73a-7f087dd3b2b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:44.651832 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c1730f05-b630-4e68-a73a-7f087dd3b2b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:44.652298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c1730f05-b630-4e68-a73a-7f087dd3b2b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:44.653502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c1730f05-b630-4e68-a73a-7f087dd3b2b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:44.653947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c1730f05-b630-4e68-a73a-7f087dd3b2b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:44.789487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c1730f05-b630-4e68-a73a-7f087dd3b2b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:44.798973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c1730f05-b630-4e68-a73a-7f087dd3b2b2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157962 Jul 14 16:10:44.799780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1345/2589] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:44 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:44.828928 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e3e47487-39c2-47c5-94ae-4d0c2df9d9df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:44.829679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e3e47487-39c2-47c5-94ae-4d0c2df9d9df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:44.836229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e3e47487-39c2-47c5-94ae-4d0c2df9d9df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:44.836686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e3e47487-39c2-47c5-94ae-4d0c2df9d9df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:44.837458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e3e47487-39c2-47c5-94ae-4d0c2df9d9df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:44.837901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e3e47487-39c2-47c5-94ae-4d0c2df9d9df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:44.920950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e3e47487-39c2-47c5-94ae-4d0c2df9d9df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:44.930298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e3e47487-39c2-47c5-94ae-4d0c2df9d9df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.105257 Jul 14 16:10:44.930918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1245/2590] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:44 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:45.032333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bf7f46b4-83c4-4906-bea6-0a8084ddaf38 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:45.032955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bf7f46b4-83c4-4906-bea6-0a8084ddaf38 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:45.038993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bf7f46b4-83c4-4906-bea6-0a8084ddaf38 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:45.039444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bf7f46b4-83c4-4906-bea6-0a8084ddaf38 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:45.040265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bf7f46b4-83c4-4906-bea6-0a8084ddaf38 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:45.040703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bf7f46b4-83c4-4906-bea6-0a8084ddaf38 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:45.171454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bf7f46b4-83c4-4906-bea6-0a8084ddaf38 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:45.180230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bf7f46b4-83c4-4906-bea6-0a8084ddaf38 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152258 Jul 14 16:10:45.180801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1346/2591] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:45 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:45.817042 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-45067a4d-b9d3-416a-86e4-0b0799d3ee56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:45.817658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-45067a4d-b9d3-416a-86e4-0b0799d3ee56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:45.823996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45067a4d-b9d3-416a-86e4-0b0799d3ee56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:45.824458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45067a4d-b9d3-416a-86e4-0b0799d3ee56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:45.825233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45067a4d-b9d3-416a-86e4-0b0799d3ee56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:45.825678 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45067a4d-b9d3-416a-86e4-0b0799d3ee56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:45.948188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-70f1f518-6fec-4158-ae3a-51a6241c32dd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:45.948905 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-70f1f518-6fec-4158-ae3a-51a6241c32dd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:45.956704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70f1f518-6fec-4158-ae3a-51a6241c32dd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:45.957155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70f1f518-6fec-4158-ae3a-51a6241c32dd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:45.957924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70f1f518-6fec-4158-ae3a-51a6241c32dd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:45.958364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70f1f518-6fec-4158-ae3a-51a6241c32dd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:45.962034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-45067a4d-b9d3-416a-86e4-0b0799d3ee56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:45.970323 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-45067a4d-b9d3-416a-86e4-0b0799d3ee56 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157649 Jul 14 16:10:45.971002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1246/2592] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:45 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:46.023719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-70f1f518-6fec-4158-ae3a-51a6241c32dd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:46.027221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:46.033691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-70f1f518-6fec-4158-ae3a-51a6241c32dd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.089358 Jul 14 16:10:46.034269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1347/2593] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:45 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:46.198104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-24114788-9e64-42d4-ac5f-0d93b1589b5c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:46.198718 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-24114788-9e64-42d4-ac5f-0d93b1589b5c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:46.204909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-24114788-9e64-42d4-ac5f-0d93b1589b5c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:46.205359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-24114788-9e64-42d4-ac5f-0d93b1589b5c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:46.206128 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-24114788-9e64-42d4-ac5f-0d93b1589b5c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:46.206733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-24114788-9e64-42d4-ac5f-0d93b1589b5c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:46.345947 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-24114788-9e64-42d4-ac5f-0d93b1589b5c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:46.353996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-24114788-9e64-42d4-ac5f-0d93b1589b5c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.159742 Jul 14 16:10:46.354571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1247/2594] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:46 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:46.988263 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-89ea64ea-ca77-451b-afdc-f74b2f0c2828 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:46.988870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-89ea64ea-ca77-451b-afdc-f74b2f0c2828 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:46.995827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89ea64ea-ca77-451b-afdc-f74b2f0c2828 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:46.996270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89ea64ea-ca77-451b-afdc-f74b2f0c2828 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:46.997041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89ea64ea-ca77-451b-afdc-f74b2f0c2828 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:46.997471 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-89ea64ea-ca77-451b-afdc-f74b2f0c2828 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:47.050554 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3c4e9ab9-0f14-4211-8693-b7b802dfcd48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:47.051180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3c4e9ab9-0f14-4211-8693-b7b802dfcd48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:47.058047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c4e9ab9-0f14-4211-8693-b7b802dfcd48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:47.058493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c4e9ab9-0f14-4211-8693-b7b802dfcd48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:47.059266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c4e9ab9-0f14-4211-8693-b7b802dfcd48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:47.059736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3c4e9ab9-0f14-4211-8693-b7b802dfcd48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:47.124571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3c4e9ab9-0f14-4211-8693-b7b802dfcd48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:47.133364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3c4e9ab9-0f14-4211-8693-b7b802dfcd48 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086842 Jul 14 16:10:47.133959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1248/2595] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:47 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:47.139801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-89ea64ea-ca77-451b-afdc-f74b2f0c2828 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:47.148405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-89ea64ea-ca77-451b-afdc-f74b2f0c2828 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.164127 Jul 14 16:10:47.148964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1348/2596] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:46 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:47.372427 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-be675ad6-7ba5-40b5-b9cc-ed7da5ea450f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:47.373085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-be675ad6-7ba5-40b5-b9cc-ed7da5ea450f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:47.379874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-be675ad6-7ba5-40b5-b9cc-ed7da5ea450f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:47.380326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-be675ad6-7ba5-40b5-b9cc-ed7da5ea450f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:47.381089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-be675ad6-7ba5-40b5-b9cc-ed7da5ea450f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:47.381524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-be675ad6-7ba5-40b5-b9cc-ed7da5ea450f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:47.513211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-be675ad6-7ba5-40b5-b9cc-ed7da5ea450f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:47.521782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-be675ad6-7ba5-40b5-b9cc-ed7da5ea450f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153454 Jul 14 16:10:47.522359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1249/2597] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:47 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:48.151700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-301a9ce7-6f3b-490f-a2cc-87668e204860 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:48.152347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-301a9ce7-6f3b-490f-a2cc-87668e204860 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:48.159656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-301a9ce7-6f3b-490f-a2cc-87668e204860 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:48.160118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-301a9ce7-6f3b-490f-a2cc-87668e204860 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:48.160874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-301a9ce7-6f3b-490f-a2cc-87668e204860 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:48.161307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-301a9ce7-6f3b-490f-a2cc-87668e204860 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:48.165061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-183e9161-df65-4048-893c-e2d6a0fa1baa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:48.165684 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-183e9161-df65-4048-893c-e2d6a0fa1baa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:48.172432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-183e9161-df65-4048-893c-e2d6a0fa1baa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:48.172891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-183e9161-df65-4048-893c-e2d6a0fa1baa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:48.173665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-183e9161-df65-4048-893c-e2d6a0fa1baa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:48.174106 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-183e9161-df65-4048-893c-e2d6a0fa1baa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:48.226536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-301a9ce7-6f3b-490f-a2cc-87668e204860 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:48.235444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-301a9ce7-6f3b-490f-a2cc-87668e204860 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087220 Jul 14 16:10:48.236313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1349/2598] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:48 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:48.310926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-183e9161-df65-4048-893c-e2d6a0fa1baa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:48.318916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-183e9161-df65-4048-893c-e2d6a0fa1baa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157718 Jul 14 16:10:48.319475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1250/2599] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:48 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:48.539191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-eeebec24-56f4-49df-9c93-3ee1de407ffd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:48.539758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eeebec24-56f4-49df-9c93-3ee1de407ffd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:48.546148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eeebec24-56f4-49df-9c93-3ee1de407ffd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:48.546593 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eeebec24-56f4-49df-9c93-3ee1de407ffd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:48.547355 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eeebec24-56f4-49df-9c93-3ee1de407ffd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:48.547817 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eeebec24-56f4-49df-9c93-3ee1de407ffd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:48.681180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-eeebec24-56f4-49df-9c93-3ee1de407ffd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:48.689902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-eeebec24-56f4-49df-9c93-3ee1de407ffd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154636 Jul 14 16:10:48.690474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1350/2600] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:48 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:49.253368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d3a02cc9-7858-4a31-9f80-7bd257560c23 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:49.253897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d3a02cc9-7858-4a31-9f80-7bd257560c23 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:49.261096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d3a02cc9-7858-4a31-9f80-7bd257560c23 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:49.261096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d3a02cc9-7858-4a31-9f80-7bd257560c23 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:49.261842 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d3a02cc9-7858-4a31-9f80-7bd257560c23 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:49.262282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d3a02cc9-7858-4a31-9f80-7bd257560c23 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:49.326428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d3a02cc9-7858-4a31-9f80-7bd257560c23 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:49.334804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d3a02cc9-7858-4a31-9f80-7bd257560c23 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086108 Jul 14 16:10:49.335379 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1251/2601] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:49 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:49.335833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9652dc80-4bf9-4c59-ab9a-c25377eec472 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:49.336523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9652dc80-4bf9-4c59-ab9a-c25377eec472 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:49.343008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9652dc80-4bf9-4c59-ab9a-c25377eec472 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:49.343457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9652dc80-4bf9-4c59-ab9a-c25377eec472 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:49.344802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9652dc80-4bf9-4c59-ab9a-c25377eec472 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:49.345250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9652dc80-4bf9-4c59-ab9a-c25377eec472 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:49.480803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9652dc80-4bf9-4c59-ab9a-c25377eec472 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:49.489394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9652dc80-4bf9-4c59-ab9a-c25377eec472 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157466 Jul 14 16:10:49.489968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1351/2602] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:49 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:49.707864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d9d08ce9-d48d-41a6-a652-ad1b9d54b48c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:49.708478 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d9d08ce9-d48d-41a6-a652-ad1b9d54b48c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:49.714469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9d08ce9-d48d-41a6-a652-ad1b9d54b48c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:49.714918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9d08ce9-d48d-41a6-a652-ad1b9d54b48c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:49.715723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9d08ce9-d48d-41a6-a652-ad1b9d54b48c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:49.716164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9d08ce9-d48d-41a6-a652-ad1b9d54b48c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:49.846907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d9d08ce9-d48d-41a6-a652-ad1b9d54b48c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:49.854788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d9d08ce9-d48d-41a6-a652-ad1b9d54b48c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151426 Jul 14 16:10:49.855349 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1252/2603] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:49 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:50.351432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b30e67d0-6c9f-4d57-8fae-38f02078368f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:50.352093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b30e67d0-6c9f-4d57-8fae-38f02078368f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:50.358603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b30e67d0-6c9f-4d57-8fae-38f02078368f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:50.359079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b30e67d0-6c9f-4d57-8fae-38f02078368f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:50.359894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b30e67d0-6c9f-4d57-8fae-38f02078368f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:50.360533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b30e67d0-6c9f-4d57-8fae-38f02078368f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:50.422517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b30e67d0-6c9f-4d57-8fae-38f02078368f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:50.430331 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b30e67d0-6c9f-4d57-8fae-38f02078368f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.082771 Jul 14 16:10:50.430888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1352/2604] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:50 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:50.507582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f456c9f1-7c02-41ee-bdd3-86bf75633b30 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:50.508219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f456c9f1-7c02-41ee-bdd3-86bf75633b30 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:50.515056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f456c9f1-7c02-41ee-bdd3-86bf75633b30 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:50.515510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f456c9f1-7c02-41ee-bdd3-86bf75633b30 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:50.516584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f456c9f1-7c02-41ee-bdd3-86bf75633b30 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:50.517143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f456c9f1-7c02-41ee-bdd3-86bf75633b30 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:50.651186 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f456c9f1-7c02-41ee-bdd3-86bf75633b30 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:50.659756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f456c9f1-7c02-41ee-bdd3-86bf75633b30 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.156199 Jul 14 16:10:50.660330 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1253/2605] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:50 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:50.872480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c6300cbf-0057-47ef-9c0c-ad0758ffdf01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:50.873008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c6300cbf-0057-47ef-9c0c-ad0758ffdf01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:50.879737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c6300cbf-0057-47ef-9c0c-ad0758ffdf01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:50.880188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c6300cbf-0057-47ef-9c0c-ad0758ffdf01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:50.880989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c6300cbf-0057-47ef-9c0c-ad0758ffdf01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:50.881426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c6300cbf-0057-47ef-9c0c-ad0758ffdf01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:51.012616 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c6300cbf-0057-47ef-9c0c-ad0758ffdf01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:51.021169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c6300cbf-0057-47ef-9c0c-ad0758ffdf01 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152704 Jul 14 16:10:51.021736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1353/2606] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:50 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:51.447773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8d614308-4d58-4ed1-928e-8ee97aba8095 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:51.448390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8d614308-4d58-4ed1-928e-8ee97aba8095 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:51.454494 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d614308-4d58-4ed1-928e-8ee97aba8095 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:51.454936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d614308-4d58-4ed1-928e-8ee97aba8095 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:51.455723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d614308-4d58-4ed1-928e-8ee97aba8095 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:51.456159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d614308-4d58-4ed1-928e-8ee97aba8095 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:51.517344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8d614308-4d58-4ed1-928e-8ee97aba8095 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:51.525284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8d614308-4d58-4ed1-928e-8ee97aba8095 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.081416 Jul 14 16:10:51.525857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1254/2607] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:51 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:51.677689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5494995b-85ea-4993-bd30-be00f15489e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:51.678303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5494995b-85ea-4993-bd30-be00f15489e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:51.684879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5494995b-85ea-4993-bd30-be00f15489e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:51.685326 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5494995b-85ea-4993-bd30-be00f15489e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:51.686114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5494995b-85ea-4993-bd30-be00f15489e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:51.686549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5494995b-85ea-4993-bd30-be00f15489e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:51.820130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5494995b-85ea-4993-bd30-be00f15489e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:51.828427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5494995b-85ea-4993-bd30-be00f15489e2 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154522 Jul 14 16:10:51.829127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1354/2608] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:51 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:52.038823 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3e51276f-368b-4388-87ff-6bad6dc4a7cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:52.039427 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3e51276f-368b-4388-87ff-6bad6dc4a7cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:52.045662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e51276f-368b-4388-87ff-6bad6dc4a7cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:52.046110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e51276f-368b-4388-87ff-6bad6dc4a7cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:52.046858 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e51276f-368b-4388-87ff-6bad6dc4a7cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:52.047318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e51276f-368b-4388-87ff-6bad6dc4a7cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:52.065090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:52.179562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3e51276f-368b-4388-87ff-6bad6dc4a7cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:52.187536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3e51276f-368b-4388-87ff-6bad6dc4a7cb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152618 Jul 14 16:10:52.188621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1255/2609] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:52 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:52.541981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-739c8054-dc51-4643-a286-578bcbbe8c75 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:52.542586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-739c8054-dc51-4643-a286-578bcbbe8c75 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:52.548928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-739c8054-dc51-4643-a286-578bcbbe8c75 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:52.549372 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-739c8054-dc51-4643-a286-578bcbbe8c75 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:52.550113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-739c8054-dc51-4643-a286-578bcbbe8c75 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:52.550547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-739c8054-dc51-4643-a286-578bcbbe8c75 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:52.611207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-739c8054-dc51-4643-a286-578bcbbe8c75 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:52.619045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-739c8054-dc51-4643-a286-578bcbbe8c75 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.081002 Jul 14 16:10:52.619622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1355/2610] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:52 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:52.846093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4ae429bc-569a-4122-8c00-7c1debeb6c9b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:52.846734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4ae429bc-569a-4122-8c00-7c1debeb6c9b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:52.853196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4ae429bc-569a-4122-8c00-7c1debeb6c9b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:52.853649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4ae429bc-569a-4122-8c00-7c1debeb6c9b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:52.854520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4ae429bc-569a-4122-8c00-7c1debeb6c9b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:52.855096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4ae429bc-569a-4122-8c00-7c1debeb6c9b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:52.985897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4ae429bc-569a-4122-8c00-7c1debeb6c9b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:52.993972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4ae429bc-569a-4122-8c00-7c1debeb6c9b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152073 Jul 14 16:10:52.994548 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1256/2611] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:52 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:53.206465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-80237017-63f9-4292-88e8-77425bcbe0dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:53.207092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-80237017-63f9-4292-88e8-77425bcbe0dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:53.213741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-80237017-63f9-4292-88e8-77425bcbe0dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:53.214187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-80237017-63f9-4292-88e8-77425bcbe0dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:53.214931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-80237017-63f9-4292-88e8-77425bcbe0dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:53.215361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-80237017-63f9-4292-88e8-77425bcbe0dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:53.351473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-80237017-63f9-4292-88e8-77425bcbe0dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:53.359679 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-80237017-63f9-4292-88e8-77425bcbe0dd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157313 Jul 14 16:10:53.360253 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1356/2612] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:53 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:53.636372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-24dcddc5-ab39-4699-9276-5d42cfc73639 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:53.636900 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-24dcddc5-ab39-4699-9276-5d42cfc73639 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:53.643812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-24dcddc5-ab39-4699-9276-5d42cfc73639 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:53.644261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-24dcddc5-ab39-4699-9276-5d42cfc73639 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:53.645021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-24dcddc5-ab39-4699-9276-5d42cfc73639 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:53.645458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-24dcddc5-ab39-4699-9276-5d42cfc73639 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:53.706951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-24dcddc5-ab39-4699-9276-5d42cfc73639 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:53.714747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-24dcddc5-ab39-4699-9276-5d42cfc73639 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.082315 Jul 14 16:10:53.715304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1257/2613] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:53 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:54.012589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b48da876-9035-4467-bed5-9c1350128c1d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:54.013319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b48da876-9035-4467-bed5-9c1350128c1d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:54.020132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b48da876-9035-4467-bed5-9c1350128c1d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:54.020573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b48da876-9035-4467-bed5-9c1350128c1d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:54.021321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b48da876-9035-4467-bed5-9c1350128c1d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:54.021784 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b48da876-9035-4467-bed5-9c1350128c1d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:54.150448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b48da876-9035-4467-bed5-9c1350128c1d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:54.158911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b48da876-9035-4467-bed5-9c1350128c1d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150219 Jul 14 16:10:54.159482 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1357/2614] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:54 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:54.379108 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7ed3bba6-6537-4332-a4fd-dc124b082f8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:54.379686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7ed3bba6-6537-4332-a4fd-dc124b082f8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:54.386303 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7ed3bba6-6537-4332-a4fd-dc124b082f8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:54.386750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7ed3bba6-6537-4332-a4fd-dc124b082f8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:54.387517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7ed3bba6-6537-4332-a4fd-dc124b082f8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:54.387982 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7ed3bba6-6537-4332-a4fd-dc124b082f8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:54.524170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7ed3bba6-6537-4332-a4fd-dc124b082f8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:54.532047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7ed3bba6-6537-4332-a4fd-dc124b082f8a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157855 Jul 14 16:10:54.533476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1258/2615] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:54 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:54.732203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7f2d917a-69e8-4ae2-889d-77412e64f7e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:54.732795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7f2d917a-69e8-4ae2-889d-77412e64f7e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:54.740051 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f2d917a-69e8-4ae2-889d-77412e64f7e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:54.740506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f2d917a-69e8-4ae2-889d-77412e64f7e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:54.741267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f2d917a-69e8-4ae2-889d-77412e64f7e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:54.741703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f2d917a-69e8-4ae2-889d-77412e64f7e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:54.805926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7f2d917a-69e8-4ae2-889d-77412e64f7e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:54.814288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7f2d917a-69e8-4ae2-889d-77412e64f7e6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085943 Jul 14 16:10:54.814994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1358/2616] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:54 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:55.176325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dae18577-8b8d-41d1-bcae-af27d548a990 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:55.176939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dae18577-8b8d-41d1-bcae-af27d548a990 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:55.182966 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dae18577-8b8d-41d1-bcae-af27d548a990 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:55.183417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dae18577-8b8d-41d1-bcae-af27d548a990 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:55.184207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dae18577-8b8d-41d1-bcae-af27d548a990 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:55.184644 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dae18577-8b8d-41d1-bcae-af27d548a990 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:55.312722 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-dae18577-8b8d-41d1-bcae-af27d548a990 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:55.321685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dae18577-8b8d-41d1-bcae-af27d548a990 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.149844 Jul 14 16:10:55.322261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1259/2617] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:55 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:55.550183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0357853a-dfea-4433-bdd3-1ea857c03625 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:55.550719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0357853a-dfea-4433-bdd3-1ea857c03625 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:55.556930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0357853a-dfea-4433-bdd3-1ea857c03625 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:55.557375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0357853a-dfea-4433-bdd3-1ea857c03625 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:55.558121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0357853a-dfea-4433-bdd3-1ea857c03625 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:55.558548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0357853a-dfea-4433-bdd3-1ea857c03625 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:55.702383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0357853a-dfea-4433-bdd3-1ea857c03625 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:55.711557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0357853a-dfea-4433-bdd3-1ea857c03625 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.165461 Jul 14 16:10:55.712165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1359/2618] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:55 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:55.832035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0a8edb85-e724-4ac8-8b47-46c19f5b8241 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:55.833036 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0a8edb85-e724-4ac8-8b47-46c19f5b8241 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:55.839179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a8edb85-e724-4ac8-8b47-46c19f5b8241 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:55.839769 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a8edb85-e724-4ac8-8b47-46c19f5b8241 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:55.840547 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a8edb85-e724-4ac8-8b47-46c19f5b8241 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:55.841116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0a8edb85-e724-4ac8-8b47-46c19f5b8241 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:55.905794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0a8edb85-e724-4ac8-8b47-46c19f5b8241 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:55.914463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0a8edb85-e724-4ac8-8b47-46c19f5b8241 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087701 Jul 14 16:10:55.915032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1260/2619] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:55 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:56.339311 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c23a0ea2-c84c-4bfd-ba87-aafc32a07ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:56.340086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c23a0ea2-c84c-4bfd-ba87-aafc32a07ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:56.346929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c23a0ea2-c84c-4bfd-ba87-aafc32a07ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:56.347375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c23a0ea2-c84c-4bfd-ba87-aafc32a07ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:56.348158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c23a0ea2-c84c-4bfd-ba87-aafc32a07ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:56.348603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c23a0ea2-c84c-4bfd-ba87-aafc32a07ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:56.478724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c23a0ea2-c84c-4bfd-ba87-aafc32a07ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:56.486919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c23a0ea2-c84c-4bfd-ba87-aafc32a07ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151399 Jul 14 16:10:56.487480 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1360/2620] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:56 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:56.729020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8d6f2916-ed46-40cb-88bd-841132b754a7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:56.729627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8d6f2916-ed46-40cb-88bd-841132b754a7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:56.736082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d6f2916-ed46-40cb-88bd-841132b754a7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:56.736639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d6f2916-ed46-40cb-88bd-841132b754a7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:56.737397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d6f2916-ed46-40cb-88bd-841132b754a7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:56.737837 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d6f2916-ed46-40cb-88bd-841132b754a7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:56.869619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8d6f2916-ed46-40cb-88bd-841132b754a7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:56.878409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8d6f2916-ed46-40cb-88bd-841132b754a7 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153300 Jul 14 16:10:56.878973 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1261/2621] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:56 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:56.931196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a1658008-4f90-4bc5-a392-4fb92646a799 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:56.931833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a1658008-4f90-4bc5-a392-4fb92646a799 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:56.937809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1658008-4f90-4bc5-a392-4fb92646a799 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:56.938251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1658008-4f90-4bc5-a392-4fb92646a799 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:56.939519 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1658008-4f90-4bc5-a392-4fb92646a799 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:56.940052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1658008-4f90-4bc5-a392-4fb92646a799 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:57.000406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a1658008-4f90-4bc5-a392-4fb92646a799 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:57.010186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a1658008-4f90-4bc5-a392-4fb92646a799 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.082685 Jul 14 16:10:57.011195 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1361/2622] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:56 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:57.503166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1bcc7544-9873-4612-94c5-c4cd440f0c7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:57.503813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1bcc7544-9873-4612-94c5-c4cd440f0c7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:57.510103 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1bcc7544-9873-4612-94c5-c4cd440f0c7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:57.510641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1bcc7544-9873-4612-94c5-c4cd440f0c7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:57.511417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1bcc7544-9873-4612-94c5-c4cd440f0c7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:57.511924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1bcc7544-9873-4612-94c5-c4cd440f0c7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:57.643425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1bcc7544-9873-4612-94c5-c4cd440f0c7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:57.651448 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1bcc7544-9873-4612-94c5-c4cd440f0c7d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152209 Jul 14 16:10:57.652046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1262/2623] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:57 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:57.896620 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b2210bb6-d12b-4c9e-9c66-bbf4fbed297f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:57.897229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b2210bb6-d12b-4c9e-9c66-bbf4fbed297f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:57.903644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2210bb6-d12b-4c9e-9c66-bbf4fbed297f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:57.904206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2210bb6-d12b-4c9e-9c66-bbf4fbed297f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:57.904952 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2210bb6-d12b-4c9e-9c66-bbf4fbed297f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:57.905383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2210bb6-d12b-4c9e-9c66-bbf4fbed297f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:58.027299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f8de025c-313c-45db-9707-cd5dce7b67be tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:58.027937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f8de025c-313c-45db-9707-cd5dce7b67be tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:58.034300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8de025c-313c-45db-9707-cd5dce7b67be tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:58.034752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8de025c-313c-45db-9707-cd5dce7b67be tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:58.035583 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8de025c-313c-45db-9707-cd5dce7b67be tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:58.035999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f8de025c-313c-45db-9707-cd5dce7b67be tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:58.044913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b2210bb6-d12b-4c9e-9c66-bbf4fbed297f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:58.053691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b2210bb6-d12b-4c9e-9c66-bbf4fbed297f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161812 Jul 14 16:10:58.054607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1362/2624] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:57 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:58.099769 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f8de025c-313c-45db-9707-cd5dce7b67be tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:58.107701 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f8de025c-313c-45db-9707-cd5dce7b67be tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084235 Jul 14 16:10:58.108268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1263/2625] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:58 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:58.670219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-367e6d06-a2e5-44ca-9a4c-c193228010a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:58.671017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-367e6d06-a2e5-44ca-9a4c-c193228010a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:58.677983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-367e6d06-a2e5-44ca-9a4c-c193228010a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:58.678429 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-367e6d06-a2e5-44ca-9a4c-c193228010a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:58.679221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-367e6d06-a2e5-44ca-9a4c-c193228010a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:58.679689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-367e6d06-a2e5-44ca-9a4c-c193228010a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:58.811019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-367e6d06-a2e5-44ca-9a4c-c193228010a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:58.820938 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-367e6d06-a2e5-44ca-9a4c-c193228010a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155084 Jul 14 16:10:58.821508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1363/2626] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:58 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:59.070373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-91a51e29-93a2-4d21-a061-01b0bfb0a565 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:59.070913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-91a51e29-93a2-4d21-a061-01b0bfb0a565 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:59.077433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91a51e29-93a2-4d21-a061-01b0bfb0a565 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:59.077880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91a51e29-93a2-4d21-a061-01b0bfb0a565 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:59.078632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91a51e29-93a2-4d21-a061-01b0bfb0a565 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:59.079068 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-91a51e29-93a2-4d21-a061-01b0bfb0a565 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:59.124811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7aeb4a29-99e9-4831-9be1-7d438523c3cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:59.125414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7aeb4a29-99e9-4831-9be1-7d438523c3cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:59.131871 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7aeb4a29-99e9-4831-9be1-7d438523c3cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:59.132315 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7aeb4a29-99e9-4831-9be1-7d438523c3cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:59.133066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7aeb4a29-99e9-4831-9be1-7d438523c3cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:59.133500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7aeb4a29-99e9-4831-9be1-7d438523c3cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:59.153298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:10:59.198135 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7aeb4a29-99e9-4831-9be1-7d438523c3cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:59.207099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7aeb4a29-99e9-4831-9be1-7d438523c3cd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086058 Jul 14 16:10:59.207704 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1364/2627] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:59 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:10:59.213978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-91a51e29-93a2-4d21-a061-01b0bfb0a565 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:59.222345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-91a51e29-93a2-4d21-a061-01b0bfb0a565 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155889 Jul 14 16:10:59.222897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1264/2628] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:59 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:10:59.839101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-325430d1-8573-44f9-8605-c0c90ea47837 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:10:59.839797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-325430d1-8573-44f9-8605-c0c90ea47837 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:10:59.846094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-325430d1-8573-44f9-8605-c0c90ea47837 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:59.846548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-325430d1-8573-44f9-8605-c0c90ea47837 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:59.847312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-325430d1-8573-44f9-8605-c0c90ea47837 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:10:59.847797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-325430d1-8573-44f9-8605-c0c90ea47837 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:10:59.982007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-325430d1-8573-44f9-8605-c0c90ea47837 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:10:59.990279 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-325430d1-8573-44f9-8605-c0c90ea47837 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155005 Jul 14 16:10:59.990855 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1365/2629] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:10:59 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:00.224358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-de1a80bd-1853-4b94-866d-4d846c7bdcfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:00.224968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-de1a80bd-1853-4b94-866d-4d846c7bdcfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:00.231401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-de1a80bd-1853-4b94-866d-4d846c7bdcfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:00.231875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-de1a80bd-1853-4b94-866d-4d846c7bdcfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:00.232632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-de1a80bd-1853-4b94-866d-4d846c7bdcfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:00.233070 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-de1a80bd-1853-4b94-866d-4d846c7bdcfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:00.240096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-390c34e7-55b1-4b71-a0e4-2306bb3dc413 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:00.240752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-390c34e7-55b1-4b71-a0e4-2306bb3dc413 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:00.247444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-390c34e7-55b1-4b71-a0e4-2306bb3dc413 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:00.248103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-390c34e7-55b1-4b71-a0e4-2306bb3dc413 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:00.249016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-390c34e7-55b1-4b71-a0e4-2306bb3dc413 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:00.249496 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-390c34e7-55b1-4b71-a0e4-2306bb3dc413 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:00.296697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-de1a80bd-1853-4b94-866d-4d846c7bdcfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:00.305325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-de1a80bd-1853-4b94-866d-4d846c7bdcfd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085064 Jul 14 16:11:00.305906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1265/2630] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:00 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:00.390581 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-390c34e7-55b1-4b71-a0e4-2306bb3dc413 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:00.399526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-390c34e7-55b1-4b71-a0e4-2306bb3dc413 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.164233 Jul 14 16:11:00.400200 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1366/2631] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:00 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:01.008135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7a9f75bf-94cf-4a1e-a463-56a2c2c27c35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:01.008817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7a9f75bf-94cf-4a1e-a463-56a2c2c27c35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:01.015199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a9f75bf-94cf-4a1e-a463-56a2c2c27c35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:01.015683 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a9f75bf-94cf-4a1e-a463-56a2c2c27c35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:01.016451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a9f75bf-94cf-4a1e-a463-56a2c2c27c35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:01.016915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a9f75bf-94cf-4a1e-a463-56a2c2c27c35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:01.149299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7a9f75bf-94cf-4a1e-a463-56a2c2c27c35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:01.157192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7a9f75bf-94cf-4a1e-a463-56a2c2c27c35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152959 Jul 14 16:11:01.157760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1266/2632] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:01 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:01.324077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6afa0a6d-6fe0-429b-9cea-a83e9a210d9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:01.324727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6afa0a6d-6fe0-429b-9cea-a83e9a210d9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:01.327174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=80 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:01.333459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6afa0a6d-6fe0-429b-9cea-a83e9a210d9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:01.333909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6afa0a6d-6fe0-429b-9cea-a83e9a210d9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:01.334667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6afa0a6d-6fe0-429b-9cea-a83e9a210d9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:01.335102 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6afa0a6d-6fe0-429b-9cea-a83e9a210d9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:01.403077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6afa0a6d-6fe0-429b-9cea-a83e9a210d9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:01.412797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6afa0a6d-6fe0-429b-9cea-a83e9a210d9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.092986 Jul 14 16:11:01.413932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1367/2633] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:01 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:01.418620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-154e93aa-d627-418b-a398-cc442e9e9602 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:01.419113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-154e93aa-d627-418b-a398-cc442e9e9602 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:01.426972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-154e93aa-d627-418b-a398-cc442e9e9602 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:01.427491 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-154e93aa-d627-418b-a398-cc442e9e9602 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:01.428293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-154e93aa-d627-418b-a398-cc442e9e9602 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:01.428756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-154e93aa-d627-418b-a398-cc442e9e9602 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:01.565182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-154e93aa-d627-418b-a398-cc442e9e9602 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:01.573444 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-154e93aa-d627-418b-a398-cc442e9e9602 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160027 Jul 14 16:11:01.574004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1267/2634] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:01 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:02.174575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f5f06b39-1130-4f08-b092-6f04116f72d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:02.175186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f5f06b39-1130-4f08-b092-6f04116f72d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:02.181877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5f06b39-1130-4f08-b092-6f04116f72d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:02.182324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5f06b39-1130-4f08-b092-6f04116f72d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:02.183077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5f06b39-1130-4f08-b092-6f04116f72d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:02.183511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f5f06b39-1130-4f08-b092-6f04116f72d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:02.314448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f5f06b39-1130-4f08-b092-6f04116f72d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:02.322902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f5f06b39-1130-4f08-b092-6f04116f72d0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152210 Jul 14 16:11:02.323508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1368/2635] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:02 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:02.431168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-26456f84-1eee-493d-9c86-67f1c6ef0c51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:02.431835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-26456f84-1eee-493d-9c86-67f1c6ef0c51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:02.438805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26456f84-1eee-493d-9c86-67f1c6ef0c51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:02.439261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26456f84-1eee-493d-9c86-67f1c6ef0c51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:02.440108 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26456f84-1eee-493d-9c86-67f1c6ef0c51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:02.440614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26456f84-1eee-493d-9c86-67f1c6ef0c51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:02.507543 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-26456f84-1eee-493d-9c86-67f1c6ef0c51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:02.516437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-26456f84-1eee-493d-9c86-67f1c6ef0c51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.089351 Jul 14 16:11:02.516983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1268/2636] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:02 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:02.590675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b4ea9489-f5a3-4dde-bcc9-3d9cbeb9307c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:02.591640 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b4ea9489-f5a3-4dde-bcc9-3d9cbeb9307c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:02.597724 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4ea9489-f5a3-4dde-bcc9-3d9cbeb9307c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:02.598242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4ea9489-f5a3-4dde-bcc9-3d9cbeb9307c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:02.599000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4ea9489-f5a3-4dde-bcc9-3d9cbeb9307c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:02.599431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4ea9489-f5a3-4dde-bcc9-3d9cbeb9307c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:02.755462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b4ea9489-f5a3-4dde-bcc9-3d9cbeb9307c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:02.764690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b4ea9489-f5a3-4dde-bcc9-3d9cbeb9307c tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.178088 Jul 14 16:11:02.765269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1369/2637] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:02 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:03.340717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2fbe8217-89c5-4084-8b36-005f93dbfee7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:03.341249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2fbe8217-89c5-4084-8b36-005f93dbfee7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:03.347723 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2fbe8217-89c5-4084-8b36-005f93dbfee7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:03.348178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2fbe8217-89c5-4084-8b36-005f93dbfee7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:03.348943 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2fbe8217-89c5-4084-8b36-005f93dbfee7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:03.349378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2fbe8217-89c5-4084-8b36-005f93dbfee7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:03.483254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2fbe8217-89c5-4084-8b36-005f93dbfee7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:03.493354 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2fbe8217-89c5-4084-8b36-005f93dbfee7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.156264 Jul 14 16:11:03.494349 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1269/2638] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:03 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:03.533037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c7814e48-afb5-4372-bdbf-fe5cfda13c6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:03.533737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c7814e48-afb5-4372-bdbf-fe5cfda13c6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:03.540671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c7814e48-afb5-4372-bdbf-fe5cfda13c6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:03.541124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c7814e48-afb5-4372-bdbf-fe5cfda13c6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:03.541887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c7814e48-afb5-4372-bdbf-fe5cfda13c6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:03.542327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c7814e48-afb5-4372-bdbf-fe5cfda13c6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:03.608296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c7814e48-afb5-4372-bdbf-fe5cfda13c6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:03.617212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c7814e48-afb5-4372-bdbf-fe5cfda13c6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087970 Jul 14 16:11:03.617780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1370/2639] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:03 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:03.782255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9aaab875-beb3-4dca-b5ca-3a338c4115c3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:03.782871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9aaab875-beb3-4dca-b5ca-3a338c4115c3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:03.789686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9aaab875-beb3-4dca-b5ca-3a338c4115c3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:03.790129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9aaab875-beb3-4dca-b5ca-3a338c4115c3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:03.790874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9aaab875-beb3-4dca-b5ca-3a338c4115c3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:03.791305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9aaab875-beb3-4dca-b5ca-3a338c4115c3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:03.922556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9aaab875-beb3-4dca-b5ca-3a338c4115c3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:03.930634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9aaab875-beb3-4dca-b5ca-3a338c4115c3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152261 Jul 14 16:11:03.931214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1270/2640] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:03 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:04.510978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a1f79d69-c945-4cc2-96d0-69b028e73641 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:04.511606 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a1f79d69-c945-4cc2-96d0-69b028e73641 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:04.517865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1f79d69-c945-4cc2-96d0-69b028e73641 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:04.518318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1f79d69-c945-4cc2-96d0-69b028e73641 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:04.519077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1f79d69-c945-4cc2-96d0-69b028e73641 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:04.519517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1f79d69-c945-4cc2-96d0-69b028e73641 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:04.635008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f1689e5b-11fb-4f7a-8300-63a57d074fac tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:04.635638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f1689e5b-11fb-4f7a-8300-63a57d074fac tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:04.642077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1689e5b-11fb-4f7a-8300-63a57d074fac tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:04.642523 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1689e5b-11fb-4f7a-8300-63a57d074fac tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:04.643278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1689e5b-11fb-4f7a-8300-63a57d074fac tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:04.643740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1689e5b-11fb-4f7a-8300-63a57d074fac tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:04.649757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a1f79d69-c945-4cc2-96d0-69b028e73641 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:04.657667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a1f79d69-c945-4cc2-96d0-69b028e73641 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150654 Jul 14 16:11:04.658582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1371/2641] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:04 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:04.707796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f1689e5b-11fb-4f7a-8300-63a57d074fac tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:04.716575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f1689e5b-11fb-4f7a-8300-63a57d074fac tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085509 Jul 14 16:11:04.717146 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1271/2642] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:04 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:04.948117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8b83fd23-89f8-4c96-843f-b7166d8842d5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:04.948726 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8b83fd23-89f8-4c96-843f-b7166d8842d5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:04.954776 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b83fd23-89f8-4c96-843f-b7166d8842d5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:04.955281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b83fd23-89f8-4c96-843f-b7166d8842d5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:04.956067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b83fd23-89f8-4c96-843f-b7166d8842d5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:04.956503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8b83fd23-89f8-4c96-843f-b7166d8842d5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:05.089923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8b83fd23-89f8-4c96-843f-b7166d8842d5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:05.099268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8b83fd23-89f8-4c96-843f-b7166d8842d5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154998 Jul 14 16:11:05.099897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1372/2643] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:04 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:05.675720 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-362626bd-9568-4881-b458-d288e37a2b02 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:05.676991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-362626bd-9568-4881-b458-d288e37a2b02 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:05.683549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-362626bd-9568-4881-b458-d288e37a2b02 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:05.684025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-362626bd-9568-4881-b458-d288e37a2b02 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:05.684781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-362626bd-9568-4881-b458-d288e37a2b02 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:05.685214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-362626bd-9568-4881-b458-d288e37a2b02 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:05.689221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:05.737338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-df93f4a8-6a1d-43f4-b5de-5024743ba68f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:05.738089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-df93f4a8-6a1d-43f4-b5de-5024743ba68f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:05.745712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-df93f4a8-6a1d-43f4-b5de-5024743ba68f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:05.746291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-df93f4a8-6a1d-43f4-b5de-5024743ba68f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:05.747118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-df93f4a8-6a1d-43f4-b5de-5024743ba68f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:05.747556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-df93f4a8-6a1d-43f4-b5de-5024743ba68f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:05.815321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-df93f4a8-6a1d-43f4-b5de-5024743ba68f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:05.821750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-362626bd-9568-4881-b458-d288e37a2b02 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:05.824163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-df93f4a8-6a1d-43f4-b5de-5024743ba68f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.090724 Jul 14 16:11:05.824762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1373/2644] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:05 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:05.829867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-362626bd-9568-4881-b458-d288e37a2b02 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.158066 Jul 14 16:11:05.830431 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1272/2645] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:05 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:06.119304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e0e5d1c8-6b9d-4301-8aa1-1009dedeb373 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:06.119862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e0e5d1c8-6b9d-4301-8aa1-1009dedeb373 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:06.125819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e0e5d1c8-6b9d-4301-8aa1-1009dedeb373 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:06.126262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e0e5d1c8-6b9d-4301-8aa1-1009dedeb373 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:06.127007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e0e5d1c8-6b9d-4301-8aa1-1009dedeb373 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:06.127433 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e0e5d1c8-6b9d-4301-8aa1-1009dedeb373 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:06.258589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e0e5d1c8-6b9d-4301-8aa1-1009dedeb373 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:06.266846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e0e5d1c8-6b9d-4301-8aa1-1009dedeb373 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151463 Jul 14 16:11:06.267419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1374/2646] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:06 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:06.840109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-22f080b1-6830-4bc9-a90e-dd72464210d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:06.840669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-22f080b1-6830-4bc9-a90e-dd72464210d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:06.847267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-22f080b1-6830-4bc9-a90e-dd72464210d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:06.847467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-370421be-e8ab-4e16-9a2e-817dc1a294f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:06.847936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-22f080b1-6830-4bc9-a90e-dd72464210d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:06.848132 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-370421be-e8ab-4e16-9a2e-817dc1a294f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:06.849326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-22f080b1-6830-4bc9-a90e-dd72464210d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:06.849859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-22f080b1-6830-4bc9-a90e-dd72464210d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:06.854968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-370421be-e8ab-4e16-9a2e-817dc1a294f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:06.855422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-370421be-e8ab-4e16-9a2e-817dc1a294f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:06.856287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-370421be-e8ab-4e16-9a2e-817dc1a294f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:06.856717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-370421be-e8ab-4e16-9a2e-817dc1a294f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:06.919294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-22f080b1-6830-4bc9-a90e-dd72464210d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:06.928292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-22f080b1-6830-4bc9-a90e-dd72464210d6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.091980 Jul 14 16:11:06.928919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1273/2647] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:06 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:06.987341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-370421be-e8ab-4e16-9a2e-817dc1a294f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:06.996754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-370421be-e8ab-4e16-9a2e-817dc1a294f7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.153244 Jul 14 16:11:06.997259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1375/2648] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:06 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:07.284782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cc4923e5-cfb6-43cf-8fee-425872084562 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:07.285395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cc4923e5-cfb6-43cf-8fee-425872084562 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:07.292498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc4923e5-cfb6-43cf-8fee-425872084562 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:07.292935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc4923e5-cfb6-43cf-8fee-425872084562 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:07.293948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc4923e5-cfb6-43cf-8fee-425872084562 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:07.294387 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cc4923e5-cfb6-43cf-8fee-425872084562 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:07.429820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cc4923e5-cfb6-43cf-8fee-425872084562 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:07.437687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cc4923e5-cfb6-43cf-8fee-425872084562 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156793 Jul 14 16:11:07.438256 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1274/2649] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:07 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:08.069712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ef7f622a-e851-4dd1-a40b-e2aba5f7a224 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:08.070327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ef7f622a-e851-4dd1-a40b-e2aba5f7a224 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:08.076388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef7f622a-e851-4dd1-a40b-e2aba5f7a224 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:08.076815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef7f622a-e851-4dd1-a40b-e2aba5f7a224 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:08.077566 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef7f622a-e851-4dd1-a40b-e2aba5f7a224 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:08.077998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ef7f622a-e851-4dd1-a40b-e2aba5f7a224 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:08.138054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d8f53230-037d-4759-810f-2a458f6d1982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:08.138666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d8f53230-037d-4759-810f-2a458f6d1982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:08.143292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ef7f622a-e851-4dd1-a40b-e2aba5f7a224 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:08.144790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8f53230-037d-4759-810f-2a458f6d1982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:08.145240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8f53230-037d-4759-810f-2a458f6d1982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:08.146620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8f53230-037d-4759-810f-2a458f6d1982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:08.147059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8f53230-037d-4759-810f-2a458f6d1982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:08.152233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ef7f622a-e851-4dd1-a40b-e2aba5f7a224 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.210958 Jul 14 16:11:08.152810 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1376/2650] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:07 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:08.281556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d8f53230-037d-4759-810f-2a458f6d1982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:08.289800 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d8f53230-037d-4759-810f-2a458f6d1982 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.279365 Jul 14 16:11:08.290378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1275/2651] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:08 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:08.578574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0371dfa5-d1ab-45eb-a71b-d06a453a2426 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:08.579219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0371dfa5-d1ab-45eb-a71b-d06a453a2426 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:08.585515 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0371dfa5-d1ab-45eb-a71b-d06a453a2426 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:08.585987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0371dfa5-d1ab-45eb-a71b-d06a453a2426 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:08.586792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0371dfa5-d1ab-45eb-a71b-d06a453a2426 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:08.587292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0371dfa5-d1ab-45eb-a71b-d06a453a2426 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:08.717074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0371dfa5-d1ab-45eb-a71b-d06a453a2426 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:08.726027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0371dfa5-d1ab-45eb-a71b-d06a453a2426 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.275568 Jul 14 16:11:08.726595 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1377/2652] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:08 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:09.168950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a8790ef2-4fd6-4e4a-afbe-cfd2cf773889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:09.169567 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a8790ef2-4fd6-4e4a-afbe-cfd2cf773889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:09.176174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8790ef2-4fd6-4e4a-afbe-cfd2cf773889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:09.176631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8790ef2-4fd6-4e4a-afbe-cfd2cf773889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:09.177421 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8790ef2-4fd6-4e4a-afbe-cfd2cf773889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:09.178022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a8790ef2-4fd6-4e4a-afbe-cfd2cf773889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:09.240405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a8790ef2-4fd6-4e4a-afbe-cfd2cf773889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:09.248573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a8790ef2-4fd6-4e4a-afbe-cfd2cf773889 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.083695 Jul 14 16:11:09.249073 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1276/2653] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:09 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:09.306575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7d26e610-1f05-46b1-bc3b-8df9d262b97e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:09.307193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7d26e610-1f05-46b1-bc3b-8df9d262b97e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:09.313876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d26e610-1f05-46b1-bc3b-8df9d262b97e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:09.314364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d26e610-1f05-46b1-bc3b-8df9d262b97e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:09.315122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d26e610-1f05-46b1-bc3b-8df9d262b97e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:09.315563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d26e610-1f05-46b1-bc3b-8df9d262b97e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:09.445946 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7d26e610-1f05-46b1-bc3b-8df9d262b97e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:09.454068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7d26e610-1f05-46b1-bc3b-8df9d262b97e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151527 Jul 14 16:11:09.454632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1378/2654] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:09 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:09.742762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b819bd4f-3240-470d-985a-4d71984d436f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:09.743368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b819bd4f-3240-470d-985a-4d71984d436f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:09.749553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b819bd4f-3240-470d-985a-4d71984d436f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:09.749997 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b819bd4f-3240-470d-985a-4d71984d436f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:09.750745 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b819bd4f-3240-470d-985a-4d71984d436f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:09.751181 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b819bd4f-3240-470d-985a-4d71984d436f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:09.892545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b819bd4f-3240-470d-985a-4d71984d436f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:09.900918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b819bd4f-3240-470d-985a-4d71984d436f tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161979 Jul 14 16:11:09.901492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1277/2655] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:09 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:10.265409 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1904b965-19b1-4b61-9862-69e01f30d163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:10.265923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1904b965-19b1-4b61-9862-69e01f30d163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:10.272084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1904b965-19b1-4b61-9862-69e01f30d163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:10.272527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1904b965-19b1-4b61-9862-69e01f30d163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:10.273267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1904b965-19b1-4b61-9862-69e01f30d163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:10.273699 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1904b965-19b1-4b61-9862-69e01f30d163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:10.285127 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c1df4cdf-1191-4b90-9dda-b3c1c6e2b0bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:10.285689 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c1df4cdf-1191-4b90-9dda-b3c1c6e2b0bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:10.293294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1df4cdf-1191-4b90-9dda-b3c1c6e2b0bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:10.293750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1df4cdf-1191-4b90-9dda-b3c1c6e2b0bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:10.294717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1df4cdf-1191-4b90-9dda-b3c1c6e2b0bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:10.295154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c1df4cdf-1191-4b90-9dda-b3c1c6e2b0bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:10.321700 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c1df4cdf-1191-4b90-9dda-b3c1c6e2b0bf tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf/ips" status: 200 len: 152 microversion: 2.20 time: 0.040372 Jul 14 16:11:10.322536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1278/2656] 10.222.0.99 () {60 vars in 1288 bytes} [Thu Jul 14 16:11:10 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf/ips => generated 152 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jul 14 16:11:10.343019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1904b965-19b1-4b61-9862-69e01f30d163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:10.351873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1904b965-19b1-4b61-9862-69e01f30d163 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.090379 Jul 14 16:11:10.352452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1379/2657] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:10 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:10.472119 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f9a6f762-12bf-47de-acc7-eedbf4f7c57e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:10.472731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f9a6f762-12bf-47de-acc7-eedbf4f7c57e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:10.479816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9a6f762-12bf-47de-acc7-eedbf4f7c57e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:10.480272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9a6f762-12bf-47de-acc7-eedbf4f7c57e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:10.481028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9a6f762-12bf-47de-acc7-eedbf4f7c57e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:10.481460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9a6f762-12bf-47de-acc7-eedbf4f7c57e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:10.618403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f9a6f762-12bf-47de-acc7-eedbf4f7c57e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:10.627384 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f9a6f762-12bf-47de-acc7-eedbf4f7c57e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.159073 Jul 14 16:11:10.628019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1279/2658] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:10 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:10.919114 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-37fc808b-e870-41a8-add6-257813ad2fb4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:10.919758 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-37fc808b-e870-41a8-add6-257813ad2fb4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:10.930546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37fc808b-e870-41a8-add6-257813ad2fb4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:10.931001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37fc808b-e870-41a8-add6-257813ad2fb4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:10.931803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37fc808b-e870-41a8-add6-257813ad2fb4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:10.932483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-37fc808b-e870-41a8-add6-257813ad2fb4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:11.073991 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-37fc808b-e870-41a8-add6-257813ad2fb4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:11.082079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-37fc808b-e870-41a8-add6-257813ad2fb4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.167267 Jul 14 16:11:11.082684 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1380/2659] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:10 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:11.369374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c15a4c2e-8797-4bb5-bf18-26a7f3fb25fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:11.369956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c15a4c2e-8797-4bb5-bf18-26a7f3fb25fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:11.376190 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c15a4c2e-8797-4bb5-bf18-26a7f3fb25fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:11.376668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c15a4c2e-8797-4bb5-bf18-26a7f3fb25fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:11.377430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c15a4c2e-8797-4bb5-bf18-26a7f3fb25fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:11.377877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c15a4c2e-8797-4bb5-bf18-26a7f3fb25fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:11.440348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c15a4c2e-8797-4bb5-bf18-26a7f3fb25fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:11.449100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c15a4c2e-8797-4bb5-bf18-26a7f3fb25fb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.083831 Jul 14 16:11:11.449674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1280/2660] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:11 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:11.644636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f92f2156-0557-4631-8a68-3f924b06ea87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:11.645296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f92f2156-0557-4631-8a68-3f924b06ea87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:11.652078 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f92f2156-0557-4631-8a68-3f924b06ea87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:11.652531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f92f2156-0557-4631-8a68-3f924b06ea87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:11.653292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f92f2156-0557-4631-8a68-3f924b06ea87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:11.653727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f92f2156-0557-4631-8a68-3f924b06ea87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:11.657894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:11.785083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f92f2156-0557-4631-8a68-3f924b06ea87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:11.794395 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f92f2156-0557-4631-8a68-3f924b06ea87 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.153641 Jul 14 16:11:11.794989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1381/2661] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:11 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:12.101377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3583e0da-6344-480e-8999-82f5925f1882 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:12.101995 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3583e0da-6344-480e-8999-82f5925f1882 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:12.108477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3583e0da-6344-480e-8999-82f5925f1882 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:12.108915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3583e0da-6344-480e-8999-82f5925f1882 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:12.109674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3583e0da-6344-480e-8999-82f5925f1882 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:12.110128 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3583e0da-6344-480e-8999-82f5925f1882 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:12.241634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3583e0da-6344-480e-8999-82f5925f1882 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:12.249818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3583e0da-6344-480e-8999-82f5925f1882 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153470 Jul 14 16:11:12.250416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1281/2662] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:12 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:12.466161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f4d476c6-826c-4d46-aeb5-6c5948ab3729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:12.466772 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f4d476c6-826c-4d46-aeb5-6c5948ab3729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:12.472935 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4d476c6-826c-4d46-aeb5-6c5948ab3729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:12.473391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4d476c6-826c-4d46-aeb5-6c5948ab3729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:12.474215 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4d476c6-826c-4d46-aeb5-6c5948ab3729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:12.474653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4d476c6-826c-4d46-aeb5-6c5948ab3729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:12.546528 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f4d476c6-826c-4d46-aeb5-6c5948ab3729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:12.555345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f4d476c6-826c-4d46-aeb5-6c5948ab3729 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.093066 Jul 14 16:11:12.555948 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1382/2663] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:12 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:12.813401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-97ba76f1-c25f-4964-871f-32b22207e7e3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:12.813940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-97ba76f1-c25f-4964-871f-32b22207e7e3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:12.821259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97ba76f1-c25f-4964-871f-32b22207e7e3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:12.821712 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97ba76f1-c25f-4964-871f-32b22207e7e3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:12.822470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97ba76f1-c25f-4964-871f-32b22207e7e3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:12.822911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-97ba76f1-c25f-4964-871f-32b22207e7e3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:12.957259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-97ba76f1-c25f-4964-871f-32b22207e7e3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:12.965610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-97ba76f1-c25f-4964-871f-32b22207e7e3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.156899 Jul 14 16:11:12.966171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1282/2664] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:12 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:13.269661 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0d975e0d-c3e1-421f-afb7-19180f38006a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:13.270311 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0d975e0d-c3e1-421f-afb7-19180f38006a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:13.276907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d975e0d-c3e1-421f-afb7-19180f38006a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:13.277362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d975e0d-c3e1-421f-afb7-19180f38006a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:13.278123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d975e0d-c3e1-421f-afb7-19180f38006a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:13.278564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d975e0d-c3e1-421f-afb7-19180f38006a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:13.408880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0d975e0d-c3e1-421f-afb7-19180f38006a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:13.418812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0d975e0d-c3e1-421f-afb7-19180f38006a tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153669 Jul 14 16:11:13.419379 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1383/2665] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:13 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:13.572690 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3297fc27-98da-4f0f-93d9-2e7c32c86568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:13.573216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3297fc27-98da-4f0f-93d9-2e7c32c86568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:13.580027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3297fc27-98da-4f0f-93d9-2e7c32c86568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:13.580555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3297fc27-98da-4f0f-93d9-2e7c32c86568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:13.581340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3297fc27-98da-4f0f-93d9-2e7c32c86568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:13.581801 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3297fc27-98da-4f0f-93d9-2e7c32c86568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:13.646647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3297fc27-98da-4f0f-93d9-2e7c32c86568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:13.657724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3297fc27-98da-4f0f-93d9-2e7c32c86568 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088900 Jul 14 16:11:13.658322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1283/2666] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:13 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:13.983487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1c301c7e-41e5-41e1-b8bf-5471fabcaeeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:13.984128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1c301c7e-41e5-41e1-b8bf-5471fabcaeeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:13.994899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1c301c7e-41e5-41e1-b8bf-5471fabcaeeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:13.994899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1c301c7e-41e5-41e1-b8bf-5471fabcaeeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:13.994899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1c301c7e-41e5-41e1-b8bf-5471fabcaeeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:13.994899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1c301c7e-41e5-41e1-b8bf-5471fabcaeeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:14.122897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1c301c7e-41e5-41e1-b8bf-5471fabcaeeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:14.131377 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1c301c7e-41e5-41e1-b8bf-5471fabcaeeb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151745 Jul 14 16:11:14.133365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1384/2667] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:13 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:14.438102 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f7df5d91-161b-403a-add5-8d57bba4df76 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:14.438845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f7df5d91-161b-403a-add5-8d57bba4df76 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:14.441194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=80 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:14.447372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7df5d91-161b-403a-add5-8d57bba4df76 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:14.447946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7df5d91-161b-403a-add5-8d57bba4df76 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:14.448793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7df5d91-161b-403a-add5-8d57bba4df76 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:14.449317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7df5d91-161b-403a-add5-8d57bba4df76 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:14.583271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f7df5d91-161b-403a-add5-8d57bba4df76 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:14.591656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f7df5d91-161b-403a-add5-8d57bba4df76 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158315 Jul 14 16:11:14.592239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1284/2668] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:14 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:14.675764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e4d01bf2-34b4-49d3-9a64-4c0f8b58413a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:14.676411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e4d01bf2-34b4-49d3-9a64-4c0f8b58413a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:14.683978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4d01bf2-34b4-49d3-9a64-4c0f8b58413a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:14.684502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4d01bf2-34b4-49d3-9a64-4c0f8b58413a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:14.685245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4d01bf2-34b4-49d3-9a64-4c0f8b58413a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:14.685675 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e4d01bf2-34b4-49d3-9a64-4c0f8b58413a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:14.752257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e4d01bf2-34b4-49d3-9a64-4c0f8b58413a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:14.760517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e4d01bf2-34b4-49d3-9a64-4c0f8b58413a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088840 Jul 14 16:11:14.761106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1385/2669] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:14 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:15.149877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e2c30279-3cd3-448f-ad5c-56dc6238d7a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:15.150498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e2c30279-3cd3-448f-ad5c-56dc6238d7a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:15.156642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e2c30279-3cd3-448f-ad5c-56dc6238d7a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:15.157100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e2c30279-3cd3-448f-ad5c-56dc6238d7a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:15.157864 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e2c30279-3cd3-448f-ad5c-56dc6238d7a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:15.158307 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e2c30279-3cd3-448f-ad5c-56dc6238d7a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:15.301070 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e2c30279-3cd3-448f-ad5c-56dc6238d7a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:15.309208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e2c30279-3cd3-448f-ad5c-56dc6238d7a6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.163751 Jul 14 16:11:15.309781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1285/2670] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:15 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:15.609760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-af7c7e60-6a88-481c-800e-24c920b071ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:15.610209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-af7c7e60-6a88-481c-800e-24c920b071ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:15.616313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-af7c7e60-6a88-481c-800e-24c920b071ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:15.616795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-af7c7e60-6a88-481c-800e-24c920b071ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:15.617546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-af7c7e60-6a88-481c-800e-24c920b071ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:15.617998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-af7c7e60-6a88-481c-800e-24c920b071ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:15.751618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-af7c7e60-6a88-481c-800e-24c920b071ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:15.760631 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-af7c7e60-6a88-481c-800e-24c920b071ea tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154868 Jul 14 16:11:15.761205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1386/2671] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:15 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:15.778255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-17c0780c-be89-4f4a-b2ab-d26537147fa7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:15.778875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-17c0780c-be89-4f4a-b2ab-d26537147fa7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:15.785414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-17c0780c-be89-4f4a-b2ab-d26537147fa7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:15.785860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-17c0780c-be89-4f4a-b2ab-d26537147fa7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:15.786654 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-17c0780c-be89-4f4a-b2ab-d26537147fa7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:15.787098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-17c0780c-be89-4f4a-b2ab-d26537147fa7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:15.850129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-17c0780c-be89-4f4a-b2ab-d26537147fa7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:15.859869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-17c0780c-be89-4f4a-b2ab-d26537147fa7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085389 Jul 14 16:11:15.860380 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1286/2672] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:15 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:16.326282 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f8b0cccd-24ce-42bf-847b-f366c4012832 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:16.326929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f8b0cccd-24ce-42bf-847b-f366c4012832 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:16.332989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8b0cccd-24ce-42bf-847b-f366c4012832 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:16.333441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8b0cccd-24ce-42bf-847b-f366c4012832 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:16.334201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8b0cccd-24ce-42bf-847b-f366c4012832 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:16.334638 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8b0cccd-24ce-42bf-847b-f366c4012832 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:16.464740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f8b0cccd-24ce-42bf-847b-f366c4012832 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:16.472607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f8b0cccd-24ce-42bf-847b-f366c4012832 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150215 Jul 14 16:11:16.473171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1387/2673] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:16 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:16.778945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-96611735-9b7b-44ab-a6a3-f96210dae39d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:16.779569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-96611735-9b7b-44ab-a6a3-f96210dae39d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:16.786115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96611735-9b7b-44ab-a6a3-f96210dae39d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:16.786568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96611735-9b7b-44ab-a6a3-f96210dae39d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:16.788038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96611735-9b7b-44ab-a6a3-f96210dae39d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:16.788982 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-96611735-9b7b-44ab-a6a3-f96210dae39d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:16.877420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4e63982e-9c4c-493f-bc3a-459ae580eaf1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:16.878129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4e63982e-9c4c-493f-bc3a-459ae580eaf1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:16.885570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e63982e-9c4c-493f-bc3a-459ae580eaf1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:16.886017 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e63982e-9c4c-493f-bc3a-459ae580eaf1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:16.886780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e63982e-9c4c-493f-bc3a-459ae580eaf1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:16.887219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4e63982e-9c4c-493f-bc3a-459ae580eaf1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:16.924537 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-96611735-9b7b-44ab-a6a3-f96210dae39d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:16.937319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-96611735-9b7b-44ab-a6a3-f96210dae39d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.162237 Jul 14 16:11:16.937904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1287/2674] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:16 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:16.962816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4e63982e-9c4c-493f-bc3a-459ae580eaf1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:16.971058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4e63982e-9c4c-493f-bc3a-459ae580eaf1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.097434 Jul 14 16:11:16.971646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1388/2675] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:16 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:17.490834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b7517aaa-a32d-4abd-b2ff-1b86cb413bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:17.491474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b7517aaa-a32d-4abd-b2ff-1b86cb413bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:17.497741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7517aaa-a32d-4abd-b2ff-1b86cb413bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:17.498199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7517aaa-a32d-4abd-b2ff-1b86cb413bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:17.498964 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7517aaa-a32d-4abd-b2ff-1b86cb413bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:17.499406 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7517aaa-a32d-4abd-b2ff-1b86cb413bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:17.643026 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b7517aaa-a32d-4abd-b2ff-1b86cb413bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:17.651765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b7517aaa-a32d-4abd-b2ff-1b86cb413bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.165206 Jul 14 16:11:17.652357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1288/2676] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:17 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:17.958174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c1c0c3a8-afa5-4f4a-b7c9-3f05fcfd7eca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:17.958785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c1c0c3a8-afa5-4f4a-b7c9-3f05fcfd7eca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:17.965733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c1c0c3a8-afa5-4f4a-b7c9-3f05fcfd7eca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:17.966184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c1c0c3a8-afa5-4f4a-b7c9-3f05fcfd7eca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:17.966932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c1c0c3a8-afa5-4f4a-b7c9-3f05fcfd7eca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:17.967366 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c1c0c3a8-afa5-4f4a-b7c9-3f05fcfd7eca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:17.988239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-353be462-6a9c-45a3-a0ad-13b1e55e0019 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:17.989155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-353be462-6a9c-45a3-a0ad-13b1e55e0019 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:17.996724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-353be462-6a9c-45a3-a0ad-13b1e55e0019 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:17.997290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-353be462-6a9c-45a3-a0ad-13b1e55e0019 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:17.998105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-353be462-6a9c-45a3-a0ad-13b1e55e0019 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:17.998561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-353be462-6a9c-45a3-a0ad-13b1e55e0019 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:18.002975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:18.064630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-353be462-6a9c-45a3-a0ad-13b1e55e0019 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:18.073214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-353be462-6a9c-45a3-a0ad-13b1e55e0019 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.089054 Jul 14 16:11:18.073804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1289/2677] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:17 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:18.104586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c1c0c3a8-afa5-4f4a-b7c9-3f05fcfd7eca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:18.112442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c1c0c3a8-afa5-4f4a-b7c9-3f05fcfd7eca tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158155 Jul 14 16:11:18.113004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1389/2678] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:17 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:18.669242 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5b76ddee-5fc3-4523-9f44-b53b346bf692 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:18.669879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5b76ddee-5fc3-4523-9f44-b53b346bf692 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:18.676064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b76ddee-5fc3-4523-9f44-b53b346bf692 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:18.676521 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b76ddee-5fc3-4523-9f44-b53b346bf692 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:18.677285 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b76ddee-5fc3-4523-9f44-b53b346bf692 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:18.677725 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b76ddee-5fc3-4523-9f44-b53b346bf692 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:18.813400 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5b76ddee-5fc3-4523-9f44-b53b346bf692 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:18.822172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5b76ddee-5fc3-4523-9f44-b53b346bf692 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157077 Jul 14 16:11:18.822748 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1290/2679] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:18 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:19.090788 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-11c8e25f-5fc9-43a9-af2c-c70c3aaa16fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:19.091341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-11c8e25f-5fc9-43a9-af2c-c70c3aaa16fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:19.098054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11c8e25f-5fc9-43a9-af2c-c70c3aaa16fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:19.098532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11c8e25f-5fc9-43a9-af2c-c70c3aaa16fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:19.099296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11c8e25f-5fc9-43a9-af2c-c70c3aaa16fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:19.099781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-11c8e25f-5fc9-43a9-af2c-c70c3aaa16fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:19.129481 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c50c1aac-5bb4-4330-bb0c-03b156f2d5b4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:19.130096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c50c1aac-5bb4-4330-bb0c-03b156f2d5b4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:19.137811 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c50c1aac-5bb4-4330-bb0c-03b156f2d5b4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:19.138267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c50c1aac-5bb4-4330-bb0c-03b156f2d5b4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:19.139035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c50c1aac-5bb4-4330-bb0c-03b156f2d5b4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:19.139477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c50c1aac-5bb4-4330-bb0c-03b156f2d5b4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:19.164461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-11c8e25f-5fc9-43a9-af2c-c70c3aaa16fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:19.173341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-11c8e25f-5fc9-43a9-af2c-c70c3aaa16fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086945 Jul 14 16:11:19.173916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1390/2680] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:19 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:19.269593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c50c1aac-5bb4-4330-bb0c-03b156f2d5b4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:19.278180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c50c1aac-5bb4-4330-bb0c-03b156f2d5b4 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152509 Jul 14 16:11:19.278742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1291/2681] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:19 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:19.839774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b13307f3-fecf-4ed7-9431-9eda512c20e5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:19.840400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b13307f3-fecf-4ed7-9431-9eda512c20e5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:19.846597 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b13307f3-fecf-4ed7-9431-9eda512c20e5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:19.847049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b13307f3-fecf-4ed7-9431-9eda512c20e5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:19.847848 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b13307f3-fecf-4ed7-9431-9eda512c20e5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:19.848294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b13307f3-fecf-4ed7-9431-9eda512c20e5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:19.989309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b13307f3-fecf-4ed7-9431-9eda512c20e5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:19.998018 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b13307f3-fecf-4ed7-9431-9eda512c20e5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.162789 Jul 14 16:11:19.998590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1391/2682] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:19 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:20.190656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a4a1ddcb-eb86-49ea-8677-7f270274f2ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:20.191366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a4a1ddcb-eb86-49ea-8677-7f270274f2ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:20.198748 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a4a1ddcb-eb86-49ea-8677-7f270274f2ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:20.199227 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a4a1ddcb-eb86-49ea-8677-7f270274f2ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:20.200045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a4a1ddcb-eb86-49ea-8677-7f270274f2ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:20.200495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a4a1ddcb-eb86-49ea-8677-7f270274f2ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:20.276465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a4a1ddcb-eb86-49ea-8677-7f270274f2ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:20.285575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a4a1ddcb-eb86-49ea-8677-7f270274f2ad tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.098998 Jul 14 16:11:20.286144 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1292/2683] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:20 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:20.295455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f44512f7-5933-4912-9297-2fce2e480484 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:20.296128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f44512f7-5933-4912-9297-2fce2e480484 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:20.302692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f44512f7-5933-4912-9297-2fce2e480484 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:20.303136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f44512f7-5933-4912-9297-2fce2e480484 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:20.303922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f44512f7-5933-4912-9297-2fce2e480484 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:20.304935 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f44512f7-5933-4912-9297-2fce2e480484 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:20.439734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f44512f7-5933-4912-9297-2fce2e480484 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:20.449061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f44512f7-5933-4912-9297-2fce2e480484 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157623 Jul 14 16:11:20.449563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1392/2684] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:20 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:21.015114 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-18bc7b63-798c-4932-bfdb-48cf08e748d1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:21.015781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-18bc7b63-798c-4932-bfdb-48cf08e748d1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:21.021930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-18bc7b63-798c-4932-bfdb-48cf08e748d1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:21.022391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-18bc7b63-798c-4932-bfdb-48cf08e748d1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:21.023676 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-18bc7b63-798c-4932-bfdb-48cf08e748d1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:21.024200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-18bc7b63-798c-4932-bfdb-48cf08e748d1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:21.162073 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-18bc7b63-798c-4932-bfdb-48cf08e748d1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:21.171497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-18bc7b63-798c-4932-bfdb-48cf08e748d1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.160726 Jul 14 16:11:21.172406 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1293/2685] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:21 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:21.304004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3b4709a4-92b8-499a-b776-c40919484ada tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:21.304574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3b4709a4-92b8-499a-b776-c40919484ada tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:21.311969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3b4709a4-92b8-499a-b776-c40919484ada tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:21.312414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3b4709a4-92b8-499a-b776-c40919484ada tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:21.313197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3b4709a4-92b8-499a-b776-c40919484ada tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:21.313632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3b4709a4-92b8-499a-b776-c40919484ada tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:21.377297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3b4709a4-92b8-499a-b776-c40919484ada tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:21.387826 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3b4709a4-92b8-499a-b776-c40919484ada tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087739 Jul 14 16:11:21.388479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1393/2686] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:21 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:21.466126 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f9bbbf71-cef5-4bf8-99fa-bb38762cee80 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:21.466746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f9bbbf71-cef5-4bf8-99fa-bb38762cee80 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:21.473229 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9bbbf71-cef5-4bf8-99fa-bb38762cee80 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:21.473677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9bbbf71-cef5-4bf8-99fa-bb38762cee80 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:21.474432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9bbbf71-cef5-4bf8-99fa-bb38762cee80 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:21.474870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9bbbf71-cef5-4bf8-99fa-bb38762cee80 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:21.611790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f9bbbf71-cef5-4bf8-99fa-bb38762cee80 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:21.620569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f9bbbf71-cef5-4bf8-99fa-bb38762cee80 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158262 Jul 14 16:11:21.621142 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1294/2687] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:21 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:22.192945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-29f91cf5-0210-40da-b7b5-ec30f73932bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:22.193680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-29f91cf5-0210-40da-b7b5-ec30f73932bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:22.201550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29f91cf5-0210-40da-b7b5-ec30f73932bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:22.202126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29f91cf5-0210-40da-b7b5-ec30f73932bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:22.203016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29f91cf5-0210-40da-b7b5-ec30f73932bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:22.203561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-29f91cf5-0210-40da-b7b5-ec30f73932bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:22.339865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-29f91cf5-0210-40da-b7b5-ec30f73932bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:22.347983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-29f91cf5-0210-40da-b7b5-ec30f73932bf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.161578 Jul 14 16:11:22.348553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1394/2688] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:22 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:22.406594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f909ad4f-65d7-41e1-9a63-727e406012b2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:22.407208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f909ad4f-65d7-41e1-9a63-727e406012b2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:22.413429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f909ad4f-65d7-41e1-9a63-727e406012b2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:22.413889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f909ad4f-65d7-41e1-9a63-727e406012b2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:22.414692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f909ad4f-65d7-41e1-9a63-727e406012b2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:22.415133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f909ad4f-65d7-41e1-9a63-727e406012b2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:22.478349 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f909ad4f-65d7-41e1-9a63-727e406012b2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:22.486751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f909ad4f-65d7-41e1-9a63-727e406012b2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.083944 Jul 14 16:11:22.487335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1295/2689] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:22 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:22.638719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4ae2bac4-c72e-4128-a9a8-8294282ab831 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:22.639270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4ae2bac4-c72e-4128-a9a8-8294282ab831 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:22.645601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ae2bac4-c72e-4128-a9a8-8294282ab831 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:22.646047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ae2bac4-c72e-4128-a9a8-8294282ab831 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:22.646799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ae2bac4-c72e-4128-a9a8-8294282ab831 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:22.647231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4ae2bac4-c72e-4128-a9a8-8294282ab831 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:22.782777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4ae2bac4-c72e-4128-a9a8-8294282ab831 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:22.791152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4ae2bac4-c72e-4128-a9a8-8294282ab831 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.156416 Jul 14 16:11:22.791751 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1395/2690] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:22 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:23.365158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-62d663cb-3635-4ec5-986d-7ac7915f2ddd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:23.365685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-62d663cb-3635-4ec5-986d-7ac7915f2ddd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:23.372845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62d663cb-3635-4ec5-986d-7ac7915f2ddd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:23.373298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62d663cb-3635-4ec5-986d-7ac7915f2ddd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:23.374060 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62d663cb-3635-4ec5-986d-7ac7915f2ddd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:23.374498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-62d663cb-3635-4ec5-986d-7ac7915f2ddd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:23.504504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ebdaae9b-689d-45e9-ad15-4689e495db6e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:23.505129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ebdaae9b-689d-45e9-ad15-4689e495db6e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:23.512757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ebdaae9b-689d-45e9-ad15-4689e495db6e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:23.513216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ebdaae9b-689d-45e9-ad15-4689e495db6e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:23.513586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-62d663cb-3635-4ec5-986d-7ac7915f2ddd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:23.514067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ebdaae9b-689d-45e9-ad15-4689e495db6e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:23.514412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ebdaae9b-689d-45e9-ad15-4689e495db6e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:23.521923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-62d663cb-3635-4ec5-986d-7ac7915f2ddd tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.160841 Jul 14 16:11:23.522497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1296/2691] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:23 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:23.578634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ebdaae9b-689d-45e9-ad15-4689e495db6e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:23.586865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ebdaae9b-689d-45e9-ad15-4689e495db6e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086095 Jul 14 16:11:23.587426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1396/2692] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:23 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:23.811333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-218b84aa-2924-40cc-bc42-788b1e859ae3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:23.811996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-218b84aa-2924-40cc-bc42-788b1e859ae3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:23.818064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-218b84aa-2924-40cc-bc42-788b1e859ae3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:23.818515 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-218b84aa-2924-40cc-bc42-788b1e859ae3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:23.819271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-218b84aa-2924-40cc-bc42-788b1e859ae3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:23.819736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-218b84aa-2924-40cc-bc42-788b1e859ae3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:23.947500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-218b84aa-2924-40cc-bc42-788b1e859ae3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:23.955614 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-218b84aa-2924-40cc-bc42-788b1e859ae3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.148605 Jul 14 16:11:23.956196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1297/2693] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:23 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:24.539221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ffbe3952-c68f-4e1f-a302-89963c44daab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:24.540014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ffbe3952-c68f-4e1f-a302-89963c44daab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:24.548468 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffbe3952-c68f-4e1f-a302-89963c44daab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:24.548966 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffbe3952-c68f-4e1f-a302-89963c44daab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:24.549894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffbe3952-c68f-4e1f-a302-89963c44daab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:24.550399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ffbe3952-c68f-4e1f-a302-89963c44daab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:24.603684 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2eddb16b-37fc-462a-b40b-698cfde7118b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:24.604549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2eddb16b-37fc-462a-b40b-698cfde7118b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:24.616621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2eddb16b-37fc-462a-b40b-698cfde7118b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:24.617072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2eddb16b-37fc-462a-b40b-698cfde7118b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:24.618177 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2eddb16b-37fc-462a-b40b-698cfde7118b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:24.618390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2eddb16b-37fc-462a-b40b-698cfde7118b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:24.686767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2eddb16b-37fc-462a-b40b-698cfde7118b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:24.694804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2eddb16b-37fc-462a-b40b-698cfde7118b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.095205 Jul 14 16:11:24.695390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1298/2694] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:24 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:24.704963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ffbe3952-c68f-4e1f-a302-89963c44daab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:24.708384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:24.714826 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ffbe3952-c68f-4e1f-a302-89963c44daab tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.180250 Jul 14 16:11:24.715393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1397/2695] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:24 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:24.973254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-85fbe1a8-1867-4a09-a1d9-69ae6d34d6d9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:24.973857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-85fbe1a8-1867-4a09-a1d9-69ae6d34d6d9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:24.980927 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85fbe1a8-1867-4a09-a1d9-69ae6d34d6d9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:24.981375 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85fbe1a8-1867-4a09-a1d9-69ae6d34d6d9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:24.982144 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85fbe1a8-1867-4a09-a1d9-69ae6d34d6d9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:24.982584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85fbe1a8-1867-4a09-a1d9-69ae6d34d6d9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:25.118498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-85fbe1a8-1867-4a09-a1d9-69ae6d34d6d9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:25.126641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-85fbe1a8-1867-4a09-a1d9-69ae6d34d6d9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157277 Jul 14 16:11:25.127210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1299/2696] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:24 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:25.712792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e21e4b6b-5dd6-4303-8963-6ca02f4bd48c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:25.714094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e21e4b6b-5dd6-4303-8963-6ca02f4bd48c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:25.720547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e21e4b6b-5dd6-4303-8963-6ca02f4bd48c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:25.720999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e21e4b6b-5dd6-4303-8963-6ca02f4bd48c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:25.722866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e21e4b6b-5dd6-4303-8963-6ca02f4bd48c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:25.723304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e21e4b6b-5dd6-4303-8963-6ca02f4bd48c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:25.733511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fbd1e0ea-982b-4075-b3a1-fec44e664ce1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:25.734155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fbd1e0ea-982b-4075-b3a1-fec44e664ce1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:25.740634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fbd1e0ea-982b-4075-b3a1-fec44e664ce1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:25.741085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fbd1e0ea-982b-4075-b3a1-fec44e664ce1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:25.741853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fbd1e0ea-982b-4075-b3a1-fec44e664ce1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:25.742300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fbd1e0ea-982b-4075-b3a1-fec44e664ce1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:25.794165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e21e4b6b-5dd6-4303-8963-6ca02f4bd48c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:25.802294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e21e4b6b-5dd6-4303-8963-6ca02f4bd48c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.094017 Jul 14 16:11:25.802868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1398/2697] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:25 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:25.874782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fbd1e0ea-982b-4075-b3a1-fec44e664ce1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:25.882784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fbd1e0ea-982b-4075-b3a1-fec44e664ce1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154327 Jul 14 16:11:25.883940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1300/2698] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:25 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:26.144752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b2b3c043-7741-4b06-86f4-77848aa2aafa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:26.145387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b2b3c043-7741-4b06-86f4-77848aa2aafa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:26.152477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2b3c043-7741-4b06-86f4-77848aa2aafa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:26.152931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2b3c043-7741-4b06-86f4-77848aa2aafa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:26.153702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2b3c043-7741-4b06-86f4-77848aa2aafa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:26.154140 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b2b3c043-7741-4b06-86f4-77848aa2aafa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:26.285359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b2b3c043-7741-4b06-86f4-77848aa2aafa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:26.294237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b2b3c043-7741-4b06-86f4-77848aa2aafa tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153461 Jul 14 16:11:26.294840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1399/2699] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:26 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:26.819893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1762207d-ea9a-4a5e-b0de-3db218cb3fbd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:26.820482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1762207d-ea9a-4a5e-b0de-3db218cb3fbd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:26.827227 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1762207d-ea9a-4a5e-b0de-3db218cb3fbd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:26.827712 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1762207d-ea9a-4a5e-b0de-3db218cb3fbd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:26.828513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1762207d-ea9a-4a5e-b0de-3db218cb3fbd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:26.828955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1762207d-ea9a-4a5e-b0de-3db218cb3fbd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:26.894901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1762207d-ea9a-4a5e-b0de-3db218cb3fbd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:26.900225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-00b0ca0a-c24d-4954-92dc-6b26a3f40ef4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:26.900923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-00b0ca0a-c24d-4954-92dc-6b26a3f40ef4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:26.903488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1762207d-ea9a-4a5e-b0de-3db218cb3fbd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087639 Jul 14 16:11:26.904409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1301/2700] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:26 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:26.907801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-00b0ca0a-c24d-4954-92dc-6b26a3f40ef4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:26.908287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-00b0ca0a-c24d-4954-92dc-6b26a3f40ef4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:26.909083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-00b0ca0a-c24d-4954-92dc-6b26a3f40ef4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:26.909547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-00b0ca0a-c24d-4954-92dc-6b26a3f40ef4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:27.045061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-00b0ca0a-c24d-4954-92dc-6b26a3f40ef4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:27.053714 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-00b0ca0a-c24d-4954-92dc-6b26a3f40ef4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157293 Jul 14 16:11:27.054286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1400/2701] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:26 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:27.311565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-443f46f5-1920-4d53-a473-8f5b6343e612 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:27.312211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-443f46f5-1920-4d53-a473-8f5b6343e612 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:27.318314 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-443f46f5-1920-4d53-a473-8f5b6343e612 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:27.318806 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-443f46f5-1920-4d53-a473-8f5b6343e612 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:27.319565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-443f46f5-1920-4d53-a473-8f5b6343e612 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:27.320029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-443f46f5-1920-4d53-a473-8f5b6343e612 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:27.451292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-443f46f5-1920-4d53-a473-8f5b6343e612 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:27.459238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-443f46f5-1920-4d53-a473-8f5b6343e612 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151536 Jul 14 16:11:27.459834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1302/2702] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:27 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:27.920984 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cdde0dca-a66d-4c75-859b-bb2b484646f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:27.921600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cdde0dca-a66d-4c75-859b-bb2b484646f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:27.928179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cdde0dca-a66d-4c75-859b-bb2b484646f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:27.928631 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cdde0dca-a66d-4c75-859b-bb2b484646f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:27.929392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cdde0dca-a66d-4c75-859b-bb2b484646f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:27.929829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cdde0dca-a66d-4c75-859b-bb2b484646f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:27.992205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cdde0dca-a66d-4c75-859b-bb2b484646f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:28.000920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cdde0dca-a66d-4c75-859b-bb2b484646f3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084012 Jul 14 16:11:28.001500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1401/2703] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:27 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:28.071039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a40ba887-31e8-45de-9023-e9645b6172d7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:28.072118 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a40ba887-31e8-45de-9023-e9645b6172d7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:28.078610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a40ba887-31e8-45de-9023-e9645b6172d7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:28.079064 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a40ba887-31e8-45de-9023-e9645b6172d7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:28.079869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a40ba887-31e8-45de-9023-e9645b6172d7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:28.080309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a40ba887-31e8-45de-9023-e9645b6172d7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:28.212152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a40ba887-31e8-45de-9023-e9645b6172d7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:28.221179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a40ba887-31e8-45de-9023-e9645b6172d7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154242 Jul 14 16:11:28.221747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1303/2704] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:28 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:28.477920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c4cfda3a-efec-4ff6-b1a0-da4529b363f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:28.478497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c4cfda3a-efec-4ff6-b1a0-da4529b363f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:28.484861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4cfda3a-efec-4ff6-b1a0-da4529b363f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:28.485336 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4cfda3a-efec-4ff6-b1a0-da4529b363f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:28.486106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4cfda3a-efec-4ff6-b1a0-da4529b363f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:28.486557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c4cfda3a-efec-4ff6-b1a0-da4529b363f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:28.620599 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c4cfda3a-efec-4ff6-b1a0-da4529b363f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:28.628572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c4cfda3a-efec-4ff6-b1a0-da4529b363f8 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154910 Jul 14 16:11:28.629136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1402/2705] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:28 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:29.018162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5b586a9f-cd3a-4fbb-b4c1-ad3e9433bec5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:29.018800 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5b586a9f-cd3a-4fbb-b4c1-ad3e9433bec5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:29.025083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b586a9f-cd3a-4fbb-b4c1-ad3e9433bec5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:29.026517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b586a9f-cd3a-4fbb-b4c1-ad3e9433bec5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:29.027124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b586a9f-cd3a-4fbb-b4c1-ad3e9433bec5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:29.027530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b586a9f-cd3a-4fbb-b4c1-ad3e9433bec5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:29.096164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5b586a9f-cd3a-4fbb-b4c1-ad3e9433bec5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:29.104577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5b586a9f-cd3a-4fbb-b4c1-ad3e9433bec5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.090382 Jul 14 16:11:29.105270 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1304/2706] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:29 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:29.238537 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5820fd93-1b59-4ddd-a21c-e32208df2cbf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:29.239162 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5820fd93-1b59-4ddd-a21c-e32208df2cbf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:29.246259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5820fd93-1b59-4ddd-a21c-e32208df2cbf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:29.246687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5820fd93-1b59-4ddd-a21c-e32208df2cbf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:29.247479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5820fd93-1b59-4ddd-a21c-e32208df2cbf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:29.247955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5820fd93-1b59-4ddd-a21c-e32208df2cbf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:29.381657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5820fd93-1b59-4ddd-a21c-e32208df2cbf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:29.390303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5820fd93-1b59-4ddd-a21c-e32208df2cbf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155818 Jul 14 16:11:29.390914 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1403/2707] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:29 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:29.646486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c942963e-6e4e-4517-8dfb-54b122ad7b23 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:29.647104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c942963e-6e4e-4517-8dfb-54b122ad7b23 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:29.653383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c942963e-6e4e-4517-8dfb-54b122ad7b23 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:29.653838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c942963e-6e4e-4517-8dfb-54b122ad7b23 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:29.654602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c942963e-6e4e-4517-8dfb-54b122ad7b23 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:29.655046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c942963e-6e4e-4517-8dfb-54b122ad7b23 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:29.787625 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c942963e-6e4e-4517-8dfb-54b122ad7b23 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:29.791536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:29.797853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c942963e-6e4e-4517-8dfb-54b122ad7b23 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155356 Jul 14 16:11:29.798462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1305/2708] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:29 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:30.122134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6c4f6589-1999-4762-bdc2-aaa1ffda8a02 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:30.122742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6c4f6589-1999-4762-bdc2-aaa1ffda8a02 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:30.128821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6c4f6589-1999-4762-bdc2-aaa1ffda8a02 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:30.129273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6c4f6589-1999-4762-bdc2-aaa1ffda8a02 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:30.130027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6c4f6589-1999-4762-bdc2-aaa1ffda8a02 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:30.130465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6c4f6589-1999-4762-bdc2-aaa1ffda8a02 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:30.192104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6c4f6589-1999-4762-bdc2-aaa1ffda8a02 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:30.200097 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6c4f6589-1999-4762-bdc2-aaa1ffda8a02 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.082264 Jul 14 16:11:30.200664 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1404/2709] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:30 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:30.407558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b28cb461-64a7-472a-be72-8c24c474a5b6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:30.408202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b28cb461-64a7-472a-be72-8c24c474a5b6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:30.414917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b28cb461-64a7-472a-be72-8c24c474a5b6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:30.415424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b28cb461-64a7-472a-be72-8c24c474a5b6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:30.416785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b28cb461-64a7-472a-be72-8c24c474a5b6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:30.417474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b28cb461-64a7-472a-be72-8c24c474a5b6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:30.549257 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b28cb461-64a7-472a-be72-8c24c474a5b6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:30.558329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b28cb461-64a7-472a-be72-8c24c474a5b6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154306 Jul 14 16:11:30.558899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1306/2710] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:30 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:30.816501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5dbaf606-3c9b-4161-b52c-26ac5115a374 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:30.817071 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5dbaf606-3c9b-4161-b52c-26ac5115a374 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:30.823882 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5dbaf606-3c9b-4161-b52c-26ac5115a374 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:30.824330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5dbaf606-3c9b-4161-b52c-26ac5115a374 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:30.825093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5dbaf606-3c9b-4161-b52c-26ac5115a374 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:30.825530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5dbaf606-3c9b-4161-b52c-26ac5115a374 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:30.957918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5dbaf606-3c9b-4161-b52c-26ac5115a374 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:30.966715 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5dbaf606-3c9b-4161-b52c-26ac5115a374 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154196 Jul 14 16:11:30.967271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1405/2711] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:30 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:31.217154 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d2c19b08-6f35-4e55-b4b3-732ef6087f97 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:31.217785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d2c19b08-6f35-4e55-b4b3-732ef6087f97 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:31.223914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d2c19b08-6f35-4e55-b4b3-732ef6087f97 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:31.224369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d2c19b08-6f35-4e55-b4b3-732ef6087f97 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:31.225133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d2c19b08-6f35-4e55-b4b3-732ef6087f97 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:31.225578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d2c19b08-6f35-4e55-b4b3-732ef6087f97 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:31.291869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d2c19b08-6f35-4e55-b4b3-732ef6087f97 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:31.300373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d2c19b08-6f35-4e55-b4b3-732ef6087f97 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087376 Jul 14 16:11:31.300946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1307/2712] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:31 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:31.576080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e9a154a2-bdff-47aa-8668-6fb48ddc2bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:31.576609 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e9a154a2-bdff-47aa-8668-6fb48ddc2bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:31.578494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=78 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:31.583868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e9a154a2-bdff-47aa-8668-6fb48ddc2bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:31.584325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e9a154a2-bdff-47aa-8668-6fb48ddc2bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:31.585079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e9a154a2-bdff-47aa-8668-6fb48ddc2bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:31.585520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e9a154a2-bdff-47aa-8668-6fb48ddc2bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:31.722561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e9a154a2-bdff-47aa-8668-6fb48ddc2bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:31.731452 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e9a154a2-bdff-47aa-8668-6fb48ddc2bd7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.159661 Jul 14 16:11:31.732057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1406/2713] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:31 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:31.984107 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b9656d00-cd82-46a9-aceb-cab97146e830 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:31.984720 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b9656d00-cd82-46a9-aceb-cab97146e830 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:31.991277 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b9656d00-cd82-46a9-aceb-cab97146e830 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:31.991765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b9656d00-cd82-46a9-aceb-cab97146e830 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:31.992543 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b9656d00-cd82-46a9-aceb-cab97146e830 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:31.992982 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b9656d00-cd82-46a9-aceb-cab97146e830 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:32.124584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b9656d00-cd82-46a9-aceb-cab97146e830 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:32.132430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b9656d00-cd82-46a9-aceb-cab97146e830 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152484 Jul 14 16:11:32.133003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1308/2714] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:31 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:32.317508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-66aedc67-aed4-46fa-9529-26717aa2e83d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:32.318070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-66aedc67-aed4-46fa-9529-26717aa2e83d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:32.325598 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66aedc67-aed4-46fa-9529-26717aa2e83d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:32.326049 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66aedc67-aed4-46fa-9529-26717aa2e83d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:32.326814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66aedc67-aed4-46fa-9529-26717aa2e83d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:32.327255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66aedc67-aed4-46fa-9529-26717aa2e83d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:32.390292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-66aedc67-aed4-46fa-9529-26717aa2e83d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:32.398196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-66aedc67-aed4-46fa-9529-26717aa2e83d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084712 Jul 14 16:11:32.398771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1407/2715] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:32 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:32.749247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1e59ce64-cc61-4875-a4ce-303d9f6bdc26 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:32.749863 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1e59ce64-cc61-4875-a4ce-303d9f6bdc26 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:32.755916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1e59ce64-cc61-4875-a4ce-303d9f6bdc26 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:32.756371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1e59ce64-cc61-4875-a4ce-303d9f6bdc26 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:32.757135 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1e59ce64-cc61-4875-a4ce-303d9f6bdc26 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:32.757602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1e59ce64-cc61-4875-a4ce-303d9f6bdc26 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:32.884796 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1e59ce64-cc61-4875-a4ce-303d9f6bdc26 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:32.893035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1e59ce64-cc61-4875-a4ce-303d9f6bdc26 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.148246 Jul 14 16:11:32.893602 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1309/2716] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:32 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:33.150196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-366b1329-c065-406b-bae3-e554b920c7a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:33.150816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-366b1329-c065-406b-bae3-e554b920c7a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:33.157779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-366b1329-c065-406b-bae3-e554b920c7a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:33.158243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-366b1329-c065-406b-bae3-e554b920c7a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:33.158997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-366b1329-c065-406b-bae3-e554b920c7a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:33.159434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-366b1329-c065-406b-bae3-e554b920c7a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:33.300057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-366b1329-c065-406b-bae3-e554b920c7a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:33.308371 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-366b1329-c065-406b-bae3-e554b920c7a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.161989 Jul 14 16:11:33.308977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1408/2717] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:33 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:33.414290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-53d19984-6719-462a-ad94-01f2e4b6d0fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:33.414865 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-53d19984-6719-462a-ad94-01f2e4b6d0fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:33.421730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-53d19984-6719-462a-ad94-01f2e4b6d0fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:33.422177 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-53d19984-6719-462a-ad94-01f2e4b6d0fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:33.422941 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-53d19984-6719-462a-ad94-01f2e4b6d0fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:33.423379 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-53d19984-6719-462a-ad94-01f2e4b6d0fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:33.488239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-53d19984-6719-462a-ad94-01f2e4b6d0fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:33.496427 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-53d19984-6719-462a-ad94-01f2e4b6d0fe tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086038 Jul 14 16:11:33.496997 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1310/2718] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:33 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:33.910283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-62230df9-753d-4856-8881-1bd34c070347 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:33.910895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-62230df9-753d-4856-8881-1bd34c070347 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:33.917081 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62230df9-753d-4856-8881-1bd34c070347 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:33.917604 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62230df9-753d-4856-8881-1bd34c070347 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:33.918354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62230df9-753d-4856-8881-1bd34c070347 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:33.919044 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-62230df9-753d-4856-8881-1bd34c070347 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:34.048463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-62230df9-753d-4856-8881-1bd34c070347 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:34.056898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-62230df9-753d-4856-8881-1bd34c070347 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150496 Jul 14 16:11:34.058188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1409/2719] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:33 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:34.326346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-71a3e4c0-e896-4387-89d2-0a2f0c78773d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:34.326886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-71a3e4c0-e896-4387-89d2-0a2f0c78773d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:34.332949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71a3e4c0-e896-4387-89d2-0a2f0c78773d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:34.333402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71a3e4c0-e896-4387-89d2-0a2f0c78773d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:34.334165 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71a3e4c0-e896-4387-89d2-0a2f0c78773d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:34.334629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-71a3e4c0-e896-4387-89d2-0a2f0c78773d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:34.478225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-71a3e4c0-e896-4387-89d2-0a2f0c78773d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:34.486801 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-71a3e4c0-e896-4387-89d2-0a2f0c78773d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.164760 Jul 14 16:11:34.487370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1311/2720] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:34 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:34.513764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ac25f568-2b3c-4bfe-bdd4-206fe9f2d485 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:34.514378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ac25f568-2b3c-4bfe-bdd4-206fe9f2d485 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:34.520923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac25f568-2b3c-4bfe-bdd4-206fe9f2d485 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:34.521369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac25f568-2b3c-4bfe-bdd4-206fe9f2d485 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:34.522121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac25f568-2b3c-4bfe-bdd4-206fe9f2d485 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:34.522630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac25f568-2b3c-4bfe-bdd4-206fe9f2d485 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:34.585076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ac25f568-2b3c-4bfe-bdd4-206fe9f2d485 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:34.593864 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ac25f568-2b3c-4bfe-bdd4-206fe9f2d485 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084573 Jul 14 16:11:34.594437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1410/2721] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:34 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:35.077313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c89d212b-51e4-47c5-af25-0162e6f64a05 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:35.077919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c89d212b-51e4-47c5-af25-0162e6f64a05 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:35.084104 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c89d212b-51e4-47c5-af25-0162e6f64a05 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:35.084549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c89d212b-51e4-47c5-af25-0162e6f64a05 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:35.085299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c89d212b-51e4-47c5-af25-0162e6f64a05 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:35.085735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c89d212b-51e4-47c5-af25-0162e6f64a05 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:35.215035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c89d212b-51e4-47c5-af25-0162e6f64a05 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:35.222854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c89d212b-51e4-47c5-af25-0162e6f64a05 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.149860 Jul 14 16:11:35.223410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1312/2722] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:35 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:35.503907 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-149a84e8-dd5c-4ca0-a447-ec6f3447c8bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:35.504554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-149a84e8-dd5c-4ca0-a447-ec6f3447c8bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:35.511500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-149a84e8-dd5c-4ca0-a447-ec6f3447c8bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:35.512027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-149a84e8-dd5c-4ca0-a447-ec6f3447c8bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:35.512787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-149a84e8-dd5c-4ca0-a447-ec6f3447c8bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:35.513225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-149a84e8-dd5c-4ca0-a447-ec6f3447c8bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:35.610933 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-68347d4c-dc8e-444a-ba80-4636c8e04741 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:35.611706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-68347d4c-dc8e-444a-ba80-4636c8e04741 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:35.618270 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68347d4c-dc8e-444a-ba80-4636c8e04741 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:35.618714 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68347d4c-dc8e-444a-ba80-4636c8e04741 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:35.619477 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68347d4c-dc8e-444a-ba80-4636c8e04741 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:35.620561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-68347d4c-dc8e-444a-ba80-4636c8e04741 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:35.652789 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-149a84e8-dd5c-4ca0-a447-ec6f3447c8bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:35.661020 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-149a84e8-dd5c-4ca0-a447-ec6f3447c8bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.160910 Jul 14 16:11:35.661605 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1411/2723] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:35 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:35.688325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-68347d4c-dc8e-444a-ba80-4636c8e04741 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:35.696523 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-68347d4c-dc8e-444a-ba80-4636c8e04741 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.089413 Jul 14 16:11:35.697090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1313/2724] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:35 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:36.240058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ce36aafe-e5b5-415b-ab89-b9e6b311a50f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:36.240665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ce36aafe-e5b5-415b-ab89-b9e6b311a50f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:36.247104 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce36aafe-e5b5-415b-ab89-b9e6b311a50f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:36.247495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce36aafe-e5b5-415b-ab89-b9e6b311a50f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:36.248277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce36aafe-e5b5-415b-ab89-b9e6b311a50f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:36.248709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce36aafe-e5b5-415b-ab89-b9e6b311a50f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:36.378649 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ce36aafe-e5b5-415b-ab89-b9e6b311a50f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:36.387254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ce36aafe-e5b5-415b-ab89-b9e6b311a50f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151286 Jul 14 16:11:36.387879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1412/2725] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:36 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:36.678910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-04b13f85-c1a6-45af-8446-22a97d096de0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:36.679507 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-04b13f85-c1a6-45af-8446-22a97d096de0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:36.686870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04b13f85-c1a6-45af-8446-22a97d096de0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:36.687324 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04b13f85-c1a6-45af-8446-22a97d096de0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:36.688155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04b13f85-c1a6-45af-8446-22a97d096de0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:36.688599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-04b13f85-c1a6-45af-8446-22a97d096de0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:36.713486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ec892fca-adc0-4b8a-a4ef-988e0a3f69f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:36.714293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ec892fca-adc0-4b8a-a4ef-988e0a3f69f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:36.720786 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec892fca-adc0-4b8a-a4ef-988e0a3f69f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:36.721239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec892fca-adc0-4b8a-a4ef-988e0a3f69f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:36.722007 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec892fca-adc0-4b8a-a4ef-988e0a3f69f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:36.722448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ec892fca-adc0-4b8a-a4ef-988e0a3f69f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:36.785160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ec892fca-adc0-4b8a-a4ef-988e0a3f69f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:36.793410 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ec892fca-adc0-4b8a-a4ef-988e0a3f69f9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.083773 Jul 14 16:11:36.794283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1413/2726] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:36 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:36.818078 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-04b13f85-c1a6-45af-8446-22a97d096de0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:36.826696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-04b13f85-c1a6-45af-8446-22a97d096de0 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151687 Jul 14 16:11:36.827264 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1314/2727] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:36 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:37.404596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2b0ec807-b37a-4669-8286-efbfed3d50a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:37.405208 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2b0ec807-b37a-4669-8286-efbfed3d50a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:37.411263 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b0ec807-b37a-4669-8286-efbfed3d50a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:37.411761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b0ec807-b37a-4669-8286-efbfed3d50a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:37.412518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b0ec807-b37a-4669-8286-efbfed3d50a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:37.412959 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2b0ec807-b37a-4669-8286-efbfed3d50a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:37.431343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:37.546711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2b0ec807-b37a-4669-8286-efbfed3d50a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:37.554656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2b0ec807-b37a-4669-8286-efbfed3d50a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154147 Jul 14 16:11:37.555223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1414/2728] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:37 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:37.810784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9fb3b349-f3db-4757-87be-a880b711eb3f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:37.811374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9fb3b349-f3db-4757-87be-a880b711eb3f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:37.817890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9fb3b349-f3db-4757-87be-a880b711eb3f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:37.818339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9fb3b349-f3db-4757-87be-a880b711eb3f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:37.819093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9fb3b349-f3db-4757-87be-a880b711eb3f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:37.819531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9fb3b349-f3db-4757-87be-a880b711eb3f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:37.844510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-894d76d9-3765-4753-ba2f-b1e233f342bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:37.845120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-894d76d9-3765-4753-ba2f-b1e233f342bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:37.851550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-894d76d9-3765-4753-ba2f-b1e233f342bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:37.852040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-894d76d9-3765-4753-ba2f-b1e233f342bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:37.852794 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-894d76d9-3765-4753-ba2f-b1e233f342bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:37.853223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-894d76d9-3765-4753-ba2f-b1e233f342bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:37.881891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9fb3b349-f3db-4757-87be-a880b711eb3f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:37.891035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9fb3b349-f3db-4757-87be-a880b711eb3f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084564 Jul 14 16:11:37.891759 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1315/2729] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:37 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:37.981577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-894d76d9-3765-4753-ba2f-b1e233f342bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:37.989709 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-894d76d9-3765-4753-ba2f-b1e233f342bd tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.149010 Jul 14 16:11:37.990489 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1415/2730] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:37 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:38.571776 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3bc66fb2-9ecc-409d-9a7e-3d5f2e461534 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:38.572390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3bc66fb2-9ecc-409d-9a7e-3d5f2e461534 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:38.578880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bc66fb2-9ecc-409d-9a7e-3d5f2e461534 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:38.579333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bc66fb2-9ecc-409d-9a7e-3d5f2e461534 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:38.580126 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bc66fb2-9ecc-409d-9a7e-3d5f2e461534 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:38.580566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3bc66fb2-9ecc-409d-9a7e-3d5f2e461534 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:38.720480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3bc66fb2-9ecc-409d-9a7e-3d5f2e461534 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:38.728563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3bc66fb2-9ecc-409d-9a7e-3d5f2e461534 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.160646 Jul 14 16:11:38.729755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1316/2731] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:38 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:38.908167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-82f60310-4a8d-4c43-9a31-4cadf2ce100c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:38.908785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-82f60310-4a8d-4c43-9a31-4cadf2ce100c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:38.915266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-82f60310-4a8d-4c43-9a31-4cadf2ce100c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:38.915752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-82f60310-4a8d-4c43-9a31-4cadf2ce100c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:38.917029 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-82f60310-4a8d-4c43-9a31-4cadf2ce100c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:38.917469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-82f60310-4a8d-4c43-9a31-4cadf2ce100c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:38.983844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-82f60310-4a8d-4c43-9a31-4cadf2ce100c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:38.991872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-82f60310-4a8d-4c43-9a31-4cadf2ce100c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087607 Jul 14 16:11:38.992446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1416/2732] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:38 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:39.006044 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9fdcb72f-edeb-4751-a5ba-0b02da5b523d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:39.006747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9fdcb72f-edeb-4751-a5ba-0b02da5b523d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:39.013286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9fdcb72f-edeb-4751-a5ba-0b02da5b523d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:39.013734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9fdcb72f-edeb-4751-a5ba-0b02da5b523d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:39.014485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9fdcb72f-edeb-4751-a5ba-0b02da5b523d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:39.014921 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9fdcb72f-edeb-4751-a5ba-0b02da5b523d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:39.142049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9fdcb72f-edeb-4751-a5ba-0b02da5b523d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:39.153435 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9fdcb72f-edeb-4751-a5ba-0b02da5b523d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151058 Jul 14 16:11:39.154185 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1317/2733] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:39 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:39.746307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5384891c-91bd-4d1f-bb51-aa9a6b4e6c46 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:39.746946 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5384891c-91bd-4d1f-bb51-aa9a6b4e6c46 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:39.753095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5384891c-91bd-4d1f-bb51-aa9a6b4e6c46 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:39.753546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5384891c-91bd-4d1f-bb51-aa9a6b4e6c46 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:39.754302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5384891c-91bd-4d1f-bb51-aa9a6b4e6c46 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:39.754742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5384891c-91bd-4d1f-bb51-aa9a6b4e6c46 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:39.883188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5384891c-91bd-4d1f-bb51-aa9a6b4e6c46 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:39.892084 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5384891c-91bd-4d1f-bb51-aa9a6b4e6c46 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150226 Jul 14 16:11:39.892657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1417/2734] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:39 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:40.008825 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b654e203-5e84-4f7b-b288-32a972eade8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:40.009435 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b654e203-5e84-4f7b-b288-32a972eade8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:40.016582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b654e203-5e84-4f7b-b288-32a972eade8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:40.017033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b654e203-5e84-4f7b-b288-32a972eade8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:40.017791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b654e203-5e84-4f7b-b288-32a972eade8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:40.018228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b654e203-5e84-4f7b-b288-32a972eade8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:40.083451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b654e203-5e84-4f7b-b288-32a972eade8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:40.091673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b654e203-5e84-4f7b-b288-32a972eade8e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086712 Jul 14 16:11:40.092246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1318/2735] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:40 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:40.173497 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7a7cf588-690d-4937-9a91-6034c260afde tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:40.174106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7a7cf588-690d-4937-9a91-6034c260afde tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:40.180825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a7cf588-690d-4937-9a91-6034c260afde tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:40.181281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a7cf588-690d-4937-9a91-6034c260afde tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:40.182782 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a7cf588-690d-4937-9a91-6034c260afde tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:40.183577 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7a7cf588-690d-4937-9a91-6034c260afde tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:40.314123 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7a7cf588-690d-4937-9a91-6034c260afde tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:40.321888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7a7cf588-690d-4937-9a91-6034c260afde tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.152241 Jul 14 16:11:40.322448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1418/2736] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:40 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:40.910374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6f7e479e-8a30-4fef-8aed-6875ee73a4e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:40.911101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6f7e479e-8a30-4fef-8aed-6875ee73a4e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:40.918105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f7e479e-8a30-4fef-8aed-6875ee73a4e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:40.918812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f7e479e-8a30-4fef-8aed-6875ee73a4e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:40.919585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f7e479e-8a30-4fef-8aed-6875ee73a4e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:40.920318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6f7e479e-8a30-4fef-8aed-6875ee73a4e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:41.055487 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6f7e479e-8a30-4fef-8aed-6875ee73a4e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:41.064976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6f7e479e-8a30-4fef-8aed-6875ee73a4e8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.159400 Jul 14 16:11:41.065539 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1319/2737] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:40 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:41.108631 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6b0868d9-245c-46a8-9a25-466d31696b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:41.109240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6b0868d9-245c-46a8-9a25-466d31696b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:41.115212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b0868d9-245c-46a8-9a25-466d31696b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:41.115694 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b0868d9-245c-46a8-9a25-466d31696b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:41.116444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b0868d9-245c-46a8-9a25-466d31696b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:41.116880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6b0868d9-245c-46a8-9a25-466d31696b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:41.185680 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6b0868d9-245c-46a8-9a25-466d31696b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:41.193572 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6b0868d9-245c-46a8-9a25-466d31696b78 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.089107 Jul 14 16:11:41.194148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1419/2738] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:41 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:41.338489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d9fb6510-0203-4ab4-9a7f-449679cd55e3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:41.339284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d9fb6510-0203-4ab4-9a7f-449679cd55e3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:41.345361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9fb6510-0203-4ab4-9a7f-449679cd55e3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:41.345904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9fb6510-0203-4ab4-9a7f-449679cd55e3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:41.346672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9fb6510-0203-4ab4-9a7f-449679cd55e3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:41.347117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d9fb6510-0203-4ab4-9a7f-449679cd55e3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:41.474185 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d9fb6510-0203-4ab4-9a7f-449679cd55e3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:41.483038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d9fb6510-0203-4ab4-9a7f-449679cd55e3 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.148539 Jul 14 16:11:41.483640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1320/2739] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:41 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:42.082669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ba9df3a5-e149-437a-a389-0c591e891ad0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:42.083284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ba9df3a5-e149-437a-a389-0c591e891ad0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:42.089831 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba9df3a5-e149-437a-a389-0c591e891ad0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:42.090280 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba9df3a5-e149-437a-a389-0c591e891ad0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:42.091066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba9df3a5-e149-437a-a389-0c591e891ad0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:42.091500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba9df3a5-e149-437a-a389-0c591e891ad0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:42.210818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-173f0513-b78a-4d23-9a8d-89bd418b3313 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:42.211394 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-173f0513-b78a-4d23-9a8d-89bd418b3313 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:42.218174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-173f0513-b78a-4d23-9a8d-89bd418b3313 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:42.218622 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-173f0513-b78a-4d23-9a8d-89bd418b3313 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:42.219383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-173f0513-b78a-4d23-9a8d-89bd418b3313 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:42.219846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-173f0513-b78a-4d23-9a8d-89bd418b3313 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:42.221677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ba9df3a5-e149-437a-a389-0c591e891ad0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:42.230172 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ba9df3a5-e149-437a-a389-0c591e891ad0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151320 Jul 14 16:11:42.230757 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1420/2740] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:42 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:42.282950 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-173f0513-b78a-4d23-9a8d-89bd418b3313 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:42.290872 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-173f0513-b78a-4d23-9a8d-89bd418b3313 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.083956 Jul 14 16:11:42.292050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1321/2741] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:42 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:42.500579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-165aa4d1-a9eb-4379-b84f-079ed4e44d71 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:42.501116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-165aa4d1-a9eb-4379-b84f-079ed4e44d71 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:42.507352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-165aa4d1-a9eb-4379-b84f-079ed4e44d71 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:42.507520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-165aa4d1-a9eb-4379-b84f-079ed4e44d71 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:42.508314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-165aa4d1-a9eb-4379-b84f-079ed4e44d71 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:42.508759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-165aa4d1-a9eb-4379-b84f-079ed4e44d71 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:42.647679 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-165aa4d1-a9eb-4379-b84f-079ed4e44d71 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:42.655796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-165aa4d1-a9eb-4379-b84f-079ed4e44d71 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.159195 Jul 14 16:11:42.656368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1421/2742] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:42 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:43.248521 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5ba3a235-f119-4923-befe-f146e597fd29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:43.249122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5ba3a235-f119-4923-befe-f146e597fd29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:43.255668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ba3a235-f119-4923-befe-f146e597fd29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:43.256118 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ba3a235-f119-4923-befe-f146e597fd29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:43.256877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ba3a235-f119-4923-befe-f146e597fd29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:43.257312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5ba3a235-f119-4923-befe-f146e597fd29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:43.277744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:43.311532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-718c0bbc-9bef-4f5b-9c7d-0a23bac23bef tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:43.312155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-718c0bbc-9bef-4f5b-9c7d-0a23bac23bef tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:43.318754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-718c0bbc-9bef-4f5b-9c7d-0a23bac23bef tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:43.319202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-718c0bbc-9bef-4f5b-9c7d-0a23bac23bef tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:43.319990 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-718c0bbc-9bef-4f5b-9c7d-0a23bac23bef tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:43.320428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-718c0bbc-9bef-4f5b-9c7d-0a23bac23bef tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:43.392970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-718c0bbc-9bef-4f5b-9c7d-0a23bac23bef tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:43.399184 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5ba3a235-f119-4923-befe-f146e597fd29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:43.401869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-718c0bbc-9bef-4f5b-9c7d-0a23bac23bef tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.093331 Jul 14 16:11:43.402685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1422/2743] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:43 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:43.409000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5ba3a235-f119-4923-befe-f146e597fd29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.164534 Jul 14 16:11:43.409662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1322/2744] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:43 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:43.672510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2cd5816b-6a70-48df-a911-c34d43bebbfb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:43.673124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2cd5816b-6a70-48df-a911-c34d43bebbfb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:43.679502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2cd5816b-6a70-48df-a911-c34d43bebbfb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:43.680111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2cd5816b-6a70-48df-a911-c34d43bebbfb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:43.680805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2cd5816b-6a70-48df-a911-c34d43bebbfb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:43.681196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2cd5816b-6a70-48df-a911-c34d43bebbfb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:43.826071 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2cd5816b-6a70-48df-a911-c34d43bebbfb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:43.834188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2cd5816b-6a70-48df-a911-c34d43bebbfb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.165724 Jul 14 16:11:43.834687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1423/2745] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:43 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:44.420278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6de51ad8-206b-46c7-806a-9e09c18fd9c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:44.421641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6de51ad8-206b-46c7-806a-9e09c18fd9c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:44.427612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b6166719-fe6b-4ed6-9960-4e0549af73a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:44.428086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6de51ad8-206b-46c7-806a-9e09c18fd9c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:44.428236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b6166719-fe6b-4ed6-9960-4e0549af73a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:44.428361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6de51ad8-206b-46c7-806a-9e09c18fd9c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:44.429032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6de51ad8-206b-46c7-806a-9e09c18fd9c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:44.429463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6de51ad8-206b-46c7-806a-9e09c18fd9c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:44.435099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6166719-fe6b-4ed6-9960-4e0549af73a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:44.435552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6166719-fe6b-4ed6-9960-4e0549af73a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:44.436339 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6166719-fe6b-4ed6-9960-4e0549af73a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:44.436773 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b6166719-fe6b-4ed6-9960-4e0549af73a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:44.491546 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6de51ad8-206b-46c7-806a-9e09c18fd9c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:44.499510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6de51ad8-206b-46c7-806a-9e09c18fd9c1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084064 Jul 14 16:11:44.500867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1323/2746] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:44 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:44.567060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b6166719-fe6b-4ed6-9960-4e0549af73a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:44.576228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b6166719-fe6b-4ed6-9960-4e0549af73a0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152450 Jul 14 16:11:44.576801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1424/2747] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:44 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:44.852200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-267b7c22-90f6-4ef3-8d2d-e03bef13922e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:44.852736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-267b7c22-90f6-4ef3-8d2d-e03bef13922e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:44.854910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=80 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:44.860581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-267b7c22-90f6-4ef3-8d2d-e03bef13922e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:44.861034 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-267b7c22-90f6-4ef3-8d2d-e03bef13922e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:44.861815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-267b7c22-90f6-4ef3-8d2d-e03bef13922e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:44.862254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-267b7c22-90f6-4ef3-8d2d-e03bef13922e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:44.990113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-267b7c22-90f6-4ef3-8d2d-e03bef13922e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:44.999127 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-267b7c22-90f6-4ef3-8d2d-e03bef13922e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.150978 Jul 14 16:11:44.999724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1324/2748] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:44 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:45.516512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3479576b-0c60-45c7-860c-507a32d3f769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:45.517119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3479576b-0c60-45c7-860c-507a32d3f769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:45.524070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3479576b-0c60-45c7-860c-507a32d3f769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:45.524527 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3479576b-0c60-45c7-860c-507a32d3f769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:45.525294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3479576b-0c60-45c7-860c-507a32d3f769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:45.525763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3479576b-0c60-45c7-860c-507a32d3f769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:45.591058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3479576b-0c60-45c7-860c-507a32d3f769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:45.593727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-979b7e68-e726-4fc4-9295-2ae99ea57353 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:45.594346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-979b7e68-e726-4fc4-9295-2ae99ea57353 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:45.599151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3479576b-0c60-45c7-860c-507a32d3f769 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086498 Jul 14 16:11:45.599762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1425/2749] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:45 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:45.601141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-979b7e68-e726-4fc4-9295-2ae99ea57353 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:45.601603 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-979b7e68-e726-4fc4-9295-2ae99ea57353 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:45.602378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-979b7e68-e726-4fc4-9295-2ae99ea57353 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:45.602820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-979b7e68-e726-4fc4-9295-2ae99ea57353 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:45.743351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-979b7e68-e726-4fc4-9295-2ae99ea57353 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:45.752065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-979b7e68-e726-4fc4-9295-2ae99ea57353 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.162178 Jul 14 16:11:45.752646 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1325/2750] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:45 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:46.016276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-825fcdce-df66-4763-ad20-cf881cbf97a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:46.016926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-825fcdce-df66-4763-ad20-cf881cbf97a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:46.022901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-825fcdce-df66-4763-ad20-cf881cbf97a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:46.023365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-825fcdce-df66-4763-ad20-cf881cbf97a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:46.024163 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-825fcdce-df66-4763-ad20-cf881cbf97a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:46.024602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-825fcdce-df66-4763-ad20-cf881cbf97a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:46.154821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-825fcdce-df66-4763-ad20-cf881cbf97a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:46.163233 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-825fcdce-df66-4763-ad20-cf881cbf97a5 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.150789 Jul 14 16:11:46.163851 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1426/2751] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:46 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:46.616804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e1b68e03-6f44-4580-ba43-bd789246448b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:46.617417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e1b68e03-6f44-4580-ba43-bd789246448b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:46.625279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e1b68e03-6f44-4580-ba43-bd789246448b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:46.625760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e1b68e03-6f44-4580-ba43-bd789246448b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:46.626648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e1b68e03-6f44-4580-ba43-bd789246448b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:46.627090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e1b68e03-6f44-4580-ba43-bd789246448b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:46.693605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e1b68e03-6f44-4580-ba43-bd789246448b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:46.701850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e1b68e03-6f44-4580-ba43-bd789246448b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.089061 Jul 14 16:11:46.702409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1326/2752] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:46 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:46.770820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b66bd385-fd54-4dbd-9a20-2d87a25a779a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:46.771470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b66bd385-fd54-4dbd-9a20-2d87a25a779a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:46.779669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b66bd385-fd54-4dbd-9a20-2d87a25a779a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:46.780128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b66bd385-fd54-4dbd-9a20-2d87a25a779a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:46.780899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b66bd385-fd54-4dbd-9a20-2d87a25a779a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:46.781336 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b66bd385-fd54-4dbd-9a20-2d87a25a779a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:46.913190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b66bd385-fd54-4dbd-9a20-2d87a25a779a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:46.921885 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b66bd385-fd54-4dbd-9a20-2d87a25a779a tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155343 Jul 14 16:11:46.922461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1427/2753] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:46 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:47.181162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e1f54c76-5c6e-4ae5-8bac-34bc9f110434 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:47.181779 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e1f54c76-5c6e-4ae5-8bac-34bc9f110434 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:47.189873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e1f54c76-5c6e-4ae5-8bac-34bc9f110434 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:47.190496 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e1f54c76-5c6e-4ae5-8bac-34bc9f110434 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:47.191609 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e1f54c76-5c6e-4ae5-8bac-34bc9f110434 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:47.192233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e1f54c76-5c6e-4ae5-8bac-34bc9f110434 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:47.353959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e1f54c76-5c6e-4ae5-8bac-34bc9f110434 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:47.362430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e1f54c76-5c6e-4ae5-8bac-34bc9f110434 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.185129 Jul 14 16:11:47.363004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1327/2754] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:47 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:47.718677 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-78cb0867-6da6-4c9b-b8fd-e855fbaeca39 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:47.719292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-78cb0867-6da6-4c9b-b8fd-e855fbaeca39 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:47.725411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-78cb0867-6da6-4c9b-b8fd-e855fbaeca39 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:47.725860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-78cb0867-6da6-4c9b-b8fd-e855fbaeca39 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:47.726620 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-78cb0867-6da6-4c9b-b8fd-e855fbaeca39 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:47.727058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-78cb0867-6da6-4c9b-b8fd-e855fbaeca39 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:47.795681 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-78cb0867-6da6-4c9b-b8fd-e855fbaeca39 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:47.803745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-78cb0867-6da6-4c9b-b8fd-e855fbaeca39 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088920 Jul 14 16:11:47.804332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1428/2755] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:47 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:47.939043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-86024367-d0c6-4c12-a918-24cde1aecfd1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:47.939699 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-86024367-d0c6-4c12-a918-24cde1aecfd1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:47.946485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-86024367-d0c6-4c12-a918-24cde1aecfd1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:47.946932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-86024367-d0c6-4c12-a918-24cde1aecfd1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:47.947736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-86024367-d0c6-4c12-a918-24cde1aecfd1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:47.948176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-86024367-d0c6-4c12-a918-24cde1aecfd1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:48.078160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-86024367-d0c6-4c12-a918-24cde1aecfd1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:48.086033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-86024367-d0c6-4c12-a918-24cde1aecfd1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150845 Jul 14 16:11:48.086601 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1328/2756] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:47 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:48.381062 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-23eeffc2-04b7-4d38-9361-b02173cee342 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:48.381596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-23eeffc2-04b7-4d38-9361-b02173cee342 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:48.388695 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-23eeffc2-04b7-4d38-9361-b02173cee342 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:48.389146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-23eeffc2-04b7-4d38-9361-b02173cee342 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:48.389901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-23eeffc2-04b7-4d38-9361-b02173cee342 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:48.390333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-23eeffc2-04b7-4d38-9361-b02173cee342 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:48.521308 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-23eeffc2-04b7-4d38-9361-b02173cee342 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:48.530139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-23eeffc2-04b7-4d38-9361-b02173cee342 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153227 Jul 14 16:11:48.530703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1429/2757] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:48 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:48.821514 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-676ab232-6942-42f0-9874-43144a6884d5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:48.822122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-676ab232-6942-42f0-9874-43144a6884d5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:48.828975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-676ab232-6942-42f0-9874-43144a6884d5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:48.829419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-676ab232-6942-42f0-9874-43144a6884d5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:48.830174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-676ab232-6942-42f0-9874-43144a6884d5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:48.830607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-676ab232-6942-42f0-9874-43144a6884d5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:48.891343 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-676ab232-6942-42f0-9874-43144a6884d5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:48.899621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-676ab232-6942-42f0-9874-43144a6884d5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.082116 Jul 14 16:11:48.900198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1329/2758] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:48 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:49.103313 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-629ee5a9-4bff-4cc1-be23-252d459d960e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:49.103878 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-629ee5a9-4bff-4cc1-be23-252d459d960e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:49.111110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-629ee5a9-4bff-4cc1-be23-252d459d960e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:49.111561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-629ee5a9-4bff-4cc1-be23-252d459d960e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:49.112352 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-629ee5a9-4bff-4cc1-be23-252d459d960e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:49.112792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-629ee5a9-4bff-4cc1-be23-252d459d960e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:49.241861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-629ee5a9-4bff-4cc1-be23-252d459d960e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:49.250417 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-629ee5a9-4bff-4cc1-be23-252d459d960e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151020 Jul 14 16:11:49.250985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1430/2759] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:49 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:49.548096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-95a103a8-f68a-49d4-905f-9d1dea19b647 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:49.548706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-95a103a8-f68a-49d4-905f-9d1dea19b647 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:49.556775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-95a103a8-f68a-49d4-905f-9d1dea19b647 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:49.557240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-95a103a8-f68a-49d4-905f-9d1dea19b647 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:49.558651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-95a103a8-f68a-49d4-905f-9d1dea19b647 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:49.559094 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-95a103a8-f68a-49d4-905f-9d1dea19b647 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:49.697473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-95a103a8-f68a-49d4-905f-9d1dea19b647 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:49.706596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-95a103a8-f68a-49d4-905f-9d1dea19b647 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.162608 Jul 14 16:11:49.707175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1330/2760] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:49 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:49.916594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bd3e804e-05bb-4903-ac3d-70fc798d11a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:49.917303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bd3e804e-05bb-4903-ac3d-70fc798d11a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:49.923708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd3e804e-05bb-4903-ac3d-70fc798d11a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:49.924164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd3e804e-05bb-4903-ac3d-70fc798d11a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:49.924919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd3e804e-05bb-4903-ac3d-70fc798d11a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:49.925357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bd3e804e-05bb-4903-ac3d-70fc798d11a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:49.929210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:49.992225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bd3e804e-05bb-4903-ac3d-70fc798d11a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:50.000976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bd3e804e-05bb-4903-ac3d-70fc798d11a4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088268 Jul 14 16:11:50.001575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1431/2761] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:49 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:50.267709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5d5da31b-767e-415a-8bcd-4e08a9ceb231 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:50.268353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5d5da31b-767e-415a-8bcd-4e08a9ceb231 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:50.274374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d5da31b-767e-415a-8bcd-4e08a9ceb231 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:50.274828 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d5da31b-767e-415a-8bcd-4e08a9ceb231 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:50.275583 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d5da31b-767e-415a-8bcd-4e08a9ceb231 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:50.276076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d5da31b-767e-415a-8bcd-4e08a9ceb231 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:50.404666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5d5da31b-767e-415a-8bcd-4e08a9ceb231 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:50.412497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5d5da31b-767e-415a-8bcd-4e08a9ceb231 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.148669 Jul 14 16:11:50.413061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1331/2762] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:50 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:50.723259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-50cb3b97-909b-4ff7-ba84-59415d55fd42 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:50.723927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-50cb3b97-909b-4ff7-ba84-59415d55fd42 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:50.731030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-50cb3b97-909b-4ff7-ba84-59415d55fd42 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:50.731483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-50cb3b97-909b-4ff7-ba84-59415d55fd42 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:50.732273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-50cb3b97-909b-4ff7-ba84-59415d55fd42 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:50.732715 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-50cb3b97-909b-4ff7-ba84-59415d55fd42 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:50.862539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-50cb3b97-909b-4ff7-ba84-59415d55fd42 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:50.871237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-50cb3b97-909b-4ff7-ba84-59415d55fd42 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151851 Jul 14 16:11:50.871828 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1432/2763] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:50 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:51.019254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d63b29c2-5561-4356-856c-5795a8185e42 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:51.019920 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d63b29c2-5561-4356-856c-5795a8185e42 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:51.028607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d63b29c2-5561-4356-856c-5795a8185e42 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:51.029067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d63b29c2-5561-4356-856c-5795a8185e42 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:51.029845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d63b29c2-5561-4356-856c-5795a8185e42 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:51.030288 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d63b29c2-5561-4356-856c-5795a8185e42 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:51.093655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d63b29c2-5561-4356-856c-5795a8185e42 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:51.101696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d63b29c2-5561-4356-856c-5795a8185e42 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087567 Jul 14 16:11:51.102268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1332/2764] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:51 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:51.430298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-47efaef5-b1fa-4a61-a42c-274a56633e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:51.430920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-47efaef5-b1fa-4a61-a42c-274a56633e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:51.437598 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-47efaef5-b1fa-4a61-a42c-274a56633e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:51.438048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-47efaef5-b1fa-4a61-a42c-274a56633e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:51.438808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-47efaef5-b1fa-4a61-a42c-274a56633e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:51.439243 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-47efaef5-b1fa-4a61-a42c-274a56633e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:51.566788 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-47efaef5-b1fa-4a61-a42c-274a56633e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:51.576090 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-47efaef5-b1fa-4a61-a42c-274a56633e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.149735 Jul 14 16:11:51.576667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1433/2765] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:51 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:51.888596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-66e4d9e3-709c-4086-a7cf-48bb720d10ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:51.889173 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-66e4d9e3-709c-4086-a7cf-48bb720d10ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:51.895358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66e4d9e3-709c-4086-a7cf-48bb720d10ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:51.895842 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66e4d9e3-709c-4086-a7cf-48bb720d10ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:51.896595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66e4d9e3-709c-4086-a7cf-48bb720d10ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:51.897029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-66e4d9e3-709c-4086-a7cf-48bb720d10ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:52.030886 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-66e4d9e3-709c-4086-a7cf-48bb720d10ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:52.038702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-66e4d9e3-709c-4086-a7cf-48bb720d10ac tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154126 Jul 14 16:11:52.039265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1333/2766] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:51 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:52.119701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-4f8dd45a-9475-4944-9b97-4b888aed14a5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:52.121668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-4f8dd45a-9475-4944-9b97-4b888aed14a5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:52.128183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f8dd45a-9475-4944-9b97-4b888aed14a5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:52.128630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f8dd45a-9475-4944-9b97-4b888aed14a5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:52.130077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f8dd45a-9475-4944-9b97-4b888aed14a5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:52.130077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-4f8dd45a-9475-4944-9b97-4b888aed14a5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:52.196036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-4f8dd45a-9475-4944-9b97-4b888aed14a5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:52.204630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-4f8dd45a-9475-4944-9b97-4b888aed14a5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.090105 Jul 14 16:11:52.205202 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1434/2767] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:52 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:52.594240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f642e77e-d354-49cb-8a43-4de7040351b0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:52.594860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f642e77e-d354-49cb-8a43-4de7040351b0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:52.600897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f642e77e-d354-49cb-8a43-4de7040351b0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:52.601346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f642e77e-d354-49cb-8a43-4de7040351b0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:52.602097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f642e77e-d354-49cb-8a43-4de7040351b0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:52.602533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f642e77e-d354-49cb-8a43-4de7040351b0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:52.732369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f642e77e-d354-49cb-8a43-4de7040351b0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:52.740331 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f642e77e-d354-49cb-8a43-4de7040351b0 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150118 Jul 14 16:11:52.740906 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1334/2768] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:52 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:53.056887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3cdfa98f-a0c5-41f0-9e8b-ea3df714985e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:53.057562 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3cdfa98f-a0c5-41f0-9e8b-ea3df714985e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:53.063808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3cdfa98f-a0c5-41f0-9e8b-ea3df714985e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:53.064260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3cdfa98f-a0c5-41f0-9e8b-ea3df714985e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:53.065021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3cdfa98f-a0c5-41f0-9e8b-ea3df714985e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:53.065459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3cdfa98f-a0c5-41f0-9e8b-ea3df714985e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:53.200318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3cdfa98f-a0c5-41f0-9e8b-ea3df714985e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:53.208179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3cdfa98f-a0c5-41f0-9e8b-ea3df714985e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155150 Jul 14 16:11:53.208739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1435/2769] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:53 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:53.220667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-26dbc044-2f95-451e-8f64-6ec14ff15234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:53.221269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-26dbc044-2f95-451e-8f64-6ec14ff15234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:53.227746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26dbc044-2f95-451e-8f64-6ec14ff15234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:53.228195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26dbc044-2f95-451e-8f64-6ec14ff15234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:53.228948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26dbc044-2f95-451e-8f64-6ec14ff15234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:53.229451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26dbc044-2f95-451e-8f64-6ec14ff15234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:53.292336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-26dbc044-2f95-451e-8f64-6ec14ff15234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:53.300397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-26dbc044-2f95-451e-8f64-6ec14ff15234 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.083487 Jul 14 16:11:53.300971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1335/2770] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:53 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:53.758244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-88b037ca-ad41-47b1-88bf-9831f1704895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:53.758856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-88b037ca-ad41-47b1-88bf-9831f1704895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:53.765812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-88b037ca-ad41-47b1-88bf-9831f1704895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:53.766267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-88b037ca-ad41-47b1-88bf-9831f1704895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:53.767033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-88b037ca-ad41-47b1-88bf-9831f1704895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:53.767473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-88b037ca-ad41-47b1-88bf-9831f1704895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:53.978568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-88b037ca-ad41-47b1-88bf-9831f1704895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:53.987753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-88b037ca-ad41-47b1-88bf-9831f1704895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.233435 Jul 14 16:11:53.988908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1436/2771] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:53 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:54.225786 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4e4b5201-e62b-4ce7-89fb-41e5f68eb3fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:54.226482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4e4b5201-e62b-4ce7-89fb-41e5f68eb3fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:54.233979 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e4b5201-e62b-4ce7-89fb-41e5f68eb3fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:54.234433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e4b5201-e62b-4ce7-89fb-41e5f68eb3fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:54.235196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e4b5201-e62b-4ce7-89fb-41e5f68eb3fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:54.235665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e4b5201-e62b-4ce7-89fb-41e5f68eb3fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:54.318254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-100c93d4-36ca-4141-b3d3-08ef5df9c652 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:54.318909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-100c93d4-36ca-4141-b3d3-08ef5df9c652 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:54.326488 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-100c93d4-36ca-4141-b3d3-08ef5df9c652 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:54.326944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-100c93d4-36ca-4141-b3d3-08ef5df9c652 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:54.328190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-100c93d4-36ca-4141-b3d3-08ef5df9c652 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:54.328631 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-100c93d4-36ca-4141-b3d3-08ef5df9c652 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:54.371870 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4e4b5201-e62b-4ce7-89fb-41e5f68eb3fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:54.379938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4e4b5201-e62b-4ce7-89fb-41e5f68eb3fb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.158153 Jul 14 16:11:54.380511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1336/2772] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:54 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:54.392909 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-100c93d4-36ca-4141-b3d3-08ef5df9c652 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:54.400737 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-100c93d4-36ca-4141-b3d3-08ef5df9c652 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086339 Jul 14 16:11:54.402056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1437/2773] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:54 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:55.005101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d47602a7-17a8-47f5-a967-f4f6ec6ef870 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:55.005710 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d47602a7-17a8-47f5-a967-f4f6ec6ef870 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:55.012726 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d47602a7-17a8-47f5-a967-f4f6ec6ef870 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:55.013175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d47602a7-17a8-47f5-a967-f4f6ec6ef870 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:55.013932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d47602a7-17a8-47f5-a967-f4f6ec6ef870 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:55.014368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d47602a7-17a8-47f5-a967-f4f6ec6ef870 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:55.141958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d47602a7-17a8-47f5-a967-f4f6ec6ef870 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:55.149859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d47602a7-17a8-47f5-a967-f4f6ec6ef870 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.148663 Jul 14 16:11:55.150419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1337/2774] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:55 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:55.397972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9532a527-92d8-4e01-8ee3-16614462e332 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:55.398590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9532a527-92d8-4e01-8ee3-16614462e332 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:55.406400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9532a527-92d8-4e01-8ee3-16614462e332 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:55.406844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9532a527-92d8-4e01-8ee3-16614462e332 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:55.407612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9532a527-92d8-4e01-8ee3-16614462e332 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:55.408054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9532a527-92d8-4e01-8ee3-16614462e332 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:55.418706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8cb8cf97-6445-427d-848b-21cd9e16d9f2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:55.419571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8cb8cf97-6445-427d-848b-21cd9e16d9f2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:55.426056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8cb8cf97-6445-427d-848b-21cd9e16d9f2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:55.426510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8cb8cf97-6445-427d-848b-21cd9e16d9f2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:55.427271 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8cb8cf97-6445-427d-848b-21cd9e16d9f2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:55.427739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8cb8cf97-6445-427d-848b-21cd9e16d9f2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:55.491117 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8cb8cf97-6445-427d-848b-21cd9e16d9f2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:55.499851 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8cb8cf97-6445-427d-848b-21cd9e16d9f2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085534 Jul 14 16:11:55.500437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1338/2775] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:55 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:55.538859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9532a527-92d8-4e01-8ee3-16614462e332 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:55.547457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9532a527-92d8-4e01-8ee3-16614462e332 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153335 Jul 14 16:11:55.548055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1438/2776] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:55 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:56.167136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1c7ba321-39ba-4af9-afbe-fd122397e57d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:56.167805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1c7ba321-39ba-4af9-afbe-fd122397e57d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:56.174200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1c7ba321-39ba-4af9-afbe-fd122397e57d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:56.174652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1c7ba321-39ba-4af9-afbe-fd122397e57d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:56.175412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1c7ba321-39ba-4af9-afbe-fd122397e57d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:56.175877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1c7ba321-39ba-4af9-afbe-fd122397e57d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:56.179820 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:11:56.306574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1c7ba321-39ba-4af9-afbe-fd122397e57d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:56.315414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1c7ba321-39ba-4af9-afbe-fd122397e57d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152167 Jul 14 16:11:56.316040 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1339/2777] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:56 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:56.516209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0b47b14a-fad5-462e-9a01-c71259f8b93e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:56.516771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0b47b14a-fad5-462e-9a01-c71259f8b93e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:56.523334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b47b14a-fad5-462e-9a01-c71259f8b93e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:56.523819 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b47b14a-fad5-462e-9a01-c71259f8b93e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:56.524578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b47b14a-fad5-462e-9a01-c71259f8b93e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:56.525022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b47b14a-fad5-462e-9a01-c71259f8b93e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:56.563521 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2976b828-98e8-4116-8027-185104218aa9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:56.564257 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2976b828-98e8-4116-8027-185104218aa9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:56.570623 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2976b828-98e8-4116-8027-185104218aa9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:56.571077 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2976b828-98e8-4116-8027-185104218aa9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:56.571876 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2976b828-98e8-4116-8027-185104218aa9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:56.572322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2976b828-98e8-4116-8027-185104218aa9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:56.588612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0b47b14a-fad5-462e-9a01-c71259f8b93e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:56.597809 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0b47b14a-fad5-462e-9a01-c71259f8b93e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085542 Jul 14 16:11:56.598376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1439/2778] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:56 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:56.705907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2976b828-98e8-4116-8027-185104218aa9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:56.715056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2976b828-98e8-4116-8027-185104218aa9 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.155201 Jul 14 16:11:56.715642 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1340/2779] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:56 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:57.333304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7d224694-ff32-4a71-81e7-252dea551f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:57.333869 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7d224694-ff32-4a71-81e7-252dea551f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:57.342209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d224694-ff32-4a71-81e7-252dea551f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:57.342695 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d224694-ff32-4a71-81e7-252dea551f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:57.343465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d224694-ff32-4a71-81e7-252dea551f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:57.343943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7d224694-ff32-4a71-81e7-252dea551f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:57.478941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7d224694-ff32-4a71-81e7-252dea551f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:57.487446 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7d224694-ff32-4a71-81e7-252dea551f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.158193 Jul 14 16:11:57.488042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1440/2780] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:57 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:57.614340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-aae6ebf1-5fee-4b13-b302-23238179da65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:57.614892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-aae6ebf1-5fee-4b13-b302-23238179da65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:57.624037 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aae6ebf1-5fee-4b13-b302-23238179da65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:57.624492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aae6ebf1-5fee-4b13-b302-23238179da65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:57.625255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aae6ebf1-5fee-4b13-b302-23238179da65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:57.625694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-aae6ebf1-5fee-4b13-b302-23238179da65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:57.690747 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-aae6ebf1-5fee-4b13-b302-23238179da65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:57.699279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-aae6ebf1-5fee-4b13-b302-23238179da65 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088880 Jul 14 16:11:57.699882 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1341/2781] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:57 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:57.732712 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-304f6622-43e6-48ee-84dc-daab2d570888 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:57.733310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-304f6622-43e6-48ee-84dc-daab2d570888 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:57.739990 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-304f6622-43e6-48ee-84dc-daab2d570888 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:57.740444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-304f6622-43e6-48ee-84dc-daab2d570888 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:57.741231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-304f6622-43e6-48ee-84dc-daab2d570888 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:57.741671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-304f6622-43e6-48ee-84dc-daab2d570888 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:57.873392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-304f6622-43e6-48ee-84dc-daab2d570888 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:57.881288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-304f6622-43e6-48ee-84dc-daab2d570888 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153073 Jul 14 16:11:57.881848 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1441/2782] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:57 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:58.505417 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cceaf7cd-20e7-4a76-b9b2-1029ae2b8c4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:58.506025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cceaf7cd-20e7-4a76-b9b2-1029ae2b8c4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:58.512329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cceaf7cd-20e7-4a76-b9b2-1029ae2b8c4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:58.512773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cceaf7cd-20e7-4a76-b9b2-1029ae2b8c4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:58.513525 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cceaf7cd-20e7-4a76-b9b2-1029ae2b8c4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:58.513961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cceaf7cd-20e7-4a76-b9b2-1029ae2b8c4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:58.716328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-76429111-cad8-4555-b7ab-1090724a8bd4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:58.717051 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-76429111-cad8-4555-b7ab-1090724a8bd4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:58.723465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76429111-cad8-4555-b7ab-1090724a8bd4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:58.723951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76429111-cad8-4555-b7ab-1090724a8bd4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:58.724719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76429111-cad8-4555-b7ab-1090724a8bd4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:58.725153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-76429111-cad8-4555-b7ab-1090724a8bd4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:58.793156 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-76429111-cad8-4555-b7ab-1090724a8bd4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:58.801673 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-76429111-cad8-4555-b7ab-1090724a8bd4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.089784 Jul 14 16:11:58.802264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1442/2783] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:58 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:58.893337 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cceaf7cd-20e7-4a76-b9b2-1029ae2b8c4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:58.899654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-167f8965-53cd-4a2a-8e90-a26bfcdafb20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:58.900268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-167f8965-53cd-4a2a-8e90-a26bfcdafb20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:58.902677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cceaf7cd-20e7-4a76-b9b2-1029ae2b8c4e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.400803 Jul 14 16:11:58.903266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1342/2784] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:58 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:58.907689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-167f8965-53cd-4a2a-8e90-a26bfcdafb20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:58.908139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-167f8965-53cd-4a2a-8e90-a26bfcdafb20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:58.908904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-167f8965-53cd-4a2a-8e90-a26bfcdafb20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:58.909333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-167f8965-53cd-4a2a-8e90-a26bfcdafb20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:59.041141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-167f8965-53cd-4a2a-8e90-a26bfcdafb20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:59.049750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-167f8965-53cd-4a2a-8e90-a26bfcdafb20 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153950 Jul 14 16:11:59.050329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1443/2785] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:58 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:11:59.819517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-78c25d42-48aa-458a-a731-ca8ea659ba07 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:59.820175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-78c25d42-48aa-458a-a731-ca8ea659ba07 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:59.827280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78c25d42-48aa-458a-a731-ca8ea659ba07 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:59.827755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78c25d42-48aa-458a-a731-ca8ea659ba07 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:59.828535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78c25d42-48aa-458a-a731-ca8ea659ba07 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:59.828970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78c25d42-48aa-458a-a731-ca8ea659ba07 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:59.892561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-78c25d42-48aa-458a-a731-ca8ea659ba07 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:11:59.900481 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-78c25d42-48aa-458a-a731-ca8ea659ba07 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084847 Jul 14 16:11:59.901053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1343/2786] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:59 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:11:59.920266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a3e6036b-8586-4975-8814-395af04670b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:11:59.920922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a3e6036b-8586-4975-8814-395af04670b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:11:59.927318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a3e6036b-8586-4975-8814-395af04670b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:59.927800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a3e6036b-8586-4975-8814-395af04670b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:11:59.928546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a3e6036b-8586-4975-8814-395af04670b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:11:59.928978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a3e6036b-8586-4975-8814-395af04670b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:00.056556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a3e6036b-8586-4975-8814-395af04670b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:00.065840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a3e6036b-8586-4975-8814-395af04670b7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.149712 Jul 14 16:12:00.066426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1444/2787] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:11:59 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:00.067545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1a53208d-4346-451f-a1ee-1a692b04e524 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:00.068209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1a53208d-4346-451f-a1ee-1a692b04e524 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:00.074307 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1a53208d-4346-451f-a1ee-1a692b04e524 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:00.075287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1a53208d-4346-451f-a1ee-1a692b04e524 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:00.076080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1a53208d-4346-451f-a1ee-1a692b04e524 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:00.076511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1a53208d-4346-451f-a1ee-1a692b04e524 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:00.206848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1a53208d-4346-451f-a1ee-1a692b04e524 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:00.214686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1a53208d-4346-451f-a1ee-1a692b04e524 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.151089 Jul 14 16:12:00.215302 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1344/2788] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:00 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:00.917378 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-20a6955a-694d-442d-a15d-2c5d5c67187c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:00.917994 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-20a6955a-694d-442d-a15d-2c5d5c67187c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:00.925281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20a6955a-694d-442d-a15d-2c5d5c67187c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:00.925866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20a6955a-694d-442d-a15d-2c5d5c67187c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:00.926491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20a6955a-694d-442d-a15d-2c5d5c67187c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:00.926929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-20a6955a-694d-442d-a15d-2c5d5c67187c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:00.990363 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-20a6955a-694d-442d-a15d-2c5d5c67187c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:00.999103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-20a6955a-694d-442d-a15d-2c5d5c67187c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085770 Jul 14 16:12:00.999763 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1445/2789] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:00 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:01.083156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8bba88b9-b6ec-49d0-9f8e-7bf36cc78113 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:01.083811 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8bba88b9-b6ec-49d0-9f8e-7bf36cc78113 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:01.090310 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8bba88b9-b6ec-49d0-9f8e-7bf36cc78113 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:01.091303 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8bba88b9-b6ec-49d0-9f8e-7bf36cc78113 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:01.092101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8bba88b9-b6ec-49d0-9f8e-7bf36cc78113 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:01.092544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8bba88b9-b6ec-49d0-9f8e-7bf36cc78113 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:01.220775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8bba88b9-b6ec-49d0-9f8e-7bf36cc78113 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:01.228754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8bba88b9-b6ec-49d0-9f8e-7bf36cc78113 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.149476 Jul 14 16:12:01.229322 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1345/2790] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:01 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:01.232327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9c55f161-d196-416a-bf4e-ddb8b19a50d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:01.232939 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9c55f161-d196-416a-bf4e-ddb8b19a50d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:01.239094 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c55f161-d196-416a-bf4e-ddb8b19a50d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:01.239647 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c55f161-d196-416a-bf4e-ddb8b19a50d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:01.240404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c55f161-d196-416a-bf4e-ddb8b19a50d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:01.240838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c55f161-d196-416a-bf4e-ddb8b19a50d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:01.372369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9c55f161-d196-416a-bf4e-ddb8b19a50d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:01.382624 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9c55f161-d196-416a-bf4e-ddb8b19a50d6 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.154292 Jul 14 16:12:01.383184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1446/2791] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:01 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:02.016586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-45ced676-3c98-48dd-ad86-993a48133a43 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:02.017207 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-45ced676-3c98-48dd-ad86-993a48133a43 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:02.023414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45ced676-3c98-48dd-ad86-993a48133a43 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:02.023904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45ced676-3c98-48dd-ad86-993a48133a43 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:02.024662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45ced676-3c98-48dd-ad86-993a48133a43 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:02.025103 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45ced676-3c98-48dd-ad86-993a48133a43 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:02.087397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-45ced676-3c98-48dd-ad86-993a48133a43 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:02.101121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-45ced676-3c98-48dd-ad86-993a48133a43 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088818 Jul 14 16:12:02.101714 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1346/2792] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:02 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:02.246199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-46e18543-b38a-4bff-8d2d-e4bc3472eb17 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:02.246766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-46e18543-b38a-4bff-8d2d-e4bc3472eb17 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:02.249089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=82 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:02.254760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-46e18543-b38a-4bff-8d2d-e4bc3472eb17 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:02.255209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-46e18543-b38a-4bff-8d2d-e4bc3472eb17 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:02.256027 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-46e18543-b38a-4bff-8d2d-e4bc3472eb17 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:02.256462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-46e18543-b38a-4bff-8d2d-e4bc3472eb17 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:02.386211 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-46e18543-b38a-4bff-8d2d-e4bc3472eb17 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:02.390072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:02.395533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-46e18543-b38a-4bff-8d2d-e4bc3472eb17 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.153276 Jul 14 16:12:02.396131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1447/2793] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:02 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:02.400045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2e58afbd-a6e8-4289-a285-1305c4a8803e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:02.400673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2e58afbd-a6e8-4289-a285-1305c4a8803e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:02.407179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2e58afbd-a6e8-4289-a285-1305c4a8803e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:02.407647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2e58afbd-a6e8-4289-a285-1305c4a8803e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:02.408412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2e58afbd-a6e8-4289-a285-1305c4a8803e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:02.408855 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2e58afbd-a6e8-4289-a285-1305c4a8803e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:02.545787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2e58afbd-a6e8-4289-a285-1305c4a8803e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:02.553559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2e58afbd-a6e8-4289-a285-1305c4a8803e tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.157303 Jul 14 16:12:02.554126 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1347/2794] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:02 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:03.122646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-eec7069f-3ca3-425e-908f-413c0567e72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:03.123250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eec7069f-3ca3-425e-908f-413c0567e72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:03.129835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eec7069f-3ca3-425e-908f-413c0567e72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:03.130276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eec7069f-3ca3-425e-908f-413c0567e72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:03.131021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eec7069f-3ca3-425e-908f-413c0567e72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:03.131453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eec7069f-3ca3-425e-908f-413c0567e72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:03.197005 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-eec7069f-3ca3-425e-908f-413c0567e72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:03.205596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-eec7069f-3ca3-425e-908f-413c0567e72a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087178 Jul 14 16:12:03.206167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1448/2795] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:03 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:03.413402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f78aa22f-9498-4cda-a2b3-c5f42632a29d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:03.414014 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f78aa22f-9498-4cda-a2b3-c5f42632a29d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:03.422089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f78aa22f-9498-4cda-a2b3-c5f42632a29d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:03.422545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f78aa22f-9498-4cda-a2b3-c5f42632a29d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:03.423312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f78aa22f-9498-4cda-a2b3-c5f42632a29d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:03.423803 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f78aa22f-9498-4cda-a2b3-c5f42632a29d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:03.552510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f78aa22f-9498-4cda-a2b3-c5f42632a29d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:03.560313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f78aa22f-9498-4cda-a2b3-c5f42632a29d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150785 Jul 14 16:12:03.560884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1348/2796] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:03 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:03.570068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-48507111-61d7-41e0-aed4-48d47255da5d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:03.570691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-48507111-61d7-41e0-aed4-48d47255da5d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:03.576735 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48507111-61d7-41e0-aed4-48d47255da5d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:03.577389 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48507111-61d7-41e0-aed4-48d47255da5d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:03.578146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48507111-61d7-41e0-aed4-48d47255da5d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:03.578590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-48507111-61d7-41e0-aed4-48d47255da5d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:03.705625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-48507111-61d7-41e0-aed4-48d47255da5d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:03.713555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-48507111-61d7-41e0-aed4-48d47255da5d tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.147283 Jul 14 16:12:03.714220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1449/2797] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:03 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:04.222755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e974c3f0-5992-459b-9834-6d9e9a207fc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:04.223369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e974c3f0-5992-459b-9834-6d9e9a207fc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:04.229440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e974c3f0-5992-459b-9834-6d9e9a207fc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:04.229890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e974c3f0-5992-459b-9834-6d9e9a207fc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:04.230648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e974c3f0-5992-459b-9834-6d9e9a207fc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:04.231091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e974c3f0-5992-459b-9834-6d9e9a207fc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:04.302116 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e974c3f0-5992-459b-9834-6d9e9a207fc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:04.310279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e974c3f0-5992-459b-9834-6d9e9a207fc5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.091835 Jul 14 16:12:04.310850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1349/2798] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:04 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:04.579776 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a8f32d3b-5e8c-4b18-b293-f3459b9b14df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:04.580841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a8f32d3b-5e8c-4b18-b293-f3459b9b14df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:04.587965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8f32d3b-5e8c-4b18-b293-f3459b9b14df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:04.588422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8f32d3b-5e8c-4b18-b293-f3459b9b14df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:04.589194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8f32d3b-5e8c-4b18-b293-f3459b9b14df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:04.589634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a8f32d3b-5e8c-4b18-b293-f3459b9b14df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:04.731376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a8f32d3b-5e8c-4b18-b293-f3459b9b14df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:04.731981 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ab85c246-62b1-447b-89ce-92c8f497f841 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:04.732626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ab85c246-62b1-447b-89ce-92c8f497f841 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:04.739615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab85c246-62b1-447b-89ce-92c8f497f841 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:04.740072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab85c246-62b1-447b-89ce-92c8f497f841 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:04.740847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab85c246-62b1-447b-89ce-92c8f497f841 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:04.740964 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a8f32d3b-5e8c-4b18-b293-f3459b9b14df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.166257 Jul 14 16:12:04.741310 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ab85c246-62b1-447b-89ce-92c8f497f841 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:04.741435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1450/2799] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:04 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:04.892467 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ab85c246-62b1-447b-89ce-92c8f497f841 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:04.900408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ab85c246-62b1-447b-89ce-92c8f497f841 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.172218 Jul 14 16:12:04.900976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1350/2800] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:04 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:05.329441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3397e255-89a0-4fb0-94dc-4152fccfb9ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:05.330086 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3397e255-89a0-4fb0-94dc-4152fccfb9ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:05.336124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3397e255-89a0-4fb0-94dc-4152fccfb9ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:05.336571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3397e255-89a0-4fb0-94dc-4152fccfb9ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:05.337319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3397e255-89a0-4fb0-94dc-4152fccfb9ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:05.337753 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3397e255-89a0-4fb0-94dc-4152fccfb9ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:05.401971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3397e255-89a0-4fb0-94dc-4152fccfb9ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:05.410310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3397e255-89a0-4fb0-94dc-4152fccfb9ca tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085754 Jul 14 16:12:05.410881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1451/2801] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:05 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:05.761028 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-161d1a9a-7c91-416f-84e9-a3e752ab168e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:05.761629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-161d1a9a-7c91-416f-84e9-a3e752ab168e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:05.768291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-161d1a9a-7c91-416f-84e9-a3e752ab168e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:05.768738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-161d1a9a-7c91-416f-84e9-a3e752ab168e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:05.769522 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-161d1a9a-7c91-416f-84e9-a3e752ab168e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:05.769957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-161d1a9a-7c91-416f-84e9-a3e752ab168e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:05.898850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-161d1a9a-7c91-416f-84e9-a3e752ab168e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:05.907992 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-161d1a9a-7c91-416f-84e9-a3e752ab168e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150737 Jul 14 16:12:05.908577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1351/2802] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:05 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:05.920358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9fa15173-fc1a-4d84-95fc-b24b5f45e265 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:05.921663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9fa15173-fc1a-4d84-95fc-b24b5f45e265 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:05.928362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9fa15173-fc1a-4d84-95fc-b24b5f45e265 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:05.928814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9fa15173-fc1a-4d84-95fc-b24b5f45e265 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:05.929609 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9fa15173-fc1a-4d84-95fc-b24b5f45e265 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:05.930048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9fa15173-fc1a-4d84-95fc-b24b5f45e265 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:06.061164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9fa15173-fc1a-4d84-95fc-b24b5f45e265 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:06.069345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9fa15173-fc1a-4d84-95fc-b24b5f45e265 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.153153 Jul 14 16:12:06.069911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1452/2803] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:05 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:06.428934 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fb58af5c-d967-4874-b092-079c03296e54 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:06.429554 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fb58af5c-d967-4874-b092-079c03296e54 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:06.435667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb58af5c-d967-4874-b092-079c03296e54 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:06.436309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb58af5c-d967-4874-b092-079c03296e54 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:06.437652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb58af5c-d967-4874-b092-079c03296e54 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:06.438458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fb58af5c-d967-4874-b092-079c03296e54 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:06.515803 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fb58af5c-d967-4874-b092-079c03296e54 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:06.524757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fb58af5c-d967-4874-b092-079c03296e54 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.100473 Jul 14 16:12:06.525328 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1352/2804] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:06 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:06.926037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2500ec07-c226-484c-8a98-1a454adaa5af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:06.926645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2500ec07-c226-484c-8a98-1a454adaa5af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:06.933153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2500ec07-c226-484c-8a98-1a454adaa5af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:06.933601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2500ec07-c226-484c-8a98-1a454adaa5af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:06.934353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2500ec07-c226-484c-8a98-1a454adaa5af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:06.934790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2500ec07-c226-484c-8a98-1a454adaa5af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:07.069874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2500ec07-c226-484c-8a98-1a454adaa5af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:07.077921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2500ec07-c226-484c-8a98-1a454adaa5af tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155758 Jul 14 16:12:07.078491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1453/2805] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:06 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:07.086106 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e46190aa-ef24-43c2-b19e-3ab42f21f0bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:07.086812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e46190aa-ef24-43c2-b19e-3ab42f21f0bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:07.093606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e46190aa-ef24-43c2-b19e-3ab42f21f0bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:07.094054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e46190aa-ef24-43c2-b19e-3ab42f21f0bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:07.094797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e46190aa-ef24-43c2-b19e-3ab42f21f0bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:07.095228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e46190aa-ef24-43c2-b19e-3ab42f21f0bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:07.239042 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e46190aa-ef24-43c2-b19e-3ab42f21f0bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:07.251710 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e46190aa-ef24-43c2-b19e-3ab42f21f0bb tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.169040 Jul 14 16:12:07.253143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1353/2806] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:07 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:07.543087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e61a03eb-30b5-4ecc-8c7f-dad26682dbb6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:07.543621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e61a03eb-30b5-4ecc-8c7f-dad26682dbb6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:07.551147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e61a03eb-30b5-4ecc-8c7f-dad26682dbb6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:07.551604 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e61a03eb-30b5-4ecc-8c7f-dad26682dbb6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:07.552375 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e61a03eb-30b5-4ecc-8c7f-dad26682dbb6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:07.552820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e61a03eb-30b5-4ecc-8c7f-dad26682dbb6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:07.618290 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e61a03eb-30b5-4ecc-8c7f-dad26682dbb6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:07.627611 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e61a03eb-30b5-4ecc-8c7f-dad26682dbb6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088500 Jul 14 16:12:07.628302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1454/2807] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:07 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:08.095840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1afd4de8-bfd6-403b-929c-1640e9aa23d8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:08.096591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1afd4de8-bfd6-403b-929c-1640e9aa23d8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:08.103325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1afd4de8-bfd6-403b-929c-1640e9aa23d8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:08.103828 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1afd4de8-bfd6-403b-929c-1640e9aa23d8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:08.104604 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1afd4de8-bfd6-403b-929c-1640e9aa23d8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:08.105047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1afd4de8-bfd6-403b-929c-1640e9aa23d8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:08.238231 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1afd4de8-bfd6-403b-929c-1640e9aa23d8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:08.246302 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1afd4de8-bfd6-403b-929c-1640e9aa23d8 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154776 Jul 14 16:12:08.246803 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1354/2808] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:08 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:08.273477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9bad174d-aa5e-4218-9915-cef66ba45111 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:08.274076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9bad174d-aa5e-4218-9915-cef66ba45111 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] [instance: 58c05da0-6e6d-422a-b119-197a7a41a2b9] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:08.281795 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9bad174d-aa5e-4218-9915-cef66ba45111 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:08.282278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9bad174d-aa5e-4218-9915-cef66ba45111 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:08.283128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9bad174d-aa5e-4218-9915-cef66ba45111 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:08.283546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9bad174d-aa5e-4218-9915-cef66ba45111 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:08.648479 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-de21dcd2-f1a1-41d9-9caf-8b61f7b758df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:08.649096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-de21dcd2-f1a1-41d9-9caf-8b61f7b758df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:08.656430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-de21dcd2-f1a1-41d9-9caf-8b61f7b758df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:08.656430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-de21dcd2-f1a1-41d9-9caf-8b61f7b758df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:08.657252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-de21dcd2-f1a1-41d9-9caf-8b61f7b758df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:08.657694 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-de21dcd2-f1a1-41d9-9caf-8b61f7b758df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:08.662920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9bad174d-aa5e-4218-9915-cef66ba45111 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '71bc270c6253426baa4f79638d466b20', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '858bb49b6e1e48568e2055eacc1ee7e5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:08.671340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9bad174d-aa5e-4218-9915-cef66ba45111 tempest-VolumesSnapshotTestJSON-2074780834 tempest-VolumesSnapshotTestJSON-2074780834-project] 10.222.0.99 "GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9" status: 200 len: 1559 microversion: 2.1 time: 0.401674 Jul 14 16:12:08.671950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1455/2809] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:08 2022] GET /compute/v2.1/servers/58c05da0-6e6d-422a-b119-197a7a41a2b9 => generated 1559 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:08.736618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-de21dcd2-f1a1-41d9-9caf-8b61f7b758df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:08.740332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:08.746159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-de21dcd2-f1a1-41d9-9caf-8b61f7b758df tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.101745 Jul 14 16:12:08.746805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1355/2810] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:08 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:09.263376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fe2d4274-98ab-48c4-9bda-a20e6785a8eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:09.264271 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fe2d4274-98ab-48c4-9bda-a20e6785a8eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:09.270935 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe2d4274-98ab-48c4-9bda-a20e6785a8eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:09.271764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe2d4274-98ab-48c4-9bda-a20e6785a8eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:09.272859 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe2d4274-98ab-48c4-9bda-a20e6785a8eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:09.273638 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fe2d4274-98ab-48c4-9bda-a20e6785a8eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:09.446411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-fe2d4274-98ab-48c4-9bda-a20e6785a8eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:09.460103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fe2d4274-98ab-48c4-9bda-a20e6785a8eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.200599 Jul 14 16:12:09.460705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1456/2811] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:09 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:09.767216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6a68b5d2-de82-437f-8ea4-39dee0ea2b33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:09.768119 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6a68b5d2-de82-437f-8ea4-39dee0ea2b33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:09.775049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a68b5d2-de82-437f-8ea4-39dee0ea2b33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:09.775496 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a68b5d2-de82-437f-8ea4-39dee0ea2b33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:09.776305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a68b5d2-de82-437f-8ea4-39dee0ea2b33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:09.776745 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6a68b5d2-de82-437f-8ea4-39dee0ea2b33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:09.846741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6a68b5d2-de82-437f-8ea4-39dee0ea2b33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:09.854728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6a68b5d2-de82-437f-8ea4-39dee0ea2b33 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.092771 Jul 14 16:12:09.855301 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1356/2812] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:09 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:10.462021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1d984c00-88a8-4040-8bee-2aa186f33c2f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:10.462622 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1d984c00-88a8-4040-8bee-2aa186f33c2f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:10.469310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d984c00-88a8-4040-8bee-2aa186f33c2f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:10.469756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d984c00-88a8-4040-8bee-2aa186f33c2f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:10.470517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d984c00-88a8-4040-8bee-2aa186f33c2f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:10.470957 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d984c00-88a8-4040-8bee-2aa186f33c2f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:10.478080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1da157f0-69cb-43bb-a6a5-20e780e535d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:10.478698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1da157f0-69cb-43bb-a6a5-20e780e535d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:10.485365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1da157f0-69cb-43bb-a6a5-20e780e535d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:10.485921 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1da157f0-69cb-43bb-a6a5-20e780e535d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:10.486698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1da157f0-69cb-43bb-a6a5-20e780e535d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:10.487141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1da157f0-69cb-43bb-a6a5-20e780e535d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:10.503224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1d984c00-88a8-4040-8bee-2aa186f33c2f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Going to try to terminate instance {{(pid=124503) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:12:10.595207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1d984c00-88a8-4040-8bee-2aa186f33c2f tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 204 len: 0 microversion: 2.20 time: 0.203056 Jul 14 16:12:10.595852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1457/2813] 10.222.0.99 () {60 vars in 1279 bytes} [Thu Jul 14 16:12:10 2022] DELETE /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 0 bytes in 205 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 16:12:10.604570 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d134b9c5-3bc2-4b96-8e4d-b86830aaebb5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:10.605363 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d134b9c5-3bc2-4b96-8e4d-b86830aaebb5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:10.611754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d134b9c5-3bc2-4b96-8e4d-b86830aaebb5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:10.612214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d134b9c5-3bc2-4b96-8e4d-b86830aaebb5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:10.612985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d134b9c5-3bc2-4b96-8e4d-b86830aaebb5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:10.613424 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d134b9c5-3bc2-4b96-8e4d-b86830aaebb5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:10.631736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1da157f0-69cb-43bb-a6a5-20e780e535d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:10.641573 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1da157f0-69cb-43bb-a6a5-20e780e535d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.167140 Jul 14 16:12:10.642156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1357/2814] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:10 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:10.750510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d134b9c5-3bc2-4b96-8e4d-b86830aaebb5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:10.758501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d134b9c5-3bc2-4b96-8e4d-b86830aaebb5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:10.760079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d134b9c5-3bc2-4b96-8e4d-b86830aaebb5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:10.761249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d134b9c5-3bc2-4b96-8e4d-b86830aaebb5 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1725 microversion: 2.20 time: 0.160919 Jul 14 16:12:10.761803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1458/2815] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:12:10 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:12:10.871976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-662c1a4d-87dc-406f-8507-d833c7e6da4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:10.872581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-662c1a4d-87dc-406f-8507-d833c7e6da4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:10.879404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-662c1a4d-87dc-406f-8507-d833c7e6da4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:10.879891 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-662c1a4d-87dc-406f-8507-d833c7e6da4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:10.880657 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-662c1a4d-87dc-406f-8507-d833c7e6da4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:10.881101 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-662c1a4d-87dc-406f-8507-d833c7e6da4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:10.942744 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-662c1a4d-87dc-406f-8507-d833c7e6da4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:10.950879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-662c1a4d-87dc-406f-8507-d833c7e6da4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.082798 Jul 14 16:12:10.951373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1358/2816] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:10 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:11.659564 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e9ead2c2-791f-4f51-aef7-cb9829402611 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:11.660330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e9ead2c2-791f-4f51-aef7-cb9829402611 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:11.666870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e9ead2c2-791f-4f51-aef7-cb9829402611 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:11.667319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e9ead2c2-791f-4f51-aef7-cb9829402611 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:11.668139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e9ead2c2-791f-4f51-aef7-cb9829402611 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:11.668575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e9ead2c2-791f-4f51-aef7-cb9829402611 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:11.780785 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-52d78392-7151-4d5c-a0d2-d8fc9c007023 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:11.781542 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-52d78392-7151-4d5c-a0d2-d8fc9c007023 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:11.788258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52d78392-7151-4d5c-a0d2-d8fc9c007023 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:11.788705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52d78392-7151-4d5c-a0d2-d8fc9c007023 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:11.789462 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52d78392-7151-4d5c-a0d2-d8fc9c007023 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:11.789893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-52d78392-7151-4d5c-a0d2-d8fc9c007023 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:11.802650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e9ead2c2-791f-4f51-aef7-cb9829402611 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:11.810554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e9ead2c2-791f-4f51-aef7-cb9829402611 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155896 Jul 14 16:12:11.821316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1459/2817] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:11 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:11.925325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-52d78392-7151-4d5c-a0d2-d8fc9c007023 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:11.933219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-52d78392-7151-4d5c-a0d2-d8fc9c007023 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:11.934732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-52d78392-7151-4d5c-a0d2-d8fc9c007023 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:11.935931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-52d78392-7151-4d5c-a0d2-d8fc9c007023 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1725 microversion: 2.20 time: 0.159703 Jul 14 16:12:11.937261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1359/2818] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:12:11 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jul 14 16:12:11.968066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1d33c527-4c1b-4b26-bc6e-1a6799e21545 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:11.968966 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1d33c527-4c1b-4b26-bc6e-1a6799e21545 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:11.975746 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d33c527-4c1b-4b26-bc6e-1a6799e21545 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:11.976229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d33c527-4c1b-4b26-bc6e-1a6799e21545 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:11.976999 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d33c527-4c1b-4b26-bc6e-1a6799e21545 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:11.977438 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1d33c527-4c1b-4b26-bc6e-1a6799e21545 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:12.045420 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1d33c527-4c1b-4b26-bc6e-1a6799e21545 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:12.053828 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1d33c527-4c1b-4b26-bc6e-1a6799e21545 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.089622 Jul 14 16:12:12.054408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1460/2819] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:11 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:12.829894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5d87cfc0-0e16-4e82-a6cc-1bcacbd72420 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:12.830522 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5d87cfc0-0e16-4e82-a6cc-1bcacbd72420 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:12.837755 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d87cfc0-0e16-4e82-a6cc-1bcacbd72420 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:12.838214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d87cfc0-0e16-4e82-a6cc-1bcacbd72420 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:12.839215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d87cfc0-0e16-4e82-a6cc-1bcacbd72420 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:12.839695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5d87cfc0-0e16-4e82-a6cc-1bcacbd72420 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:12.964264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-da803cb0-0a1c-44e1-b976-0e99292822ee tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:12.964951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-da803cb0-0a1c-44e1-b976-0e99292822ee tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:12.974262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da803cb0-0a1c-44e1-b976-0e99292822ee tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:12.974718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da803cb0-0a1c-44e1-b976-0e99292822ee tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:12.975485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da803cb0-0a1c-44e1-b976-0e99292822ee tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:12.976505 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-da803cb0-0a1c-44e1-b976-0e99292822ee tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:13.005466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5d87cfc0-0e16-4e82-a6cc-1bcacbd72420 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:13.013437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5d87cfc0-0e16-4e82-a6cc-1bcacbd72420 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.187861 Jul 14 16:12:13.014020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1360/2820] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:12 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:13.053169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-da803cb0-0a1c-44e1-b976-0e99292822ee tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:13.061500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-da803cb0-0a1c-44e1-b976-0e99292822ee tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:13.063138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-da803cb0-0a1c-44e1-b976-0e99292822ee tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '781567471d0f4ca4add4331d405febd4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '636b923a8a58435484086dc8394ccc23', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:13.064601 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-da803cb0-0a1c-44e1-b976-0e99292822ee tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 200 len: 1657 microversion: 2.20 time: 0.108774 Jul 14 16:12:13.066520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1461/2821] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:12:12 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 1657 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jul 14 16:12:13.081592 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a23f7d35-ea9a-475d-a56e-4bdba3101960 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:13.082211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a23f7d35-ea9a-475d-a56e-4bdba3101960 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:13.088211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a23f7d35-ea9a-475d-a56e-4bdba3101960 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:13.088665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a23f7d35-ea9a-475d-a56e-4bdba3101960 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:13.089440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a23f7d35-ea9a-475d-a56e-4bdba3101960 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:13.089887 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a23f7d35-ea9a-475d-a56e-4bdba3101960 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:13.152260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a23f7d35-ea9a-475d-a56e-4bdba3101960 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:13.161141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a23f7d35-ea9a-475d-a56e-4bdba3101960 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.083310 Jul 14 16:12:13.161731 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1361/2822] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:13 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:13.357835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-f4c09888-d421-475d-9415-1e3cc946caa4 req-e124f0c5-2b20-4305-9afc-ea52f7242b93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b384c419-d19a-4564-9c70-ae40273487bf", "name": "network-vif-deleted", "tag": "dfba5691-18bb-4970-9d97-f67ef9081351"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:12:13.367826 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-f4c09888-d421-475d-9415-1e3cc946caa4 req-e124f0c5-2b20-4305-9afc-ea52f7242b93 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:13.368466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-f4c09888-d421-475d-9415-1e3cc946caa4 req-e124f0c5-2b20-4305-9afc-ea52f7242b93 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:13.382522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-f4c09888-d421-475d-9415-1e3cc946caa4 req-e124f0c5-2b20-4305-9afc-ea52f7242b93 service nova] Creating event network-vif-deleted:dfba5691-18bb-4970-9d97-f67ef9081351 for instance b384c419-d19a-4564-9c70-ae40273487bf on hv-cinder-82651 Jul 14 16:12:13.390850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-f4c09888-d421-475d-9415-1e3cc946caa4 req-e124f0c5-2b20-4305-9afc-ea52f7242b93 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.094533 Jul 14 16:12:13.391900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1462/2823] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:12:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:12:14.031968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0d36a8bd-e548-4499-b2f4-bdcbe3110baf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:14.032579 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0d36a8bd-e548-4499-b2f4-bdcbe3110baf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:14.039006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d36a8bd-e548-4499-b2f4-bdcbe3110baf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:14.039457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d36a8bd-e548-4499-b2f4-bdcbe3110baf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:14.040255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d36a8bd-e548-4499-b2f4-bdcbe3110baf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:14.040724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0d36a8bd-e548-4499-b2f4-bdcbe3110baf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:14.085392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8814be85-2611-436f-a326-1a186bb905c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:14.086799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8814be85-2611-436f-a326-1a186bb905c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:14.094129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8814be85-2611-436f-a326-1a186bb905c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:14.094671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8814be85-2611-436f-a326-1a186bb905c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:14.095517 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8814be85-2611-436f-a326-1a186bb905c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:14.096038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8814be85-2611-436f-a326-1a186bb905c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:14.110847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-8814be85-2611-436f-a326-1a186bb905c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] HTTP exception thrown: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8814be85-2611-436f-a326-1a186bb905c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Request method failure captured: Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf HTTP/1.1 Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgK5WXOpci8AcrNPn8DZdLLfUB41hSWokUR9H6KGxUfhPgB-BorBSZznPeBbS4gu94jx-hxaHDmhLG-t30F1OFghgkwn6GHIuifzVKnBtRjL6ElXPVnPijnlxUZTNEt3ToExP61Kr8jSycWU9MCu5vsLLyrO4eaZKYrYLFgLM2mFCI Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 636b923a8a58435484086dc8394ccc23 Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:12:14.112582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:12:14.114549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_636b923a8a58435484086dc8394ccc23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/636b923a8a58435484086dc8394ccc23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/636b923a8a58435484086dc8394ccc23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/636b923a8a58435484086dc8394ccc23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:12:14.114549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:12:14.114549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 636b923a8a58435484086dc8394ccc23 Jul 14 16:12:14.114549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:12:14.114549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-AttachVolumeShelveTestJSON-1064333928-project Jul 14 16:12:14.114549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:12:14.114549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:12:14.114549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 781567471d0f4ca4add4331d405febd4 Jul 14 16:12:14.114549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1064333928-project Jul 14 16:12:14.114549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:12:14.114549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:14.114549 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': 'b384c419-d19a-4564-9c70-ae40273487bf'} Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:12:14.115587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:14.117297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:12:14.122183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8814be85-2611-436f-a326-1a186bb905c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Returning 404 to user: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:12:14.122183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8814be85-2611-436f-a326-1a186bb905c7 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 404 len: 111 microversion: 2.20 time: 0.037026 Jul 14 16:12:14.122183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1463/2824] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:12:14 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jul 14 16:12:14.127764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c3f02d67-e3dd-474f-8337-55e3af11761c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '.version_select at 0x7f357c264430>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:14.131344 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR oslo.messaging._drivers.impl_rabbit [None req-c3f02d67-e3dd-474f-8337-55e3af11761c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [abba292d-f6c9-44d8-a304-fefc4d161067] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 16:12:14.185134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0d36a8bd-e548-4499-b2f4-bdcbe3110baf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:14.194626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0d36a8bd-e548-4499-b2f4-bdcbe3110baf tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.167190 Jul 14 16:12:14.195214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1362/2825] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:14 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:14.200536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-43185a89-c443-435e-851d-4e51a06bcf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:14.201413 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-43185a89-c443-435e-851d-4e51a06bcf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:14.208585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43185a89-c443-435e-851d-4e51a06bcf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:14.209038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43185a89-c443-435e-851d-4e51a06bcf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:14.209814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43185a89-c443-435e-851d-4e51a06bcf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:14.210258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-43185a89-c443-435e-851d-4e51a06bcf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:14.276440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-43185a89-c443-435e-851d-4e51a06bcf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:14.286048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-43185a89-c443-435e-851d-4e51a06bcf4b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.089541 Jul 14 16:12:14.286643 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1363/2826] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:14 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:15.139255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [None req-c3f02d67-e3dd-474f-8337-55e3af11761c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [abba292d-f6c9-44d8-a304-fefc4d161067] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 46654. Jul 14 16:12:15.162101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c3f02d67-e3dd-474f-8337-55e3af11761c tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132635853" status: 204 len: 0 microversion: 2.20 time: 1.038788 Jul 14 16:12:15.162674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1464/2827] 10.222.0.99 () {60 vars in 1261 bytes} [Thu Jul 14 16:12:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1132635853 => generated 0 bytes in 1041 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jul 14 16:12:15.213164 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fcc3eeb2-54b3-431f-a4e2-44c8a2948d7f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:15.213784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fcc3eeb2-54b3-431f-a4e2-44c8a2948d7f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:15.216481 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=80 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:15.222586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fcc3eeb2-54b3-431f-a4e2-44c8a2948d7f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:15.223038 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fcc3eeb2-54b3-431f-a4e2-44c8a2948d7f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:15.223840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fcc3eeb2-54b3-431f-a4e2-44c8a2948d7f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:15.224279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fcc3eeb2-54b3-431f-a4e2-44c8a2948d7f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:15.303538 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b363dfb1-1900-4be0-8869-bbf34ccfdf7e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:15.304176 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b363dfb1-1900-4be0-8869-bbf34ccfdf7e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:15.313961 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b363dfb1-1900-4be0-8869-bbf34ccfdf7e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:15.314514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b363dfb1-1900-4be0-8869-bbf34ccfdf7e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:15.315360 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b363dfb1-1900-4be0-8869-bbf34ccfdf7e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:15.316012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b363dfb1-1900-4be0-8869-bbf34ccfdf7e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:15.321506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:15.396515 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fcc3eeb2-54b3-431f-a4e2-44c8a2948d7f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:15.404951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fcc3eeb2-54b3-431f-a4e2-44c8a2948d7f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.195573 Jul 14 16:12:15.405875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1364/2828] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:15 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:15.422993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b363dfb1-1900-4be0-8869-bbf34ccfdf7e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:15.431127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b363dfb1-1900-4be0-8869-bbf34ccfdf7e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.131991 Jul 14 16:12:15.431713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1465/2829] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:15 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:15.838346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3b9ba48a-b717-4f83-8ee2-13345cd85f32 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:15.838850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3b9ba48a-b717-4f83-8ee2-13345cd85f32 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:15.845504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b9ba48a-b717-4f83-8ee2-13345cd85f32 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:15.845957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b9ba48a-b717-4f83-8ee2-13345cd85f32 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:15.846721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b9ba48a-b717-4f83-8ee2-13345cd85f32 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:15.847174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3b9ba48a-b717-4f83-8ee2-13345cd85f32 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:15.861188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-3b9ba48a-b717-4f83-8ee2-13345cd85f32 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] HTTP exception thrown: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3b9ba48a-b717-4f83-8ee2-13345cd85f32 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Request method failure captured: Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf HTTP/1.1 Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgK5WXOpci8AcrNPn8DZdLLfUB41hSWokUR9H6KGxUfhPgB-BorBSZznPeBbS4gu94jx-hxaHDmhLG-t30F1OFghgkwn6GHIuifzVKnBtRjL6ElXPVnPijnlxUZTNEt3ToExP61Kr8jSycWU9MCu5vsLLyrO4eaZKYrYLFgLM2mFCI Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 636b923a8a58435484086dc8394ccc23 Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:12:15.862880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:12:15.864853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_636b923a8a58435484086dc8394ccc23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/636b923a8a58435484086dc8394ccc23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/636b923a8a58435484086dc8394ccc23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/636b923a8a58435484086dc8394ccc23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:12:15.864853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:12:15.864853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 636b923a8a58435484086dc8394ccc23 Jul 14 16:12:15.864853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:12:15.864853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeShelveTestJSON-1064333928-project Jul 14 16:12:15.864853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:12:15.864853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:12:15.864853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 781567471d0f4ca4add4331d405febd4 Jul 14 16:12:15.864853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1064333928-project Jul 14 16:12:15.864853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:12:15.864853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:15.864853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'b384c419-d19a-4564-9c70-ae40273487bf'} Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:12:15.865916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:15.867569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:12:15.869344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3b9ba48a-b717-4f83-8ee2-13345cd85f32 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Returning 404 to user: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:12:15.869344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3b9ba48a-b717-4f83-8ee2-13345cd85f32 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "DELETE /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 404 len: 111 microversion: 2.20 time: 0.030032 Jul 14 16:12:15.869344 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1365/2830] 10.222.0.99 () {60 vars in 1279 bytes} [Thu Jul 14 16:12:15 2022] DELETE /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:12:15.872838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-368caa05-23c7-49a0-b5fb-45542685a10b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:15.873449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-368caa05-23c7-49a0-b5fb-45542685a10b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: b384c419-d19a-4564-9c70-ae40273487bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:15.880060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-368caa05-23c7-49a0-b5fb-45542685a10b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:15.880511 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-368caa05-23c7-49a0-b5fb-45542685a10b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:15.881261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-368caa05-23c7-49a0-b5fb-45542685a10b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:15.881708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-368caa05-23c7-49a0-b5fb-45542685a10b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:15.895918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-368caa05-23c7-49a0-b5fb-45542685a10b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] HTTP exception thrown: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-368caa05-23c7-49a0-b5fb-45542685a10b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Request method failure captured: Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf HTTP/1.1 Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgK5WXOpci8AcrNPn8DZdLLfUB41hSWokUR9H6KGxUfhPgB-BorBSZznPeBbS4gu94jx-hxaHDmhLG-t30F1OFghgkwn6GHIuifzVKnBtRjL6ElXPVnPijnlxUZTNEt3ToExP61Kr8jSycWU9MCu5vsLLyrO4eaZKYrYLFgLM2mFCI Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 636b923a8a58435484086dc8394ccc23 Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:12:15.897470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:12:15.899334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_636b923a8a58435484086dc8394ccc23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/636b923a8a58435484086dc8394ccc23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/636b923a8a58435484086dc8394ccc23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/636b923a8a58435484086dc8394ccc23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:12:15.899334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:12:15.899334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 636b923a8a58435484086dc8394ccc23 Jul 14 16:12:15.899334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:12:15.899334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-AttachVolumeShelveTestJSON-1064333928-project Jul 14 16:12:15.899334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:12:15.899334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:12:15.899334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 781567471d0f4ca4add4331d405febd4 Jul 14 16:12:15.899334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1064333928-project Jul 14 16:12:15.899334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:12:15.899334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:15.899334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': 'b384c419-d19a-4564-9c70-ae40273487bf'} Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:12:15.900449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. Jul 14 16:12:15.902093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:12:15.903554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-368caa05-23c7-49a0-b5fb-45542685a10b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Returning 404 to user: Instance b384c419-d19a-4564-9c70-ae40273487bf could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:12:15.903554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-368caa05-23c7-49a0-b5fb-45542685a10b tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf" status: 404 len: 111 microversion: 2.20 time: 0.029884 Jul 14 16:12:15.903554 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1466/2831] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:12:15 2022] GET /compute/v2.1/servers/b384c419-d19a-4564-9c70-ae40273487bf => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:12:16.423171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-59cf306a-8930-42b2-860b-44f589eb626b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:16.423797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-59cf306a-8930-42b2-860b-44f589eb626b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:16.430255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-59cf306a-8930-42b2-860b-44f589eb626b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:16.430706 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-59cf306a-8930-42b2-860b-44f589eb626b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:16.431461 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-59cf306a-8930-42b2-860b-44f589eb626b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:16.431925 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-59cf306a-8930-42b2-860b-44f589eb626b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:16.448752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0081ec5c-2a4d-423c-ab17-eee03d04656d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:16.449412 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0081ec5c-2a4d-423c-ab17-eee03d04656d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:16.456306 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0081ec5c-2a4d-423c-ab17-eee03d04656d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:16.456787 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0081ec5c-2a4d-423c-ab17-eee03d04656d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:16.457553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0081ec5c-2a4d-423c-ab17-eee03d04656d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:16.458001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0081ec5c-2a4d-423c-ab17-eee03d04656d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:16.521149 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0081ec5c-2a4d-423c-ab17-eee03d04656d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:16.530428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0081ec5c-2a4d-423c-ab17-eee03d04656d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085151 Jul 14 16:12:16.531696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1467/2832] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:16 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:16.574894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-59cf306a-8930-42b2-860b-44f589eb626b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:16.582954 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-59cf306a-8930-42b2-860b-44f589eb626b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.164516 Jul 14 16:12:16.583514 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1366/2833] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:16 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:17.548159 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-bdb25b43-febf-42c5-9e69-a6de691b1dae tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:17.548768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-bdb25b43-febf-42c5-9e69-a6de691b1dae tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:17.556498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bdb25b43-febf-42c5-9e69-a6de691b1dae tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:17.556949 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bdb25b43-febf-42c5-9e69-a6de691b1dae tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:17.557710 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bdb25b43-febf-42c5-9e69-a6de691b1dae tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:17.558146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-bdb25b43-febf-42c5-9e69-a6de691b1dae tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:17.600442 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a5bfbc17-d239-45dc-8407-9471b783512f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:17.601070 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a5bfbc17-d239-45dc-8407-9471b783512f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:17.609491 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a5bfbc17-d239-45dc-8407-9471b783512f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:17.609976 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a5bfbc17-d239-45dc-8407-9471b783512f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:17.610853 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a5bfbc17-d239-45dc-8407-9471b783512f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:17.611351 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a5bfbc17-d239-45dc-8407-9471b783512f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:17.631625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-bdb25b43-febf-42c5-9e69-a6de691b1dae tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:17.640263 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-bdb25b43-febf-42c5-9e69-a6de691b1dae tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.096298 Jul 14 16:12:17.640898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1468/2834] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:17 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:17.748155 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a5bfbc17-d239-45dc-8407-9471b783512f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:17.756903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a5bfbc17-d239-45dc-8407-9471b783512f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.160181 Jul 14 16:12:17.757492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1367/2835] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:17 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:18.658925 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-73fea4ba-555f-4640-aa37-b4632d495272 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:18.659578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-73fea4ba-555f-4640-aa37-b4632d495272 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:18.666576 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73fea4ba-555f-4640-aa37-b4632d495272 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:18.667022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73fea4ba-555f-4640-aa37-b4632d495272 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:18.667816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73fea4ba-555f-4640-aa37-b4632d495272 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:18.668251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-73fea4ba-555f-4640-aa37-b4632d495272 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:18.731617 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-73fea4ba-555f-4640-aa37-b4632d495272 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:18.740056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-73fea4ba-555f-4640-aa37-b4632d495272 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086089 Jul 14 16:12:18.740639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1469/2836] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:18 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:18.775130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-348f68e7-5fbd-4dfa-b24e-1e65c36f7dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:18.775776 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-348f68e7-5fbd-4dfa-b24e-1e65c36f7dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:18.784703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-348f68e7-5fbd-4dfa-b24e-1e65c36f7dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:18.785080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-348f68e7-5fbd-4dfa-b24e-1e65c36f7dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:18.786093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-348f68e7-5fbd-4dfa-b24e-1e65c36f7dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:18.786537 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-348f68e7-5fbd-4dfa-b24e-1e65c36f7dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:18.945199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-348f68e7-5fbd-4dfa-b24e-1e65c36f7dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:18.954833 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-348f68e7-5fbd-4dfa-b24e-1e65c36f7dbc tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.183907 Jul 14 16:12:18.955453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1368/2837] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:18 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:19.757281 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2275341f-e570-4ef5-83c9-2ff01d1158b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:19.757904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2275341f-e570-4ef5-83c9-2ff01d1158b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:19.764591 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2275341f-e570-4ef5-83c9-2ff01d1158b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:19.765045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2275341f-e570-4ef5-83c9-2ff01d1158b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:19.766003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2275341f-e570-4ef5-83c9-2ff01d1158b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:19.766469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2275341f-e570-4ef5-83c9-2ff01d1158b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:19.828666 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2275341f-e570-4ef5-83c9-2ff01d1158b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:19.836591 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2275341f-e570-4ef5-83c9-2ff01d1158b6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.083313 Jul 14 16:12:19.837164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1470/2838] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:19 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:19.972877 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b71bd7bf-ccf6-477d-9803-0891e5c6df62 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:19.973536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b71bd7bf-ccf6-477d-9803-0891e5c6df62 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:19.981219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b71bd7bf-ccf6-477d-9803-0891e5c6df62 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:19.981703 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b71bd7bf-ccf6-477d-9803-0891e5c6df62 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:19.982544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b71bd7bf-ccf6-477d-9803-0891e5c6df62 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:19.983009 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b71bd7bf-ccf6-477d-9803-0891e5c6df62 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:20.129603 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b71bd7bf-ccf6-477d-9803-0891e5c6df62 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:20.137800 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b71bd7bf-ccf6-477d-9803-0891e5c6df62 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.169468 Jul 14 16:12:20.138372 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1369/2839] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:19 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:20.856117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9e1bc80b-bf4a-4318-9e3b-60056b562e88 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:20.856689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9e1bc80b-bf4a-4318-9e3b-60056b562e88 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:20.864197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e1bc80b-bf4a-4318-9e3b-60056b562e88 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:20.864676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e1bc80b-bf4a-4318-9e3b-60056b562e88 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:20.865436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e1bc80b-bf4a-4318-9e3b-60056b562e88 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:20.865883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9e1bc80b-bf4a-4318-9e3b-60056b562e88 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:20.935255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9e1bc80b-bf4a-4318-9e3b-60056b562e88 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:20.944667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9e1bc80b-bf4a-4318-9e3b-60056b562e88 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.093081 Jul 14 16:12:20.945246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1471/2840] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:20 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:21.156194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0b1ad103-95b8-4ef2-9b97-36c198a4270b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:21.156919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0b1ad103-95b8-4ef2-9b97-36c198a4270b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:21.164111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0b1ad103-95b8-4ef2-9b97-36c198a4270b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:21.164557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0b1ad103-95b8-4ef2-9b97-36c198a4270b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:21.165319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0b1ad103-95b8-4ef2-9b97-36c198a4270b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:21.165754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0b1ad103-95b8-4ef2-9b97-36c198a4270b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:21.304098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0b1ad103-95b8-4ef2-9b97-36c198a4270b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:21.312079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0b1ad103-95b8-4ef2-9b97-36c198a4270b tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.159780 Jul 14 16:12:21.312684 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1370/2841] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:21 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:21.962115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0f2b6cc5-861b-4bad-b034-68e239085c9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:21.962983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0f2b6cc5-861b-4bad-b034-68e239085c9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:21.970058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f2b6cc5-861b-4bad-b034-68e239085c9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:21.970058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f2b6cc5-861b-4bad-b034-68e239085c9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:21.971143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f2b6cc5-861b-4bad-b034-68e239085c9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:21.971143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f2b6cc5-861b-4bad-b034-68e239085c9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:22.037646 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0f2b6cc5-861b-4bad-b034-68e239085c9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:22.045947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0f2b6cc5-861b-4bad-b034-68e239085c9d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087702 Jul 14 16:12:22.046514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1472/2842] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:21 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:22.333121 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b8d325a4-a91f-4813-bf3b-12eae441c056 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:22.333907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b8d325a4-a91f-4813-bf3b-12eae441c056 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:22.340176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8d325a4-a91f-4813-bf3b-12eae441c056 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:22.340638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8d325a4-a91f-4813-bf3b-12eae441c056 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:22.341405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8d325a4-a91f-4813-bf3b-12eae441c056 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:22.341844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8d325a4-a91f-4813-bf3b-12eae441c056 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:22.477839 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b8d325a4-a91f-4813-bf3b-12eae441c056 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:22.486476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b8d325a4-a91f-4813-bf3b-12eae441c056 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157650 Jul 14 16:12:22.487188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1371/2843] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:22 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:23.063440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d6c26cf7-699a-4ac7-9edc-041d90c51cb8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:23.064294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d6c26cf7-699a-4ac7-9edc-041d90c51cb8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:23.073239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6c26cf7-699a-4ac7-9edc-041d90c51cb8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:23.074058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6c26cf7-699a-4ac7-9edc-041d90c51cb8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:23.075013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6c26cf7-699a-4ac7-9edc-041d90c51cb8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:23.075461 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d6c26cf7-699a-4ac7-9edc-041d90c51cb8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:23.140460 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d6c26cf7-699a-4ac7-9edc-041d90c51cb8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:23.149474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d6c26cf7-699a-4ac7-9edc-041d90c51cb8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.089968 Jul 14 16:12:23.150045 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1473/2844] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:23 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:23.504459 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3971224b-074f-40fe-b4e5-70b822fe5e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:23.505055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3971224b-074f-40fe-b4e5-70b822fe5e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:23.511508 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3971224b-074f-40fe-b4e5-70b822fe5e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:23.511996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3971224b-074f-40fe-b4e5-70b822fe5e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:23.512752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3971224b-074f-40fe-b4e5-70b822fe5e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:23.513193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3971224b-074f-40fe-b4e5-70b822fe5e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:23.650764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3971224b-074f-40fe-b4e5-70b822fe5e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:23.659328 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3971224b-074f-40fe-b4e5-70b822fe5e75 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.158967 Jul 14 16:12:23.659954 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1372/2845] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:23 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:24.167433 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d638719b-4f12-454a-bc1d-4e0bde169be9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:24.168034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d638719b-4f12-454a-bc1d-4e0bde169be9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:24.176365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d638719b-4f12-454a-bc1d-4e0bde169be9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:24.176816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d638719b-4f12-454a-bc1d-4e0bde169be9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:24.177581 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d638719b-4f12-454a-bc1d-4e0bde169be9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:24.178015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d638719b-4f12-454a-bc1d-4e0bde169be9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:24.242079 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d638719b-4f12-454a-bc1d-4e0bde169be9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:24.251009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d638719b-4f12-454a-bc1d-4e0bde169be9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087748 Jul 14 16:12:24.252099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1474/2846] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:24 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:24.676510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c82f278b-e867-460a-856b-afaf42384fac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:24.677134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c82f278b-e867-460a-856b-afaf42384fac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:24.683804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c82f278b-e867-460a-856b-afaf42384fac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:24.684260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c82f278b-e867-460a-856b-afaf42384fac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:24.685016 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c82f278b-e867-460a-856b-afaf42384fac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:24.685458 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c82f278b-e867-460a-856b-afaf42384fac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:24.689316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:24.819561 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c82f278b-e867-460a-856b-afaf42384fac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:24.830330 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c82f278b-e867-460a-856b-afaf42384fac tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157625 Jul 14 16:12:24.831726 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1373/2847] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:24 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:25.270366 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2d0442c1-2ad9-4035-8245-7d121273d2b7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:25.271102 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2d0442c1-2ad9-4035-8245-7d121273d2b7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:25.278904 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2d0442c1-2ad9-4035-8245-7d121273d2b7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:25.279472 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2d0442c1-2ad9-4035-8245-7d121273d2b7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:25.280476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2d0442c1-2ad9-4035-8245-7d121273d2b7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:25.281019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2d0442c1-2ad9-4035-8245-7d121273d2b7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:25.349347 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2d0442c1-2ad9-4035-8245-7d121273d2b7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:25.357815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2d0442c1-2ad9-4035-8245-7d121273d2b7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.093077 Jul 14 16:12:25.358388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1475/2848] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:25 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:25.848593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8e6f4596-6d65-49a7-9e20-355a3fae7b4d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:25.849205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8e6f4596-6d65-49a7-9e20-355a3fae7b4d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:25.856247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e6f4596-6d65-49a7-9e20-355a3fae7b4d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:25.856700 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e6f4596-6d65-49a7-9e20-355a3fae7b4d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:25.857455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e6f4596-6d65-49a7-9e20-355a3fae7b4d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:25.857892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8e6f4596-6d65-49a7-9e20-355a3fae7b4d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:25.988234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8e6f4596-6d65-49a7-9e20-355a3fae7b4d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:25.996465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8e6f4596-6d65-49a7-9e20-355a3fae7b4d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152104 Jul 14 16:12:25.997049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1374/2849] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:25 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:26.383922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f999fbbd-0db3-4c49-b567-74af39de85e7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:26.384555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f999fbbd-0db3-4c49-b567-74af39de85e7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:26.392033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f999fbbd-0db3-4c49-b567-74af39de85e7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:26.392513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f999fbbd-0db3-4c49-b567-74af39de85e7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:26.394413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f999fbbd-0db3-4c49-b567-74af39de85e7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:26.394413 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f999fbbd-0db3-4c49-b567-74af39de85e7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:26.463341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f999fbbd-0db3-4c49-b567-74af39de85e7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:26.472259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f999fbbd-0db3-4c49-b567-74af39de85e7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.092399 Jul 14 16:12:26.472931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1476/2850] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:26 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:27.014161 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-94098297-c0b3-45d8-a997-9759d916eb4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:27.014772 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-94098297-c0b3-45d8-a997-9759d916eb4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:27.021485 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-94098297-c0b3-45d8-a997-9759d916eb4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:27.021937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-94098297-c0b3-45d8-a997-9759d916eb4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:27.022715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-94098297-c0b3-45d8-a997-9759d916eb4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:27.023192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-94098297-c0b3-45d8-a997-9759d916eb4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:27.157157 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-94098297-c0b3-45d8-a997-9759d916eb4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:27.166211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-94098297-c0b3-45d8-a997-9759d916eb4c tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155987 Jul 14 16:12:27.166866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1375/2851] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:27 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:27.490643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-df61385a-4cf9-4f17-9e6d-752c03b750f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:27.491435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-df61385a-4cf9-4f17-9e6d-752c03b750f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:27.497933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-df61385a-4cf9-4f17-9e6d-752c03b750f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:27.498382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-df61385a-4cf9-4f17-9e6d-752c03b750f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:27.499155 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-df61385a-4cf9-4f17-9e6d-752c03b750f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:27.499589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-df61385a-4cf9-4f17-9e6d-752c03b750f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:27.563217 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-df61385a-4cf9-4f17-9e6d-752c03b750f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:27.572246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-df61385a-4cf9-4f17-9e6d-752c03b750f7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086328 Jul 14 16:12:27.572898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1477/2852] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:27 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:28.186056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6dc60c0b-3295-4ee8-8255-6a52fd7be88f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:28.186672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6dc60c0b-3295-4ee8-8255-6a52fd7be88f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:28.194248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6dc60c0b-3295-4ee8-8255-6a52fd7be88f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:28.194702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6dc60c0b-3295-4ee8-8255-6a52fd7be88f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:28.195471 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6dc60c0b-3295-4ee8-8255-6a52fd7be88f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:28.195940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6dc60c0b-3295-4ee8-8255-6a52fd7be88f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:28.331043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6dc60c0b-3295-4ee8-8255-6a52fd7be88f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:28.339370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6dc60c0b-3295-4ee8-8255-6a52fd7be88f tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157201 Jul 14 16:12:28.339993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1376/2853] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:28 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:28.590072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b065fd04-e5c0-4f6e-838b-54e87cafb48a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:28.590682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b065fd04-e5c0-4f6e-838b-54e87cafb48a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:28.597264 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b065fd04-e5c0-4f6e-838b-54e87cafb48a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:28.597716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b065fd04-e5c0-4f6e-838b-54e87cafb48a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:28.598474 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b065fd04-e5c0-4f6e-838b-54e87cafb48a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:28.598913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b065fd04-e5c0-4f6e-838b-54e87cafb48a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:28.664781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b065fd04-e5c0-4f6e-838b-54e87cafb48a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:28.673158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b065fd04-e5c0-4f6e-838b-54e87cafb48a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086963 Jul 14 16:12:28.673719 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1478/2854] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:28 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:29.356143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-eb9ce952-1c65-4ebb-9a52-5fb79c5e7e35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:29.356691 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-eb9ce952-1c65-4ebb-9a52-5fb79c5e7e35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:29.364098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eb9ce952-1c65-4ebb-9a52-5fb79c5e7e35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:29.364544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eb9ce952-1c65-4ebb-9a52-5fb79c5e7e35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:29.365293 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eb9ce952-1c65-4ebb-9a52-5fb79c5e7e35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:29.365728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-eb9ce952-1c65-4ebb-9a52-5fb79c5e7e35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:29.506318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-eb9ce952-1c65-4ebb-9a52-5fb79c5e7e35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:29.515556 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-eb9ce952-1c65-4ebb-9a52-5fb79c5e7e35 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.163489 Jul 14 16:12:29.516159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1377/2855] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:29 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:29.690935 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e35bb82b-c698-40ea-938a-8d695fd0194c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:29.692037 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e35bb82b-c698-40ea-938a-8d695fd0194c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:29.700358 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e35bb82b-c698-40ea-938a-8d695fd0194c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:29.700811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e35bb82b-c698-40ea-938a-8d695fd0194c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:29.701584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e35bb82b-c698-40ea-938a-8d695fd0194c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:29.702028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e35bb82b-c698-40ea-938a-8d695fd0194c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:29.768776 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e35bb82b-c698-40ea-938a-8d695fd0194c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:29.777260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e35bb82b-c698-40ea-938a-8d695fd0194c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.090655 Jul 14 16:12:29.777829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1479/2856] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:29 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:30.533745 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-612220ab-fa4a-478c-a39c-c0c7b9dae977 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:30.534354 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-612220ab-fa4a-478c-a39c-c0c7b9dae977 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:30.540975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-612220ab-fa4a-478c-a39c-c0c7b9dae977 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:30.541453 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-612220ab-fa4a-478c-a39c-c0c7b9dae977 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:30.542245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-612220ab-fa4a-478c-a39c-c0c7b9dae977 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:30.542707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-612220ab-fa4a-478c-a39c-c0c7b9dae977 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:30.676651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-612220ab-fa4a-478c-a39c-c0c7b9dae977 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:30.684813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-612220ab-fa4a-478c-a39c-c0c7b9dae977 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155301 Jul 14 16:12:30.685401 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1378/2857] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:30 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:30.795283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7ef20c8c-71fc-4ee3-b7df-e67fb72c65a3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:30.795883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7ef20c8c-71fc-4ee3-b7df-e67fb72c65a3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:30.802835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7ef20c8c-71fc-4ee3-b7df-e67fb72c65a3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:30.803286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7ef20c8c-71fc-4ee3-b7df-e67fb72c65a3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:30.804092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7ef20c8c-71fc-4ee3-b7df-e67fb72c65a3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:30.804530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7ef20c8c-71fc-4ee3-b7df-e67fb72c65a3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:30.871121 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7ef20c8c-71fc-4ee3-b7df-e67fb72c65a3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:30.879715 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7ef20c8c-71fc-4ee3-b7df-e67fb72c65a3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088587 Jul 14 16:12:30.880272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1480/2858] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:30 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:31.702708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dee5fc22-cc0f-42af-8b74-b100a0b6b0f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:31.703319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dee5fc22-cc0f-42af-8b74-b100a0b6b0f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:31.710823 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dee5fc22-cc0f-42af-8b74-b100a0b6b0f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:31.711378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dee5fc22-cc0f-42af-8b74-b100a0b6b0f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:31.712574 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dee5fc22-cc0f-42af-8b74-b100a0b6b0f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:31.713340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dee5fc22-cc0f-42af-8b74-b100a0b6b0f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:31.854566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-dee5fc22-cc0f-42af-8b74-b100a0b6b0f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:31.864084 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dee5fc22-cc0f-42af-8b74-b100a0b6b0f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.165142 Jul 14 16:12:31.864679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1379/2859] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:31 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:31.897083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7b8a7382-fc08-409d-a280-39bdaa7cf967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:31.897682 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7b8a7382-fc08-409d-a280-39bdaa7cf967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:31.904425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7b8a7382-fc08-409d-a280-39bdaa7cf967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:31.904879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7b8a7382-fc08-409d-a280-39bdaa7cf967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:31.905638 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7b8a7382-fc08-409d-a280-39bdaa7cf967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:31.906069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7b8a7382-fc08-409d-a280-39bdaa7cf967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:31.972930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7b8a7382-fc08-409d-a280-39bdaa7cf967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:31.981250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7b8a7382-fc08-409d-a280-39bdaa7cf967 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088696 Jul 14 16:12:31.981838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1481/2860] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:31 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:32.883760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-95f8efb5-7c88-4ea4-bc77-764e683209a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:32.884503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-95f8efb5-7c88-4ea4-bc77-764e683209a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:32.891787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-95f8efb5-7c88-4ea4-bc77-764e683209a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:32.891787 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-95f8efb5-7c88-4ea4-bc77-764e683209a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:32.892766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-95f8efb5-7c88-4ea4-bc77-764e683209a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:32.892766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-95f8efb5-7c88-4ea4-bc77-764e683209a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:32.999260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5f0cdcf5-4973-4ad7-ac26-ed15dc453323 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:32.999942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5f0cdcf5-4973-4ad7-ac26-ed15dc453323 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:33.001915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:33.007637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f0cdcf5-4973-4ad7-ac26-ed15dc453323 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:33.008174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f0cdcf5-4973-4ad7-ac26-ed15dc453323 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:33.009115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f0cdcf5-4973-4ad7-ac26-ed15dc453323 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:33.009625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5f0cdcf5-4973-4ad7-ac26-ed15dc453323 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:33.030294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:33.037316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-95f8efb5-7c88-4ea4-bc77-764e683209a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:33.046032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-95f8efb5-7c88-4ea4-bc77-764e683209a7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.166376 Jul 14 16:12:33.046620 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1380/2861] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:32 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:33.081451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5f0cdcf5-4973-4ad7-ac26-ed15dc453323 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:33.089733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5f0cdcf5-4973-4ad7-ac26-ed15dc453323 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.095201 Jul 14 16:12:33.090334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1482/2862] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:32 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:34.063766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2983034e-8adc-4f4c-b30b-5bc519039895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:34.064433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2983034e-8adc-4f4c-b30b-5bc519039895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:34.071076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2983034e-8adc-4f4c-b30b-5bc519039895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:34.071557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2983034e-8adc-4f4c-b30b-5bc519039895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:34.072377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2983034e-8adc-4f4c-b30b-5bc519039895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:34.072854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2983034e-8adc-4f4c-b30b-5bc519039895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:34.110401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-16dffe2e-802d-4983-a959-abdb2219e98b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:34.111046 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-16dffe2e-802d-4983-a959-abdb2219e98b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:34.118702 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16dffe2e-802d-4983-a959-abdb2219e98b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:34.119154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16dffe2e-802d-4983-a959-abdb2219e98b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:34.120029 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16dffe2e-802d-4983-a959-abdb2219e98b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:34.120667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16dffe2e-802d-4983-a959-abdb2219e98b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:34.190928 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-16dffe2e-802d-4983-a959-abdb2219e98b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:34.200653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-16dffe2e-802d-4983-a959-abdb2219e98b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.096843 Jul 14 16:12:34.201236 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1483/2863] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:34 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:34.233133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2983034e-8adc-4f4c-b30b-5bc519039895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:34.242021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2983034e-8adc-4f4c-b30b-5bc519039895 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.182241 Jul 14 16:12:34.242594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1381/2864] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:34 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:35.217445 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6277e52b-e99b-44e2-bfe4-27691f5837b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:35.218040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6277e52b-e99b-44e2-bfe4-27691f5837b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:35.224841 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6277e52b-e99b-44e2-bfe4-27691f5837b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:35.225292 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6277e52b-e99b-44e2-bfe4-27691f5837b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:35.226048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6277e52b-e99b-44e2-bfe4-27691f5837b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:35.226478 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6277e52b-e99b-44e2-bfe4-27691f5837b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:35.259497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bb82a8ce-c4f5-49ba-afc1-58e9dbcd6599 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:35.260067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bb82a8ce-c4f5-49ba-afc1-58e9dbcd6599 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:35.266486 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb82a8ce-c4f5-49ba-afc1-58e9dbcd6599 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:35.266939 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb82a8ce-c4f5-49ba-afc1-58e9dbcd6599 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:35.267735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb82a8ce-c4f5-49ba-afc1-58e9dbcd6599 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:35.268329 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb82a8ce-c4f5-49ba-afc1-58e9dbcd6599 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:35.295432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6277e52b-e99b-44e2-bfe4-27691f5837b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:35.304396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6277e52b-e99b-44e2-bfe4-27691f5837b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.090782 Jul 14 16:12:35.304978 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1484/2865] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:35 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:35.402171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bb82a8ce-c4f5-49ba-afc1-58e9dbcd6599 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:35.410993 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bb82a8ce-c4f5-49ba-afc1-58e9dbcd6599 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.155392 Jul 14 16:12:35.411577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1382/2866] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:35 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:36.321799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-88d491ea-2142-40d0-a8d9-13dbe21e5d52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:36.322359 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-88d491ea-2142-40d0-a8d9-13dbe21e5d52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:36.328847 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-88d491ea-2142-40d0-a8d9-13dbe21e5d52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:36.329297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-88d491ea-2142-40d0-a8d9-13dbe21e5d52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:36.330048 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-88d491ea-2142-40d0-a8d9-13dbe21e5d52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:36.334120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-88d491ea-2142-40d0-a8d9-13dbe21e5d52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:36.396721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-88d491ea-2142-40d0-a8d9-13dbe21e5d52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:36.404956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-88d491ea-2142-40d0-a8d9-13dbe21e5d52 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087109 Jul 14 16:12:36.405523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1485/2867] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:36 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:36.428257 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0f618ec4-6764-43e1-9b2b-60ff33511f27 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:36.428869 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0f618ec4-6764-43e1-9b2b-60ff33511f27 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:36.435554 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0f618ec4-6764-43e1-9b2b-60ff33511f27 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:36.436056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0f618ec4-6764-43e1-9b2b-60ff33511f27 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:36.436817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0f618ec4-6764-43e1-9b2b-60ff33511f27 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:36.437295 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0f618ec4-6764-43e1-9b2b-60ff33511f27 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:36.569314 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0f618ec4-6764-43e1-9b2b-60ff33511f27 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:36.577308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0f618ec4-6764-43e1-9b2b-60ff33511f27 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.152935 Jul 14 16:12:36.577814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1383/2868] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:36 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:37.422127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0b511d7b-d204-4f51-b946-aaf202f92dd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:37.422740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0b511d7b-d204-4f51-b946-aaf202f92dd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:37.429814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b511d7b-d204-4f51-b946-aaf202f92dd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:37.430269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b511d7b-d204-4f51-b946-aaf202f92dd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:37.431024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b511d7b-d204-4f51-b946-aaf202f92dd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:37.431458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b511d7b-d204-4f51-b946-aaf202f92dd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:37.494385 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0b511d7b-d204-4f51-b946-aaf202f92dd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:37.502346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0b511d7b-d204-4f51-b946-aaf202f92dd5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084277 Jul 14 16:12:37.503092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1486/2869] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:37 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:37.594138 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-11af84a8-400a-4d18-9d8a-8fd41d123f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:37.594813 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-11af84a8-400a-4d18-9d8a-8fd41d123f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:37.602378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-11af84a8-400a-4d18-9d8a-8fd41d123f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:37.602835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-11af84a8-400a-4d18-9d8a-8fd41d123f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:37.603632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-11af84a8-400a-4d18-9d8a-8fd41d123f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:37.604065 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-11af84a8-400a-4d18-9d8a-8fd41d123f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:37.738857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-11af84a8-400a-4d18-9d8a-8fd41d123f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:37.746804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-11af84a8-400a-4d18-9d8a-8fd41d123f16 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.156603 Jul 14 16:12:37.747373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1384/2870] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:37 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:38.521455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2e2967b0-1148-4c67-9539-66f7f3b9b52d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:38.522059 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2e2967b0-1148-4c67-9539-66f7f3b9b52d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:38.530223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e2967b0-1148-4c67-9539-66f7f3b9b52d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:38.530621 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e2967b0-1148-4c67-9539-66f7f3b9b52d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:38.531392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e2967b0-1148-4c67-9539-66f7f3b9b52d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:38.531872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2e2967b0-1148-4c67-9539-66f7f3b9b52d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:38.596532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2e2967b0-1148-4c67-9539-66f7f3b9b52d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:38.604512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2e2967b0-1148-4c67-9539-66f7f3b9b52d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088661 Jul 14 16:12:38.605076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1487/2871] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:38 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:38.764446 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7ab3babf-34ba-47a0-85b9-2ce108a0d7a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:38.765058 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7ab3babf-34ba-47a0-85b9-2ce108a0d7a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:38.773249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7ab3babf-34ba-47a0-85b9-2ce108a0d7a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:38.773695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7ab3babf-34ba-47a0-85b9-2ce108a0d7a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:38.774451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7ab3babf-34ba-47a0-85b9-2ce108a0d7a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:38.774895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7ab3babf-34ba-47a0-85b9-2ce108a0d7a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:38.912922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7ab3babf-34ba-47a0-85b9-2ce108a0d7a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:38.921409 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7ab3babf-34ba-47a0-85b9-2ce108a0d7a9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.160739 Jul 14 16:12:38.921999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1385/2872] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:38 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:39.621380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-30ea3070-aa86-49a2-9859-d2de82f5d1dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:39.621998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-30ea3070-aa86-49a2-9859-d2de82f5d1dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:39.629393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30ea3070-aa86-49a2-9859-d2de82f5d1dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:39.629845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30ea3070-aa86-49a2-9859-d2de82f5d1dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:39.630628 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30ea3070-aa86-49a2-9859-d2de82f5d1dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:39.631066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-30ea3070-aa86-49a2-9859-d2de82f5d1dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:39.696416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-30ea3070-aa86-49a2-9859-d2de82f5d1dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:39.704425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-30ea3070-aa86-49a2-9859-d2de82f5d1dc tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087357 Jul 14 16:12:39.704996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1488/2873] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:39 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:39.939476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ff3accee-28b1-477d-8cd7-c7df63ad8b38 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:39.940742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ff3accee-28b1-477d-8cd7-c7df63ad8b38 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:39.947432 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ff3accee-28b1-477d-8cd7-c7df63ad8b38 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:39.947924 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ff3accee-28b1-477d-8cd7-c7df63ad8b38 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:39.948688 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ff3accee-28b1-477d-8cd7-c7df63ad8b38 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:39.949129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ff3accee-28b1-477d-8cd7-c7df63ad8b38 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:40.081961 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ff3accee-28b1-477d-8cd7-c7df63ad8b38 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:40.089793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ff3accee-28b1-477d-8cd7-c7df63ad8b38 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154156 Jul 14 16:12:40.090367 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1386/2874] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:39 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:40.722733 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8f292dc0-29da-4f05-ab1a-380bebbff91f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:40.723410 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8f292dc0-29da-4f05-ab1a-380bebbff91f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:40.730486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8f292dc0-29da-4f05-ab1a-380bebbff91f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:40.730965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8f292dc0-29da-4f05-ab1a-380bebbff91f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:40.731816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8f292dc0-29da-4f05-ab1a-380bebbff91f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:40.732304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8f292dc0-29da-4f05-ab1a-380bebbff91f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:40.797903 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8f292dc0-29da-4f05-ab1a-380bebbff91f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:40.806958 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8f292dc0-29da-4f05-ab1a-380bebbff91f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088922 Jul 14 16:12:40.807531 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1489/2875] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:40 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:41.106884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-41e1b850-2cc9-4257-87c9-ae133e335efe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:41.107495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-41e1b850-2cc9-4257-87c9-ae133e335efe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:41.114500 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-41e1b850-2cc9-4257-87c9-ae133e335efe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:41.115061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-41e1b850-2cc9-4257-87c9-ae133e335efe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:41.115743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-41e1b850-2cc9-4257-87c9-ae133e335efe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:41.116188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-41e1b850-2cc9-4257-87c9-ae133e335efe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:41.248181 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-41e1b850-2cc9-4257-87c9-ae133e335efe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:41.256140 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-41e1b850-2cc9-4257-87c9-ae133e335efe tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.153401 Jul 14 16:12:41.256708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1387/2876] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:41 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:41.824529 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0b65f3df-4223-4952-9f2b-bd7bc2e9ddfb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:41.825422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0b65f3df-4223-4952-9f2b-bd7bc2e9ddfb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:41.831984 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b65f3df-4223-4952-9f2b-bd7bc2e9ddfb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:41.832425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b65f3df-4223-4952-9f2b-bd7bc2e9ddfb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:41.833234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b65f3df-4223-4952-9f2b-bd7bc2e9ddfb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:41.834028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b65f3df-4223-4952-9f2b-bd7bc2e9ddfb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:41.897370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0b65f3df-4223-4952-9f2b-bd7bc2e9ddfb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:41.905485 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0b65f3df-4223-4952-9f2b-bd7bc2e9ddfb tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085063 Jul 14 16:12:41.906047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1490/2877] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:41 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:42.274098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-829e2552-8cf0-46a0-ae86-4f138bdfc063 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:42.274700 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-829e2552-8cf0-46a0-ae86-4f138bdfc063 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:42.281192 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-829e2552-8cf0-46a0-ae86-4f138bdfc063 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:42.281645 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-829e2552-8cf0-46a0-ae86-4f138bdfc063 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:42.282403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-829e2552-8cf0-46a0-ae86-4f138bdfc063 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:42.282843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-829e2552-8cf0-46a0-ae86-4f138bdfc063 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:42.413746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-829e2552-8cf0-46a0-ae86-4f138bdfc063 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:42.422083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-829e2552-8cf0-46a0-ae86-4f138bdfc063 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151890 Jul 14 16:12:42.422648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1388/2878] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:42 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:42.922513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-436f08b6-3a99-4d32-99cf-d1d87a76987f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:42.923199 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-436f08b6-3a99-4d32-99cf-d1d87a76987f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:42.930973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-436f08b6-3a99-4d32-99cf-d1d87a76987f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:42.931425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-436f08b6-3a99-4d32-99cf-d1d87a76987f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:42.932227 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-436f08b6-3a99-4d32-99cf-d1d87a76987f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:42.932691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-436f08b6-3a99-4d32-99cf-d1d87a76987f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:42.996442 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-436f08b6-3a99-4d32-99cf-d1d87a76987f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:43.004878 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-436f08b6-3a99-4d32-99cf-d1d87a76987f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086591 Jul 14 16:12:43.005449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1491/2879] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:42 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:43.440589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1cc6c150-dead-48e7-9900-152d2dbb8920 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:43.441199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1cc6c150-dead-48e7-9900-152d2dbb8920 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:43.447799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1cc6c150-dead-48e7-9900-152d2dbb8920 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:43.448280 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1cc6c150-dead-48e7-9900-152d2dbb8920 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:43.449085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1cc6c150-dead-48e7-9900-152d2dbb8920 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:43.449550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1cc6c150-dead-48e7-9900-152d2dbb8920 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:43.584339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1cc6c150-dead-48e7-9900-152d2dbb8920 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:43.587751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:43.593419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1cc6c150-dead-48e7-9900-152d2dbb8920 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.157391 Jul 14 16:12:43.594015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1389/2880] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:43 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:44.022074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-068d956d-aa3b-4a39-abf5-2f89aa07adc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:44.022698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-068d956d-aa3b-4a39-abf5-2f89aa07adc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:44.029456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-068d956d-aa3b-4a39-abf5-2f89aa07adc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:44.029912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-068d956d-aa3b-4a39-abf5-2f89aa07adc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:44.030664 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-068d956d-aa3b-4a39-abf5-2f89aa07adc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:44.031101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-068d956d-aa3b-4a39-abf5-2f89aa07adc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:44.098338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-068d956d-aa3b-4a39-abf5-2f89aa07adc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:44.106260 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-068d956d-aa3b-4a39-abf5-2f89aa07adc9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088617 Jul 14 16:12:44.106831 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1492/2881] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:44 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:44.610449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8057121c-5c9b-4d8c-aa5d-6916d5b749e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:44.611063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8057121c-5c9b-4d8c-aa5d-6916d5b749e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:44.617987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8057121c-5c9b-4d8c-aa5d-6916d5b749e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:44.618440 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8057121c-5c9b-4d8c-aa5d-6916d5b749e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:44.619196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8057121c-5c9b-4d8c-aa5d-6916d5b749e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:44.619662 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8057121c-5c9b-4d8c-aa5d-6916d5b749e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:44.747862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8057121c-5c9b-4d8c-aa5d-6916d5b749e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:44.757053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8057121c-5c9b-4d8c-aa5d-6916d5b749e9 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150678 Jul 14 16:12:44.757623 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1390/2882] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:44 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:45.122553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1f8d0064-05d6-438e-9760-1fd119a97a93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:45.123083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1f8d0064-05d6-438e-9760-1fd119a97a93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:45.130220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f8d0064-05d6-438e-9760-1fd119a97a93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:45.130663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f8d0064-05d6-438e-9760-1fd119a97a93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:45.131408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f8d0064-05d6-438e-9760-1fd119a97a93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:45.131865 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1f8d0064-05d6-438e-9760-1fd119a97a93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:45.192689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-1f8d0064-05d6-438e-9760-1fd119a97a93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:45.200934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1f8d0064-05d6-438e-9760-1fd119a97a93 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.082312 Jul 14 16:12:45.201501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1493/2883] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:45 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:45.774628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-27a0d050-cfd1-4602-a614-b224903410c6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:45.775273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-27a0d050-cfd1-4602-a614-b224903410c6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:45.777634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=54 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:45.782913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-27a0d050-cfd1-4602-a614-b224903410c6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:45.783418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-27a0d050-cfd1-4602-a614-b224903410c6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:45.784221 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-27a0d050-cfd1-4602-a614-b224903410c6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:45.784666 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-27a0d050-cfd1-4602-a614-b224903410c6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:45.916951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-27a0d050-cfd1-4602-a614-b224903410c6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:45.925635 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-27a0d050-cfd1-4602-a614-b224903410c6 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154984 Jul 14 16:12:45.926205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1391/2884] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:45 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:46.218510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a1a5e79a-7f3b-4bbd-a714-7b5f473b24a9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:46.219108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a1a5e79a-7f3b-4bbd-a714-7b5f473b24a9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:46.225862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1a5e79a-7f3b-4bbd-a714-7b5f473b24a9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:46.226316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1a5e79a-7f3b-4bbd-a714-7b5f473b24a9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:46.227075 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1a5e79a-7f3b-4bbd-a714-7b5f473b24a9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:46.227516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a1a5e79a-7f3b-4bbd-a714-7b5f473b24a9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:46.292031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a1a5e79a-7f3b-4bbd-a714-7b5f473b24a9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:46.300950 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a1a5e79a-7f3b-4bbd-a714-7b5f473b24a9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086449 Jul 14 16:12:46.301515 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1494/2885] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:46 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:46.943062 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-05e9610c-3032-49c7-9895-7e504167a095 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:46.943715 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-05e9610c-3032-49c7-9895-7e504167a095 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:46.950247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-05e9610c-3032-49c7-9895-7e504167a095 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:46.950692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-05e9610c-3032-49c7-9895-7e504167a095 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:46.951451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-05e9610c-3032-49c7-9895-7e504167a095 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:46.951913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-05e9610c-3032-49c7-9895-7e504167a095 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:47.084434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-05e9610c-3032-49c7-9895-7e504167a095 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:47.092327 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-05e9610c-3032-49c7-9895-7e504167a095 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.153914 Jul 14 16:12:47.092893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1392/2886] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:46 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:47.317976 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0f81902b-58af-415d-9728-d452608824b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:47.318539 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0f81902b-58af-415d-9728-d452608824b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:47.325146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f81902b-58af-415d-9728-d452608824b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:47.325598 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f81902b-58af-415d-9728-d452608824b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:47.326353 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f81902b-58af-415d-9728-d452608824b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:47.326792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f81902b-58af-415d-9728-d452608824b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:47.389310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0f81902b-58af-415d-9728-d452608824b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:47.397824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0f81902b-58af-415d-9728-d452608824b4 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084023 Jul 14 16:12:47.398384 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1495/2887] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:47 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:48.109885 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-85034e90-198e-41aa-9284-8e8c57d47e36 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:48.110488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-85034e90-198e-41aa-9284-8e8c57d47e36 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:48.117636 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85034e90-198e-41aa-9284-8e8c57d47e36 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:48.118082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85034e90-198e-41aa-9284-8e8c57d47e36 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:48.118828 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85034e90-198e-41aa-9284-8e8c57d47e36 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:48.119263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-85034e90-198e-41aa-9284-8e8c57d47e36 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:48.249238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-85034e90-198e-41aa-9284-8e8c57d47e36 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:48.257428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-85034e90-198e-41aa-9284-8e8c57d47e36 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151336 Jul 14 16:12:48.258090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1393/2888] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:48 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:48.415351 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-13186c47-8817-4bd2-a782-8ec27cfa3be3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:48.416013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-13186c47-8817-4bd2-a782-8ec27cfa3be3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:48.423469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13186c47-8817-4bd2-a782-8ec27cfa3be3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:48.423944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13186c47-8817-4bd2-a782-8ec27cfa3be3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:48.425655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13186c47-8817-4bd2-a782-8ec27cfa3be3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:48.426128 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-13186c47-8817-4bd2-a782-8ec27cfa3be3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:48.490760 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-13186c47-8817-4bd2-a782-8ec27cfa3be3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:48.498638 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-13186c47-8817-4bd2-a782-8ec27cfa3be3 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087140 Jul 14 16:12:48.499139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1496/2889] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:48 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:49.274850 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-0cb86f57-0cb0-4636-b2a6-611d588f94aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:49.275410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-0cb86f57-0cb0-4636-b2a6-611d588f94aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:49.282088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cb86f57-0cb0-4636-b2a6-611d588f94aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:49.282545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cb86f57-0cb0-4636-b2a6-611d588f94aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:49.283314 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cb86f57-0cb0-4636-b2a6-611d588f94aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:49.283789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-0cb86f57-0cb0-4636-b2a6-611d588f94aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:49.421551 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-0cb86f57-0cb0-4636-b2a6-611d588f94aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:49.430063 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-0cb86f57-0cb0-4636-b2a6-611d588f94aa tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.159151 Jul 14 16:12:49.430624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1394/2890] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:49 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:49.515317 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-09545b7c-4838-4caa-bef9-21f1ddff2839 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:49.515972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-09545b7c-4838-4caa-bef9-21f1ddff2839 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:49.523251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-09545b7c-4838-4caa-bef9-21f1ddff2839 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:49.523743 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-09545b7c-4838-4caa-bef9-21f1ddff2839 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:49.524509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-09545b7c-4838-4caa-bef9-21f1ddff2839 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:49.525001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-09545b7c-4838-4caa-bef9-21f1ddff2839 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:49.590022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-09545b7c-4838-4caa-bef9-21f1ddff2839 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:49.599019 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-09545b7c-4838-4caa-bef9-21f1ddff2839 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.087585 Jul 14 16:12:49.599619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1497/2891] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:49 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:50.447318 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a60dbaf9-ea18-42cf-ae5d-aedb301c01ee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:50.447946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a60dbaf9-ea18-42cf-ae5d-aedb301c01ee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:50.454455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a60dbaf9-ea18-42cf-ae5d-aedb301c01ee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:50.454902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a60dbaf9-ea18-42cf-ae5d-aedb301c01ee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:50.455693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a60dbaf9-ea18-42cf-ae5d-aedb301c01ee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:50.456138 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a60dbaf9-ea18-42cf-ae5d-aedb301c01ee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:50.585835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a60dbaf9-ea18-42cf-ae5d-aedb301c01ee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:50.593930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a60dbaf9-ea18-42cf-ae5d-aedb301c01ee tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.150641 Jul 14 16:12:50.594495 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1395/2892] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:50 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:50.615898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5a689bc8-5390-46e1-abb8-6fcf7e2141c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:50.616669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5a689bc8-5390-46e1-abb8-6fcf7e2141c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:50.622977 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a689bc8-5390-46e1-abb8-6fcf7e2141c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:50.623421 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a689bc8-5390-46e1-abb8-6fcf7e2141c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:50.624197 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a689bc8-5390-46e1-abb8-6fcf7e2141c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:50.624632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a689bc8-5390-46e1-abb8-6fcf7e2141c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:50.687514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5a689bc8-5390-46e1-abb8-6fcf7e2141c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:50.695574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5a689bc8-5390-46e1-abb8-6fcf7e2141c8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084091 Jul 14 16:12:50.696150 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1498/2893] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:50 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:51.611298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-dfd9e4a1-37b1-4b99-80cc-825534d5f627 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:51.611907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-dfd9e4a1-37b1-4b99-80cc-825534d5f627 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:51.619528 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dfd9e4a1-37b1-4b99-80cc-825534d5f627 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:51.620015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dfd9e4a1-37b1-4b99-80cc-825534d5f627 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:51.620778 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dfd9e4a1-37b1-4b99-80cc-825534d5f627 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:51.621217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-dfd9e4a1-37b1-4b99-80cc-825534d5f627 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:51.711506 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-97fa6748-1752-4f28-8d7b-f3a3d47a2173 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:51.712247 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-97fa6748-1752-4f28-8d7b-f3a3d47a2173 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:51.718838 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97fa6748-1752-4f28-8d7b-f3a3d47a2173 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:51.719296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97fa6748-1752-4f28-8d7b-f3a3d47a2173 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:51.720096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97fa6748-1752-4f28-8d7b-f3a3d47a2173 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:51.720541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-97fa6748-1752-4f28-8d7b-f3a3d47a2173 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:51.724584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:12:51.757492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-dfd9e4a1-37b1-4b99-80cc-825534d5f627 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:51.765636 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-dfd9e4a1-37b1-4b99-80cc-825534d5f627 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.158236 Jul 14 16:12:51.766213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1396/2894] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:51 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:51.783301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-97fa6748-1752-4f28-8d7b-f3a3d47a2173 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:51.791970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-97fa6748-1752-4f28-8d7b-f3a3d47a2173 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084168 Jul 14 16:12:51.792556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1499/2895] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:51 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:52.783450 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6ebe13ba-8185-45f4-8387-cd301b75d1d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:52.784099 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6ebe13ba-8185-45f4-8387-cd301b75d1d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:52.791299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ebe13ba-8185-45f4-8387-cd301b75d1d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:52.791788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ebe13ba-8185-45f4-8387-cd301b75d1d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:52.792552 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ebe13ba-8185-45f4-8387-cd301b75d1d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:52.792989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ebe13ba-8185-45f4-8387-cd301b75d1d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:52.809692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8197cc2d-aa34-4337-84d8-a24b5cc2c8c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:52.810309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8197cc2d-aa34-4337-84d8-a24b5cc2c8c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:52.817297 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8197cc2d-aa34-4337-84d8-a24b5cc2c8c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:52.817739 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8197cc2d-aa34-4337-84d8-a24b5cc2c8c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:52.818493 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8197cc2d-aa34-4337-84d8-a24b5cc2c8c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:52.818923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8197cc2d-aa34-4337-84d8-a24b5cc2c8c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:52.885458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8197cc2d-aa34-4337-84d8-a24b5cc2c8c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:52.893685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8197cc2d-aa34-4337-84d8-a24b5cc2c8c2 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.088295 Jul 14 16:12:52.895224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1500/2896] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:52 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:52.932521 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6ebe13ba-8185-45f4-8387-cd301b75d1d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:52.940443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6ebe13ba-8185-45f4-8387-cd301b75d1d4 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.161338 Jul 14 16:12:52.941611 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1397/2897] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:52 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:53.912198 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7f784449-3595-43d8-bfbc-d1f113b929aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:53.912812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7f784449-3595-43d8-bfbc-d1f113b929aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:53.919711 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f784449-3595-43d8-bfbc-d1f113b929aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:53.920426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f784449-3595-43d8-bfbc-d1f113b929aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:53.921194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f784449-3595-43d8-bfbc-d1f113b929aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:53.921630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f784449-3595-43d8-bfbc-d1f113b929aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:53.959303 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-564292ca-db83-4abf-9134-66990ac12e58 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:53.959983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-564292ca-db83-4abf-9134-66990ac12e58 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:53.966894 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-564292ca-db83-4abf-9134-66990ac12e58 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:53.967346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-564292ca-db83-4abf-9134-66990ac12e58 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:53.968217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-564292ca-db83-4abf-9134-66990ac12e58 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:53.968658 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-564292ca-db83-4abf-9134-66990ac12e58 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:53.985980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7f784449-3595-43d8-bfbc-d1f113b929aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:53.994343 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7f784449-3595-43d8-bfbc-d1f113b929aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.086712 Jul 14 16:12:53.996212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1501/2898] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:53 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:54.113122 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-564292ca-db83-4abf-9134-66990ac12e58 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:54.121111 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-564292ca-db83-4abf-9134-66990ac12e58 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.166767 Jul 14 16:12:54.121676 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1398/2899] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:53 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:12:55.010555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f68c45d2-5f8b-422a-a700-b00c32e04ce0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:55.011188 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f68c45d2-5f8b-422a-a700-b00c32e04ce0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:55.017685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f68c45d2-5f8b-422a-a700-b00c32e04ce0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:55.018127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f68c45d2-5f8b-422a-a700-b00c32e04ce0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:55.019522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f68c45d2-5f8b-422a-a700-b00c32e04ce0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:55.020153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f68c45d2-5f8b-422a-a700-b00c32e04ce0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:55.084032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f68c45d2-5f8b-422a-a700-b00c32e04ce0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:55.091887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f68c45d2-5f8b-422a-a700-b00c32e04ce0 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085351 Jul 14 16:12:55.092451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1502/2900] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:55 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:55.138595 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-42dfa1be-cf0a-4aab-aac1-ff4b847c43eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:55.139205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-42dfa1be-cf0a-4aab-aac1-ff4b847c43eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:55.146571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-42dfa1be-cf0a-4aab-aac1-ff4b847c43eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:55.147020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-42dfa1be-cf0a-4aab-aac1-ff4b847c43eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:55.147822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-42dfa1be-cf0a-4aab-aac1-ff4b847c43eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:55.148263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-42dfa1be-cf0a-4aab-aac1-ff4b847c43eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:55.278403 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-42dfa1be-cf0a-4aab-aac1-ff4b847c43eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:55.286488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-42dfa1be-cf0a-4aab-aac1-ff4b847c43eb tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.151724 Jul 14 16:12:55.287060 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1399/2901] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:55 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:56.108459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e236cd12-a616-4064-bc2c-0685154c9917 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:56.109083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e236cd12-a616-4064-bc2c-0685154c9917 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:56.115762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e236cd12-a616-4064-bc2c-0685154c9917 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:56.116207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e236cd12-a616-4064-bc2c-0685154c9917 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:56.116951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e236cd12-a616-4064-bc2c-0685154c9917 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:56.117381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e236cd12-a616-4064-bc2c-0685154c9917 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:56.182234 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e236cd12-a616-4064-bc2c-0685154c9917 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:56.190160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e236cd12-a616-4064-bc2c-0685154c9917 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.085565 Jul 14 16:12:56.190801 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1503/2902] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:56 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:56.303740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-57ba2fde-7c32-418d-9eb3-01d6714bf4c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:56.304326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-57ba2fde-7c32-418d-9eb3-01d6714bf4c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:56.310893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-57ba2fde-7c32-418d-9eb3-01d6714bf4c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:56.311348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-57ba2fde-7c32-418d-9eb3-01d6714bf4c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:56.312145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-57ba2fde-7c32-418d-9eb3-01d6714bf4c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:56.312585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-57ba2fde-7c32-418d-9eb3-01d6714bf4c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:56.446332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-57ba2fde-7c32-418d-9eb3-01d6714bf4c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:56.454162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-57ba2fde-7c32-418d-9eb3-01d6714bf4c1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.154483 Jul 14 16:12:56.454733 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1400/2903] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:56 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:57.207665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a27f4fb5-ae8f-44a1-a58f-98405e7f9647 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:57.208304 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a27f4fb5-ae8f-44a1-a58f-98405e7f9647 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:57.214764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a27f4fb5-ae8f-44a1-a58f-98405e7f9647 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:57.215204 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a27f4fb5-ae8f-44a1-a58f-98405e7f9647 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:57.215974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a27f4fb5-ae8f-44a1-a58f-98405e7f9647 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:57.216404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a27f4fb5-ae8f-44a1-a58f-98405e7f9647 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:57.279932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a27f4fb5-ae8f-44a1-a58f-98405e7f9647 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:57.288370 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a27f4fb5-ae8f-44a1-a58f-98405e7f9647 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.084867 Jul 14 16:12:57.288932 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1504/2904] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:57 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:57.470937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a9f64ff0-6f98-4d9e-804c-f9caabf877ca tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:57.471555 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a9f64ff0-6f98-4d9e-804c-f9caabf877ca tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:57.478973 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a9f64ff0-6f98-4d9e-804c-f9caabf877ca tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:57.479166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a9f64ff0-6f98-4d9e-804c-f9caabf877ca tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:57.479956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a9f64ff0-6f98-4d9e-804c-f9caabf877ca tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:57.480399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a9f64ff0-6f98-4d9e-804c-f9caabf877ca tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:57.616843 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a9f64ff0-6f98-4d9e-804c-f9caabf877ca tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:57.625123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a9f64ff0-6f98-4d9e-804c-f9caabf877ca tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1737 microversion: 2.1 time: 0.158146 Jul 14 16:12:57.625697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1401/2905] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:57 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1737 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:58.311061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ac38ae3d-726e-4a81-b7f3-809b43bbae21 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:58.312821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ac38ae3d-726e-4a81-b7f3-809b43bbae21 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:58.325310 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac38ae3d-726e-4a81-b7f3-809b43bbae21 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:58.326036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac38ae3d-726e-4a81-b7f3-809b43bbae21 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:58.327217 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac38ae3d-726e-4a81-b7f3-809b43bbae21 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:58.328866 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ac38ae3d-726e-4a81-b7f3-809b43bbae21 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:58.418231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ac38ae3d-726e-4a81-b7f3-809b43bbae21 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:58.427388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ac38ae3d-726e-4a81-b7f3-809b43bbae21 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1369 microversion: 2.1 time: 0.124765 Jul 14 16:12:58.436885 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1505/2906] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:58 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1369 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:58.642996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d3536f10-6f80-4f2a-a966-99543a0bd4f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:58.644857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d3536f10-6f80-4f2a-a966-99543a0bd4f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:58.652224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d3536f10-6f80-4f2a-a966-99543a0bd4f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:58.652671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d3536f10-6f80-4f2a-a966-99543a0bd4f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:58.653603 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d3536f10-6f80-4f2a-a966-99543a0bd4f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:58.654337 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d3536f10-6f80-4f2a-a966-99543a0bd4f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:58.828206 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d3536f10-6f80-4f2a-a966-99543a0bd4f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:58.836686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d3536f10-6f80-4f2a-a966-99543a0bd4f1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1691 microversion: 2.1 time: 0.198290 Jul 14 16:12:58.837195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1402/2907] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:58 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1691 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:59.444778 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9661d0c7-eebf-4138-93d5-ee1e82a01179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:59.445414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9661d0c7-eebf-4138-93d5-ee1e82a01179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:59.457126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9661d0c7-eebf-4138-93d5-ee1e82a01179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:59.457701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9661d0c7-eebf-4138-93d5-ee1e82a01179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:59.458988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9661d0c7-eebf-4138-93d5-ee1e82a01179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:59.458988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9661d0c7-eebf-4138-93d5-ee1e82a01179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:59.491913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9661d0c7-eebf-4138-93d5-ee1e82a01179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:59.492364 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9661d0c7-eebf-4138-93d5-ee1e82a01179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:59.492814 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-9661d0c7-eebf-4138-93d5-ee1e82a01179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lazy-loading 'fault' on Instance uuid f3d96a86-d045-44b2-b298-75df12f65c86 {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:12:59.533894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9661d0c7-eebf-4138-93d5-ee1e82a01179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:12:59.541717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9661d0c7-eebf-4138-93d5-ee1e82a01179 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 200 len: 1463 microversion: 2.1 time: 0.101833 Jul 14 16:12:59.542282 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1506/2908] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:59 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 1463 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:12:59.853668 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-603b2fd1-eb58-4e2a-9d1e-5a24738eb7f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:12:59.854290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-603b2fd1-eb58-4e2a-9d1e-5a24738eb7f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:12:59.861685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-603b2fd1-eb58-4e2a-9d1e-5a24738eb7f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:59.862234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-603b2fd1-eb58-4e2a-9d1e-5a24738eb7f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:12:59.864009 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-603b2fd1-eb58-4e2a-9d1e-5a24738eb7f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:12:59.864751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-603b2fd1-eb58-4e2a-9d1e-5a24738eb7f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:00.047738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-603b2fd1-eb58-4e2a-9d1e-5a24738eb7f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:00.056468 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-603b2fd1-eb58-4e2a-9d1e-5a24738eb7f5 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1691 microversion: 2.1 time: 0.206529 Jul 14 16:13:00.057055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1403/2909] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:12:59 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1691 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:00.558930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-36fadb06-08f5-42c2-90e3-be7a0426cbb7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:00.559545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-36fadb06-08f5-42c2-90e3-be7a0426cbb7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:00.566600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36fadb06-08f5-42c2-90e3-be7a0426cbb7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:00.567051 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36fadb06-08f5-42c2-90e3-be7a0426cbb7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:00.567824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36fadb06-08f5-42c2-90e3-be7a0426cbb7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:00.568266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-36fadb06-08f5-42c2-90e3-be7a0426cbb7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:00.583052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-36fadb06-08f5-42c2-90e3-be7a0426cbb7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] HTTP exception thrown: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-36fadb06-08f5-42c2-90e3-be7a0426cbb7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Request method failure captured: Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 HTTP/1.1 Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgS-4Q10n__x9pLo9H4HyyVCSViURQOHJjOVPtrhou9XF5HwPz8tdwdHMutE7Bp3YVzRzDSx_ATxxriDPQ_5j6YQRyCO9XTdJIwm_O6HQ1GOdd-hHQ30X8JDgFNk7gLQPOc2qGY5R-sCoZL3pqcV8TP-HfAjy1Dyzx5JTWPDZX_edU Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 67ea0d1ef31b495b8dad23f39cedf1bf Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:13:00.584633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:13:00.586669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:13:00.586669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:13:00.586669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 67ea0d1ef31b495b8dad23f39cedf1bf Jul 14 16:13:00.586669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:13:00.586669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-AttachVolumeTestJSON-129772734-project Jul 14 16:13:00.586669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:13:00.586669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:13:00.586669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 46f52ad195a34123982d238ea351172d Jul 14 16:13:00.586669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-AttachVolumeTestJSON-129772734-project Jul 14 16:13:00.586669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:13:00.586669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:13:00.586669 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': 'f3d96a86-d045-44b2-b298-75df12f65c86'} Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:13:00.587895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:13:00.589750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:13:00.591402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-36fadb06-08f5-42c2-90e3-be7a0426cbb7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Returning 404 to user: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:13:00.591402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-36fadb06-08f5-42c2-90e3-be7a0426cbb7 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 404 len: 111 microversion: 2.1 time: 0.031308 Jul 14 16:13:00.592595 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1507/2910] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:00 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:13:00.595335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4a608e3a-a321-4199-9e1c-44f9cfe2cfcd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '.version_select at 0x7f357c05b310>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:00.615013 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4a608e3a-a321-4199-9e1c-44f9cfe2cfcd tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544239903" status: 202 len: 0 microversion: 2.1 time: 0.023355 Jul 14 16:13:00.615538 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1404/2911] 10.222.0.99 () {58 vars in 1220 bytes} [Thu Jul 14 16:13:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1544239903 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:13:00.844146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-d18c1305-f0bc-45fa-83fa-74e3fb7ded3f req-ea92e73e-3b2a-43f6-818c-8fb5f2812635 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4e7b59f-1959-4ed1-ba26-c70f4d9336bb", "name": "network-vif-deleted", "tag": "6d596c25-d79d-4ae5-aad6-5b159dc0f3f0"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:13:00.853785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-d18c1305-f0bc-45fa-83fa-74e3fb7ded3f req-ea92e73e-3b2a-43f6-818c-8fb5f2812635 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:00.854239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-d18c1305-f0bc-45fa-83fa-74e3fb7ded3f req-ea92e73e-3b2a-43f6-818c-8fb5f2812635 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:00.866820 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-d18c1305-f0bc-45fa-83fa-74e3fb7ded3f req-ea92e73e-3b2a-43f6-818c-8fb5f2812635 service nova] Creating event network-vif-deleted:6d596c25-d79d-4ae5-aad6-5b159dc0f3f0 for instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb on hv-cinder-82651 Jul 14 16:13:00.872390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-d18c1305-f0bc-45fa-83fa-74e3fb7ded3f req-ea92e73e-3b2a-43f6-818c-8fb5f2812635 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032652 Jul 14 16:13:00.875962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1508/2912] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:13:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:13:01.075425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6b985683-b6b8-4a22-bab0-359ab1264d29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:01.076243 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6b985683-b6b8-4a22-bab0-359ab1264d29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:01.086825 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b985683-b6b8-4a22-bab0-359ab1264d29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:01.087552 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b985683-b6b8-4a22-bab0-359ab1264d29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:01.088530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b985683-b6b8-4a22-bab0-359ab1264d29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:01.088968 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6b985683-b6b8-4a22-bab0-359ab1264d29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:01.181162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6b985683-b6b8-4a22-bab0-359ab1264d29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:01.190484 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6b985683-b6b8-4a22-bab0-359ab1264d29 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1624 microversion: 2.1 time: 0.119977 Jul 14 16:13:01.191852 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1405/2913] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:01 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1624 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:01.482901 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-820447c2-b62b-4a47-8fc3-fd81ac8dea3c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Action: 'create', calling method: .version_select at 0x7f357c33dca0>, body: {"keypair": {"name": "tempest-keypair-1094861201", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOaolDbuPbs5OuZJAQTPwwCV0TxJwxSyqn7JKXiV0zVSNZesYrEaKbqnYmvoLys/0yvgkZ6uJu9+COLgdnhiQ7tK5LHiPDsLVf9aFcjTp7T8+qD8nPr74hQ610W8F83Bhg=="}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:13:01.498738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-820447c2-b62b-4a47-8fc3-fd81ac8dea3c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Getting quotas for project 67ea0d1ef31b495b8dad23f39cedf1bf. Resources: {'key_pairs'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:13:01.502589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-820447c2-b62b-4a47-8fc3-fd81ac8dea3c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Getting quotas for user 46f52ad195a34123982d238ea351172d and project 67ea0d1ef31b495b8dad23f39cedf1bf. Resources: {'key_pairs'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:13:01.526872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-820447c2-b62b-4a47-8fc3-fd81ac8dea3c tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.048131 Jul 14 16:13:01.527481 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1509/2914] 10.222.0.99 () {60 vars in 1158 bytes} [Thu Jul 14 16:13:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:13:02.208523 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9f74659b-5926-42e8-86c7-0b1f68da7704 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:02.209148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9f74659b-5926-42e8-86c7-0b1f68da7704 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:02.216308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f74659b-5926-42e8-86c7-0b1f68da7704 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:02.216768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f74659b-5926-42e8-86c7-0b1f68da7704 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:02.217551 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f74659b-5926-42e8-86c7-0b1f68da7704 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:02.217997 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9f74659b-5926-42e8-86c7-0b1f68da7704 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:02.293383 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9f74659b-5926-42e8-86c7-0b1f68da7704 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:02.302520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9f74659b-5926-42e8-86c7-0b1f68da7704 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1624 microversion: 2.1 time: 0.098283 Jul 14 16:13:02.303106 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1406/2915] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:02 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1624 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:02.900015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-867283444", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2c48309c-ba99-490f-9743-fd4ada15ac8c"}], "security_groups": [{"name": "tempest-securitygroup--351356295"}], "key_name": "tempest-keypair-1094861201", "user_data": "}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:13:03.008518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.network.neutron [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] validate_networks() for [('2c48309c-ba99-490f-9743-fd4ada15ac8c', None, None, None, None, None)] {{(pid=124503) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:13:03.205465 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=69,nova_api:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:03.320539 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-a18af6f5-b619-49d0-bc76-880f75e875df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:03.321341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-a18af6f5-b619-49d0-bc76-880f75e875df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:03.327845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a18af6f5-b619-49d0-bc76-880f75e875df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:03.328310 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a18af6f5-b619-49d0-bc76-880f75e875df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:03.329132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a18af6f5-b619-49d0-bc76-880f75e875df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:03.329581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a18af6f5-b619-49d0-bc76-880f75e875df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:03.348568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=100 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:03.363756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a18af6f5-b619-49d0-bc76-880f75e875df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:03.363985 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-a18af6f5-b619-49d0-bc76-880f75e875df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:03.364332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-a18af6f5-b619-49d0-bc76-880f75e875df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'fault' on Instance uuid d4e7b59f-1959-4ed1-ba26-c70f4d9336bb {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:13:03.406608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-a18af6f5-b619-49d0-bc76-880f75e875df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:03.415238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-a18af6f5-b619-49d0-bc76-880f75e875df tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 200 len: 1336 microversion: 2.1 time: 0.099047 Jul 14 16:13:03.415840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1407/2916] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:03 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 1336 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:13:03.465487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Flavor limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:13:03.465916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Image limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:13:03.466428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Flavor pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:13:03.466842 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Image pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:13:03.467259 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:13:03.476745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:03.477200 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:03.477998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:03.478436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:03.495888 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Getting quotas for project 67ea0d1ef31b495b8dad23f39cedf1bf. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:13:03.499876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Getting quotas for user 46f52ad195a34123982d238ea351172d and project 67ea0d1ef31b495b8dad23f39cedf1bf. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:13:03.512147 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Going to run 1 instances... {{(pid=124503) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:13:03.514602 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124503) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:13:03.563097 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR oslo.messaging._drivers.impl_rabbit [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [a106d16d-5ed9-4cde-b8fd-f76cf0bf54cd] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 16:13:04.433679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3e8669e7-8dd1-42e8-9a9a-214d4b2fee98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:04.434273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3e8669e7-8dd1-42e8-9a9a-214d4b2fee98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: d4e7b59f-1959-4ed1-ba26-c70f4d9336bb] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:04.440854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e8669e7-8dd1-42e8-9a9a-214d4b2fee98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:04.441313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e8669e7-8dd1-42e8-9a9a-214d4b2fee98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:04.442079 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e8669e7-8dd1-42e8-9a9a-214d4b2fee98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:04.442524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3e8669e7-8dd1-42e8-9a9a-214d4b2fee98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:04.461664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-3e8669e7-8dd1-42e8-9a9a-214d4b2fee98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb could not be found. Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3e8669e7-8dd1-42e8-9a9a-214d4b2fee98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb HTTP/1.1 Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:13:04.464686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:13:04.466709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:13:04.466709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:13:04.466709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 16:13:04.466709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:13:04.466709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 16:13:04.466709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:13:04.466709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:13:04.466709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 16:13:04.466709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 16:13:04.466709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:13:04.466709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb could not be found. Jul 14 16:13:04.466709 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'd4e7b59f-1959-4ed1-ba26-c70f4d9336bb'} Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb could not be found. Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:13:04.467793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb could not be found. Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb could not be found. Jul 14 16:13:04.469436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:04.471123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3e8669e7-8dd1-42e8-9a9a-214d4b2fee98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 404 to user: Instance d4e7b59f-1959-4ed1-ba26-c70f4d9336bb could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:13:04.471123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3e8669e7-8dd1-42e8-9a9a-214d4b2fee98 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb" status: 404 len: 111 microversion: 2.1 time: 0.037162 Jul 14 16:13:04.471123 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1408/2917] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:04 2022] GET /compute/v2.1/servers/d4e7b59f-1959-4ed1-ba26-c70f4d9336bb => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:13:04.478278 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6a40a801-2d6d-4fd1-8635-868e0d98e134 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '.version_select at 0x7f357fdafb80>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:04.496402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6a40a801-2d6d-4fd1-8635-868e0d98e134 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068264139" status: 202 len: 0 microversion: 2.1 time: 0.022832 Jul 14 16:13:04.496901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1409/2918] 10.222.0.99 () {58 vars in 1220 bytes} [Thu Jul 14 16:13:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-2068264139 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:13:04.570252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [a106d16d-5ed9-4cde-b8fd-f76cf0bf54cd] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 46924. Jul 14 16:13:04.576237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-eadefa52-b254-46ca-9988-2a8e7e63adb9 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.681077 Jul 14 16:13:04.577287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1510/2919] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 16:13:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 1683 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:13:04.587535 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7a0d8b93-f080-4bfb-9846-a63306c2d984 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:04.588195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7a0d8b93-f080-4bfb-9846-a63306c2d984 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:04.679730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7a0d8b93-f080-4bfb-9846-a63306c2d984 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:04.697240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7a0d8b93-f080-4bfb-9846-a63306c2d984 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1237 microversion: 2.1 time: 0.113526 Jul 14 16:13:04.708024 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1410/2920] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:04 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1237 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:05.319957 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-83968a37-43f5-4f83-afbd-658252276a53 req-c90fba8f-6efa-4ee4-8dd8-d8c85766e73f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "58c05da0-6e6d-422a-b119-197a7a41a2b9", "name": "network-vif-deleted", "tag": "48e0854c-0f5f-413b-9fa6-152194242978"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:13:05.334569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-83968a37-43f5-4f83-afbd-658252276a53 req-c90fba8f-6efa-4ee4-8dd8-d8c85766e73f service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:05.335812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-83968a37-43f5-4f83-afbd-658252276a53 req-c90fba8f-6efa-4ee4-8dd8-d8c85766e73f service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:05.381390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-83968a37-43f5-4f83-afbd-658252276a53 req-c90fba8f-6efa-4ee4-8dd8-d8c85766e73f service nova] Creating event network-vif-deleted:48e0854c-0f5f-413b-9fa6-152194242978 for instance 58c05da0-6e6d-422a-b119-197a7a41a2b9 on hv-cinder-82651 Jul 14 16:13:05.392139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-83968a37-43f5-4f83-afbd-658252276a53 req-c90fba8f-6efa-4ee4-8dd8-d8c85766e73f service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077215 Jul 14 16:13:05.393067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1511/2921] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:13:05.715073 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f7946090-edc9-4c01-a6f5-c56511f9a41e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:05.716220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f7946090-edc9-4c01-a6f5-c56511f9a41e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:05.723533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7946090-edc9-4c01-a6f5-c56511f9a41e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:05.724113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7946090-edc9-4c01-a6f5-c56511f9a41e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:05.725143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7946090-edc9-4c01-a6f5-c56511f9a41e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:05.725590 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f7946090-edc9-4c01-a6f5-c56511f9a41e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:05.802482 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f7946090-edc9-4c01-a6f5-c56511f9a41e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:05.810238 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f7946090-edc9-4c01-a6f5-c56511f9a41e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1289 microversion: 2.1 time: 0.099302 Jul 14 16:13:05.810743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1411/2922] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:05 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1289 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:13:06.832754 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-92bbfc68-e386-48b8-917e-8aca162db672 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:06.834148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-92bbfc68-e386-48b8-917e-8aca162db672 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:06.843166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-92bbfc68-e386-48b8-917e-8aca162db672 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:06.844015 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-92bbfc68-e386-48b8-917e-8aca162db672 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:06.844934 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-92bbfc68-e386-48b8-917e-8aca162db672 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:06.845548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-92bbfc68-e386-48b8-917e-8aca162db672 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:07.083969 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-92bbfc68-e386-48b8-917e-8aca162db672 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:07.092238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-92bbfc68-e386-48b8-917e-8aca162db672 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1362 microversion: 2.1 time: 0.265155 Jul 14 16:13:07.092827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1512/2923] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:06 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1362 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:07.625345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7178593f-8eb2-481b-a7ff-a24aed5e424e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:07.625996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7178593f-8eb2-481b-a7ff-a24aed5e424e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:07.633619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7178593f-8eb2-481b-a7ff-a24aed5e424e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:07.634145 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7178593f-8eb2-481b-a7ff-a24aed5e424e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:07.634978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7178593f-8eb2-481b-a7ff-a24aed5e424e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:07.635502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7178593f-8eb2-481b-a7ff-a24aed5e424e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:07.661821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7178593f-8eb2-481b-a7ff-a24aed5e424e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:13:07.699052 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-1e43ab97-ef70-4216-9643-9da3b4c22b51 req-38aba046-cfc4-4881-92bd-67e9d5e2a505 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb6e886-c18e-465b-ba45-b172d1639d11", "tag": "4e421601-a8d5-48ee-b1d7-7b9bf1f0d7cd"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:13:07.708899 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-1e43ab97-ef70-4216-9643-9da3b4c22b51 req-38aba046-cfc4-4881-92bd-67e9d5e2a505 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:07.709520 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-1e43ab97-ef70-4216-9643-9da3b4c22b51 req-38aba046-cfc4-4881-92bd-67e9d5e2a505 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:07.729002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-1e43ab97-ef70-4216-9643-9da3b4c22b51 req-38aba046-cfc4-4881-92bd-67e9d5e2a505 service nova] Creating event network-changed:4e421601-a8d5-48ee-b1d7-7b9bf1f0d7cd for instance 2bb6e886-c18e-465b-ba45-b172d1639d11 on hv-cinder-82651 Jul 14 16:13:07.734072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-1e43ab97-ef70-4216-9643-9da3b4c22b51 req-38aba046-cfc4-4881-92bd-67e9d5e2a505 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039086 Jul 14 16:13:07.734708 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1513/2924] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:13:07.782253 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7178593f-8eb2-481b-a7ff-a24aed5e424e tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 204 len: 0 microversion: 2.1 time: 0.160378 Jul 14 16:13:07.782953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1412/2925] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:13:07 2022] DELETE /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:13:07.793065 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-18542d0a-197f-4607-861e-b3eb6115ce24 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:07.793846 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-18542d0a-197f-4607-861e-b3eb6115ce24 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:07.800563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-18542d0a-197f-4607-861e-b3eb6115ce24 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:07.801130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-18542d0a-197f-4607-861e-b3eb6115ce24 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:07.801898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-18542d0a-197f-4607-861e-b3eb6115ce24 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:07.802330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-18542d0a-197f-4607-861e-b3eb6115ce24 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:08.011020 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-18542d0a-197f-4607-861e-b3eb6115ce24 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:08.019803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-18542d0a-197f-4607-861e-b3eb6115ce24 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1508 microversion: 2.1 time: 0.231633 Jul 14 16:13:08.020368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1514/2926] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:07 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1508 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:08.111551 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-388c73bb-2a1d-47c4-9906-84ff0bb28d92 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:08.112764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-388c73bb-2a1d-47c4-9906-84ff0bb28d92 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:08.121163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-388c73bb-2a1d-47c4-9906-84ff0bb28d92 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:08.121611 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-388c73bb-2a1d-47c4-9906-84ff0bb28d92 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:08.122371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-388c73bb-2a1d-47c4-9906-84ff0bb28d92 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:08.122802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-388c73bb-2a1d-47c4-9906-84ff0bb28d92 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:08.310052 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-388c73bb-2a1d-47c4-9906-84ff0bb28d92 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:08.318274 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-388c73bb-2a1d-47c4-9906-84ff0bb28d92 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1362 microversion: 2.1 time: 0.211046 Jul 14 16:13:08.319029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1413/2927] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:08 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:09.037824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-972dc696-4113-4fc1-992c-d04564dac476 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:09.038470 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-972dc696-4113-4fc1-992c-d04564dac476 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:09.045346 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-972dc696-4113-4fc1-992c-d04564dac476 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:09.045796 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-972dc696-4113-4fc1-992c-d04564dac476 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:09.046550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-972dc696-4113-4fc1-992c-d04564dac476 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:09.046998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-972dc696-4113-4fc1-992c-d04564dac476 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:09.174050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-972dc696-4113-4fc1-992c-d04564dac476 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:09.181589 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-972dc696-4113-4fc1-992c-d04564dac476 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1508 microversion: 2.1 time: 0.148435 Jul 14 16:13:09.182148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1515/2928] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:09 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1508 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:09.334821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5b0b7a58-68fc-4449-b091-726ee1782f4f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:09.335454 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5b0b7a58-68fc-4449-b091-726ee1782f4f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:09.341713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b0b7a58-68fc-4449-b091-726ee1782f4f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:09.342166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b0b7a58-68fc-4449-b091-726ee1782f4f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:09.342929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b0b7a58-68fc-4449-b091-726ee1782f4f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:09.343367 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b0b7a58-68fc-4449-b091-726ee1782f4f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:09.478989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5b0b7a58-68fc-4449-b091-726ee1782f4f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:09.488045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5b0b7a58-68fc-4449-b091-726ee1782f4f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1362 microversion: 2.1 time: 0.156950 Jul 14 16:13:09.488638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1414/2929] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:09 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:10.199193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0b051ce1-4557-4adf-9dcb-0fc705844781 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:10.199825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0b051ce1-4557-4adf-9dcb-0fc705844781 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:10.206987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b051ce1-4557-4adf-9dcb-0fc705844781 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:10.207425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b051ce1-4557-4adf-9dcb-0fc705844781 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:10.208200 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b051ce1-4557-4adf-9dcb-0fc705844781 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:10.208662 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0b051ce1-4557-4adf-9dcb-0fc705844781 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:10.352764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0b051ce1-4557-4adf-9dcb-0fc705844781 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:10.360239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0b051ce1-4557-4adf-9dcb-0fc705844781 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1508 microversion: 2.1 time: 0.164917 Jul 14 16:13:10.361148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1516/2930] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:10 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:10.508712 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f1df37d1-6dc0-484e-a683-53983d0b187d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:10.509265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f1df37d1-6dc0-484e-a683-53983d0b187d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:10.515708 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1df37d1-6dc0-484e-a683-53983d0b187d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:10.516170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1df37d1-6dc0-484e-a683-53983d0b187d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:10.516930 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1df37d1-6dc0-484e-a683-53983d0b187d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:10.517367 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f1df37d1-6dc0-484e-a683-53983d0b187d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:10.655405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f1df37d1-6dc0-484e-a683-53983d0b187d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:10.663740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f1df37d1-6dc0-484e-a683-53983d0b187d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1362 microversion: 2.1 time: 0.158950 Jul 14 16:13:10.664304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1415/2931] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:10 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1362 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:11.378435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dcb3730d-5ab0-42e0-9963-12aa81a0faff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:11.379108 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dcb3730d-5ab0-42e0-9963-12aa81a0faff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:11.391117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dcb3730d-5ab0-42e0-9963-12aa81a0faff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:11.391569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dcb3730d-5ab0-42e0-9963-12aa81a0faff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:11.392361 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dcb3730d-5ab0-42e0-9963-12aa81a0faff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:11.392797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dcb3730d-5ab0-42e0-9963-12aa81a0faff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:11.526284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-6a80846f-ed4d-4e86-a6fe-0f8461a9f79e req-bc8ff96d-372c-4dc1-9708-4f77b3486611 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3264933c-e17b-494c-8d12-86fd9c3ad82d", "name": "network-vif-unplugged", "status": "completed", "tag": "66177828-49fe-493d-8421-513610bbef0f"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:13:11.534890 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-6a80846f-ed4d-4e86-a6fe-0f8461a9f79e req-bc8ff96d-372c-4dc1-9708-4f77b3486611 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:11.535582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-dcb3730d-5ab0-42e0-9963-12aa81a0faff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:11.535854 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-6a80846f-ed4d-4e86-a6fe-0f8461a9f79e req-bc8ff96d-372c-4dc1-9708-4f77b3486611 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:11.543793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dcb3730d-5ab0-42e0-9963-12aa81a0faff tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1508 microversion: 2.1 time: 0.169767 Jul 14 16:13:11.544718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1517/2932] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:11 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:11.548282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-6a80846f-ed4d-4e86-a6fe-0f8461a9f79e req-bc8ff96d-372c-4dc1-9708-4f77b3486611 service nova] Creating event network-vif-unplugged:66177828-49fe-493d-8421-513610bbef0f for instance 3264933c-e17b-494c-8d12-86fd9c3ad82d on hv-cinder-82651 Jul 14 16:13:11.554212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-6a80846f-ed4d-4e86-a6fe-0f8461a9f79e req-bc8ff96d-372c-4dc1-9708-4f77b3486611 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032306 Jul 14 16:13:11.555056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1416/2933] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:13:11.682389 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0cdc8fdb-4c41-46e6-92ff-7b46226f4f40 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:11.683047 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0cdc8fdb-4c41-46e6-92ff-7b46226f4f40 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:11.689995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0cdc8fdb-4c41-46e6-92ff-7b46226f4f40 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:11.690477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0cdc8fdb-4c41-46e6-92ff-7b46226f4f40 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:11.691238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0cdc8fdb-4c41-46e6-92ff-7b46226f4f40 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:11.691722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0cdc8fdb-4c41-46e6-92ff-7b46226f4f40 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:11.827512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0cdc8fdb-4c41-46e6-92ff-7b46226f4f40 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:11.836238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0cdc8fdb-4c41-46e6-92ff-7b46226f4f40 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1362 microversion: 2.1 time: 0.158185 Jul 14 16:13:11.836807 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1518/2934] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:11 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1362 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:12.562978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f9056cf0-f775-4a8a-9150-68f61de693b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:12.563956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-f9056cf0-f775-4a8a-9150-68f61de693b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:12.574990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9056cf0-f775-4a8a-9150-68f61de693b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:12.576494 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9056cf0-f775-4a8a-9150-68f61de693b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:12.578782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9056cf0-f775-4a8a-9150-68f61de693b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:12.579467 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-f9056cf0-f775-4a8a-9150-68f61de693b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:12.776919 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-d82f2057-8a55-4e47-9064-ca6a82037b68 req-383230be-5ac6-487c-ac8a-f3daf0ef1cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3264933c-e17b-494c-8d12-86fd9c3ad82d", "name": "network-vif-deleted", "tag": "66177828-49fe-493d-8421-513610bbef0f"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:13:12.793216 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-d82f2057-8a55-4e47-9064-ca6a82037b68 req-383230be-5ac6-487c-ac8a-f3daf0ef1cff service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:12.793768 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-d82f2057-8a55-4e47-9064-ca6a82037b68 req-383230be-5ac6-487c-ac8a-f3daf0ef1cff service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:12.819710 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-d82f2057-8a55-4e47-9064-ca6a82037b68 req-383230be-5ac6-487c-ac8a-f3daf0ef1cff service nova] Creating event network-vif-deleted:66177828-49fe-493d-8421-513610bbef0f for instance 3264933c-e17b-494c-8d12-86fd9c3ad82d on hv-cinder-82651 Jul 14 16:13:12.828136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-d82f2057-8a55-4e47-9064-ca6a82037b68 req-383230be-5ac6-487c-ac8a-f3daf0ef1cff service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056075 Jul 14 16:13:12.829414 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1519/2935] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:13:12.854169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ba7b5879-9782-4ddb-8b33-10a008e2a9c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:12.854877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ba7b5879-9782-4ddb-8b33-10a008e2a9c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:12.872284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba7b5879-9782-4ddb-8b33-10a008e2a9c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:12.872827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba7b5879-9782-4ddb-8b33-10a008e2a9c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:12.873609 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba7b5879-9782-4ddb-8b33-10a008e2a9c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:12.874996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba7b5879-9782-4ddb-8b33-10a008e2a9c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:12.911929 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=100 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:12.917616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-f9056cf0-f775-4a8a-9150-68f61de693b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:12.933618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f9056cf0-f775-4a8a-9150-68f61de693b3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 200 len: 1508 microversion: 2.1 time: 0.374838 Jul 14 16:13:12.934369 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1417/2936] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:12 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 1508 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:13:13.044345 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ba7b5879-9782-4ddb-8b33-10a008e2a9c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:13.056731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ba7b5879-9782-4ddb-8b33-10a008e2a9c6 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1362 microversion: 2.1 time: 0.206881 Jul 14 16:13:13.057679 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1520/2937] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:12 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1362 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:13.953857 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-830da1ee-7d38-4979-9646-fdb28fa576e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:13.954752 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-830da1ee-7d38-4979-9646-fdb28fa576e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 3264933c-e17b-494c-8d12-86fd9c3ad82d] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:13.961388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-830da1ee-7d38-4979-9646-fdb28fa576e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:13.961945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-830da1ee-7d38-4979-9646-fdb28fa576e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:13.962588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-830da1ee-7d38-4979-9646-fdb28fa576e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:13.963096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-830da1ee-7d38-4979-9646-fdb28fa576e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:13.977413 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-830da1ee-7d38-4979-9646-fdb28fa576e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Instance 3264933c-e17b-494c-8d12-86fd9c3ad82d could not be found. Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-830da1ee-7d38-4979-9646-fdb28fa576e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d HTTP/1.1 Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:13:13.979083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:13:13.981043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:13:13.981043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:13:13.981043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 16:13:13.981043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:13:13.981043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 16:13:13.981043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:13:13.981043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:13:13.981043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 16:13:13.981043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 16:13:13.981043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:13:13.981043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 3264933c-e17b-494c-8d12-86fd9c3ad82d could not be found. Jul 14 16:13:13.981043 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '3264933c-e17b-494c-8d12-86fd9c3ad82d'} Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3264933c-e17b-494c-8d12-86fd9c3ad82d could not be found. Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:13:13.982163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3264933c-e17b-494c-8d12-86fd9c3ad82d could not be found. Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3264933c-e17b-494c-8d12-86fd9c3ad82d could not be found. Jul 14 16:13:13.983577 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:13.985252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-830da1ee-7d38-4979-9646-fdb28fa576e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 404 to user: Instance 3264933c-e17b-494c-8d12-86fd9c3ad82d could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:13:13.985252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-830da1ee-7d38-4979-9646-fdb28fa576e1 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d" status: 404 len: 111 microversion: 2.1 time: 0.030585 Jul 14 16:13:13.985252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1418/2938] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:13 2022] GET /compute/v2.1/servers/3264933c-e17b-494c-8d12-86fd9c3ad82d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:13:13.991124 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3347af6e-4be1-48a6-9237-c7762acf6da7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:13.991740 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3347af6e-4be1-48a6-9237-c7762acf6da7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:13.995829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:13.996594 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=10 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:14.002534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3347af6e-4be1-48a6-9237-c7762acf6da7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:14.003092 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3347af6e-4be1-48a6-9237-c7762acf6da7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:14.004035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3347af6e-4be1-48a6-9237-c7762acf6da7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:14.004516 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3347af6e-4be1-48a6-9237-c7762acf6da7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:14.034596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3347af6e-4be1-48a6-9237-c7762acf6da7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Going to try to terminate instance {{(pid=124503) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:13:14.077197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-78fa574a-9760-47d6-8514-6f04f64e0b90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:14.077721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-78fa574a-9760-47d6-8514-6f04f64e0b90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:14.084464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78fa574a-9760-47d6-8514-6f04f64e0b90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:14.084911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78fa574a-9760-47d6-8514-6f04f64e0b90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:14.085661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78fa574a-9760-47d6-8514-6f04f64e0b90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:14.086097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-78fa574a-9760-47d6-8514-6f04f64e0b90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:14.116804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3347af6e-4be1-48a6-9237-c7762acf6da7 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "DELETE /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 204 len: 0 microversion: 2.1 time: 0.130805 Jul 14 16:13:14.117756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1521/2939] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:13:13 2022] DELETE /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:13:14.126679 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ba773a0c-0672-43ac-947b-75e85b325c6d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:14.127383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ba773a0c-0672-43ac-947b-75e85b325c6d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:14.133416 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba773a0c-0672-43ac-947b-75e85b325c6d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:14.133867 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba773a0c-0672-43ac-947b-75e85b325c6d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:14.134634 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba773a0c-0672-43ac-947b-75e85b325c6d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:14.135070 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ba773a0c-0672-43ac-947b-75e85b325c6d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:14.244832 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-78fa574a-9760-47d6-8514-6f04f64e0b90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:14.252672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-78fa574a-9760-47d6-8514-6f04f64e0b90 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1362 microversion: 2.1 time: 0.180822 Jul 14 16:13:14.253998 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1419/2940] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:14 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1362 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:13:14.281766 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ba773a0c-0672-43ac-947b-75e85b325c6d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:14.290454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ba773a0c-0672-43ac-947b-75e85b325c6d tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1522 microversion: 2.1 time: 0.167924 Jul 14 16:13:14.291183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1522/2941] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:14 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1522 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:15.244806 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:15.271206 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6046150e-67bc-45c4-ae7f-f216854f9579 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:15.271870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6046150e-67bc-45c4-ae7f-f216854f9579 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:15.281558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6046150e-67bc-45c4-ae7f-f216854f9579 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:15.282028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6046150e-67bc-45c4-ae7f-f216854f9579 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:15.282776 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6046150e-67bc-45c4-ae7f-f216854f9579 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:15.283270 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6046150e-67bc-45c4-ae7f-f216854f9579 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:15.309844 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-b7ddbdbc-d7ce-4eef-aa31-18621a5ae429 req-d7eec4e6-5ce3-45f1-9171-8f438b92856e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "15c97816-6d05-424a-832a-48500a73d87f", "name": "network-vif-deleted", "tag": "ef1ba542-f905-48ed-ae96-28d22e39407f"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:13:15.318325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-b7ddbdbc-d7ce-4eef-aa31-18621a5ae429 req-d7eec4e6-5ce3-45f1-9171-8f438b92856e service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:15.319036 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-b7ddbdbc-d7ce-4eef-aa31-18621a5ae429 req-d7eec4e6-5ce3-45f1-9171-8f438b92856e service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:15.332047 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-b7ddbdbc-d7ce-4eef-aa31-18621a5ae429 req-d7eec4e6-5ce3-45f1-9171-8f438b92856e service nova] Creating event network-vif-deleted:ef1ba542-f905-48ed-ae96-28d22e39407f for instance 15c97816-6d05-424a-832a-48500a73d87f on hv-cinder-82651 Jul 14 16:13:15.337115 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-b7ddbdbc-d7ce-4eef-aa31-18621a5ae429 req-d7eec4e6-5ce3-45f1-9171-8f438b92856e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098713 Jul 14 16:13:15.338006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1420/2942] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:13:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:13:15.344608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-81e90140-124e-4c03-bf24-312310ba7ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:15.346216 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-81e90140-124e-4c03-bf24-312310ba7ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:15.355672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81e90140-124e-4c03-bf24-312310ba7ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:15.356228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81e90140-124e-4c03-bf24-312310ba7ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:15.357427 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81e90140-124e-4c03-bf24-312310ba7ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:15.357935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81e90140-124e-4c03-bf24-312310ba7ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:15.393379 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81e90140-124e-4c03-bf24-312310ba7ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:15.393865 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81e90140-124e-4c03-bf24-312310ba7ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:15.394399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-81e90140-124e-4c03-bf24-312310ba7ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lazy-loading 'fault' on Instance uuid 15c97816-6d05-424a-832a-48500a73d87f {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:13:15.446053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-81e90140-124e-4c03-bf24-312310ba7ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd01c301ea20d4acab8dff1148501a975', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2a542b3ba16943a4ab7d2624d961b4a5', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:15.453388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6046150e-67bc-45c4-ae7f-f216854f9579 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:15.454510 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-81e90140-124e-4c03-bf24-312310ba7ea3 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 200 len: 1312 microversion: 2.1 time: 0.115082 Jul 14 16:13:15.455511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1421/2943] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:15 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 1312 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:15.465473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6046150e-67bc-45c4-ae7f-f216854f9579 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1362 microversion: 2.1 time: 0.198895 Jul 14 16:13:15.466035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1523/2944] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:15 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1362 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:16.471412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bcc8df4b-353f-490a-b594-438a9543bc88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:16.472002 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bcc8df4b-353f-490a-b594-438a9543bc88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] [instance: 15c97816-6d05-424a-832a-48500a73d87f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:16.474816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=75,nova_api:DELETE=2,nova_api:UPDATE=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:13:16.480945 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bcc8df4b-353f-490a-b594-438a9543bc88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:16.481402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bcc8df4b-353f-490a-b594-438a9543bc88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:16.482179 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bcc8df4b-353f-490a-b594-438a9543bc88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:16.482321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-695fe503-f802-4205-8b38-caec229a53f1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:16.482763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bcc8df4b-353f-490a-b594-438a9543bc88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:16.482921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-695fe503-f802-4205-8b38-caec229a53f1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:16.490210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-695fe503-f802-4205-8b38-caec229a53f1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:16.490906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-695fe503-f802-4205-8b38-caec229a53f1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:16.491703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-695fe503-f802-4205-8b38-caec229a53f1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:16.492186 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-695fe503-f802-4205-8b38-caec229a53f1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:16.498612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-bcc8df4b-353f-490a-b594-438a9543bc88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] HTTP exception thrown: Instance 15c97816-6d05-424a-832a-48500a73d87f could not be found. Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bcc8df4b-353f-490a-b594-438a9543bc88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Request method failure captured: Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f HTTP/1.1 Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgLQWftRuYnt5-r92_NtpPHivFWw8MjXjKXrRIGvcYuUAzNcJJ5m_M7TgDOa2v_ECV1mR8o1dIov7FWPHXNzcGrBN38ykPxHi_NXP6fG4T5rwKSQ7hqEgIzQ_kwqfduAaOaTJ5tP-8WoIC0gsOMJrS5JkvVpNFD6BjQbf3f-jnq7w0 Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:13:16.500347 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:13:16.502357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/2a542b3ba16943a4ab7d2624d961b4a5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:13:16.502357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:13:16.502357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 2a542b3ba16943a4ab7d2624d961b4a5 Jul 14 16:13:16.502357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1944728338 Jul 14 16:13:16.502357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 16:13:16.502357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:13:16.502357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:13:16.502357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: d01c301ea20d4acab8dff1148501a975 Jul 14 16:13:16.502357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1944728338-project Jul 14 16:13:16.502357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:13:16.502357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 15c97816-6d05-424a-832a-48500a73d87f could not be found. Jul 14 16:13:16.502357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '15c97816-6d05-424a-832a-48500a73d87f'} Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 15c97816-6d05-424a-832a-48500a73d87f could not be found. Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:13:16.503550 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 15c97816-6d05-424a-832a-48500a73d87f could not be found. Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 15c97816-6d05-424a-832a-48500a73d87f could not be found. Jul 14 16:13:16.507390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:13:16.509474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bcc8df4b-353f-490a-b594-438a9543bc88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] Returning 404 to user: Instance 15c97816-6d05-424a-832a-48500a73d87f could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:13:16.509474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bcc8df4b-353f-490a-b594-438a9543bc88 tempest-ServerRescueNegativeTestJSON-1944728338 tempest-ServerRescueNegativeTestJSON-1944728338-project] 10.222.0.99 "GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f" status: 404 len: 111 microversion: 2.1 time: 0.034361 Jul 14 16:13:16.509474 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1422/2945] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:16 2022] GET /compute/v2.1/servers/15c97816-6d05-424a-832a-48500a73d87f => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:13:16.636755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-695fe503-f802-4205-8b38-caec229a53f1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:16.644268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-695fe503-f802-4205-8b38-caec229a53f1 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1362 microversion: 2.1 time: 0.165807 Jul 14 16:13:16.644898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1524/2946] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:16 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1362 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:13:17.664470 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5e030755-e20b-41d4-9249-9ea87cb9e29a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:17.665098 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5e030755-e20b-41d4-9249-9ea87cb9e29a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:17.670924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-f6a085b5-dd04-46d6-8262-e082c9a6d2fa req-a8ecff6e-2da9-4f94-a4b0-36b93aca5c32 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb6e886-c18e-465b-ba45-b172d1639d11", "name": "network-vif-plugged", "status": "completed", "tag": "4e421601-a8d5-48ee-b1d7-7b9bf1f0d7cd"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:13:17.679832 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5e030755-e20b-41d4-9249-9ea87cb9e29a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:17.680415 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5e030755-e20b-41d4-9249-9ea87cb9e29a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:17.681252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5e030755-e20b-41d4-9249-9ea87cb9e29a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:17.681701 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5e030755-e20b-41d4-9249-9ea87cb9e29a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:17.687626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-f6a085b5-dd04-46d6-8262-e082c9a6d2fa req-a8ecff6e-2da9-4f94-a4b0-36b93aca5c32 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:17.688883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-f6a085b5-dd04-46d6-8262-e082c9a6d2fa req-a8ecff6e-2da9-4f94-a4b0-36b93aca5c32 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:17.718137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-f6a085b5-dd04-46d6-8262-e082c9a6d2fa req-a8ecff6e-2da9-4f94-a4b0-36b93aca5c32 service nova] Creating event network-vif-plugged:4e421601-a8d5-48ee-b1d7-7b9bf1f0d7cd for instance 2bb6e886-c18e-465b-ba45-b172d1639d11 on hv-cinder-82651 Jul 14 16:13:17.726920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-f6a085b5-dd04-46d6-8262-e082c9a6d2fa req-a8ecff6e-2da9-4f94-a4b0-36b93aca5c32 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062411 Jul 14 16:13:17.727857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1525/2947] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:13:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:13:18.015342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5e030755-e20b-41d4-9249-9ea87cb9e29a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:18.023228 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5e030755-e20b-41d4-9249-9ea87cb9e29a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1362 microversion: 2.1 time: 0.364163 Jul 14 16:13:18.024195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1423/2948] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:17 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:19.043061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5e29508c-c287-47d2-b73d-2f09ea26a5bf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:19.044230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5e29508c-c287-47d2-b73d-2f09ea26a5bf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:19.054058 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5e29508c-c287-47d2-b73d-2f09ea26a5bf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:19.054721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5e29508c-c287-47d2-b73d-2f09ea26a5bf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:19.055906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5e29508c-c287-47d2-b73d-2f09ea26a5bf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:19.056558 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5e29508c-c287-47d2-b73d-2f09ea26a5bf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:19.230439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-5e29508c-c287-47d2-b73d-2f09ea26a5bf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:19.242957 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5e29508c-c287-47d2-b73d-2f09ea26a5bf tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1362 microversion: 2.1 time: 0.206312 Jul 14 16:13:19.248854 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1526/2949] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:19 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1362 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:20.270320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7a597b65-f84b-4de8-932b-5a0e6bdc8d2d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:20.271569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7a597b65-f84b-4de8-932b-5a0e6bdc8d2d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:20.282677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a597b65-f84b-4de8-932b-5a0e6bdc8d2d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:20.283454 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a597b65-f84b-4de8-932b-5a0e6bdc8d2d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:20.284765 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a597b65-f84b-4de8-932b-5a0e6bdc8d2d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:20.285343 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7a597b65-f84b-4de8-932b-5a0e6bdc8d2d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:20.446498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7a597b65-f84b-4de8-932b-5a0e6bdc8d2d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:13:20.456707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7a597b65-f84b-4de8-932b-5a0e6bdc8d2d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1547 microversion: 2.1 time: 0.192621 Jul 14 16:13:20.458273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1424/2950] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:13:20 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1547 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:13:20.474168 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b36d61a9-47be-4a4d-9919-c4fc3e481907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:13:20.474678 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b36d61a9-47be-4a4d-9919-c4fc3e481907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:13:20.483399 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b36d61a9-47be-4a4d-9919-c4fc3e481907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:20.483912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b36d61a9-47be-4a4d-9919-c4fc3e481907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:20.484687 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b36d61a9-47be-4a4d-9919-c4fc3e481907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:20.486685 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b36d61a9-47be-4a4d-9919-c4fc3e481907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:20.584707 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b36d61a9-47be-4a4d-9919-c4fc3e481907 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.114465 Jul 14 16:13:20.594727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1527/2951] 10.222.0.99 () {58 vars in 1274 bytes} [Thu Jul 14 16:13:20 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-interface => generated 284 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:13:21.926236 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-776799ea-3b41-4b03-815c-d1c1c2e2751b req-af920249-da7b-4766-a020-ba3407495379 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2bb6e886-c18e-465b-ba45-b172d1639d11", "tag": "4e421601-a8d5-48ee-b1d7-7b9bf1f0d7cd"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:13:21.939797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-776799ea-3b41-4b03-815c-d1c1c2e2751b req-af920249-da7b-4766-a020-ba3407495379 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:13:21.940679 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-776799ea-3b41-4b03-815c-d1c1c2e2751b req-af920249-da7b-4766-a020-ba3407495379 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:13:21.954108 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-776799ea-3b41-4b03-815c-d1c1c2e2751b req-af920249-da7b-4766-a020-ba3407495379 service nova] Creating event network-changed:4e421601-a8d5-48ee-b1d7-7b9bf1f0d7cd for instance 2bb6e886-c18e-465b-ba45-b172d1639d11 on hv-cinder-82651 Jul 14 16:13:21.961019 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-776799ea-3b41-4b03-815c-d1c1c2e2751b req-af920249-da7b-4766-a020-ba3407495379 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039092 Jul 14 16:13:21.961901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1425/2952] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:13:28.894575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:13:28.895234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:13:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:14:07.670827 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:07.671798 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:07.676633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-475c08db-f6e7-4c3b-95e9-a913bcdfc1aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:07.677129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-475c08db-f6e7-4c3b-95e9-a913bcdfc1aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:07.684404 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-475c08db-f6e7-4c3b-95e9-a913bcdfc1aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:07.684872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-475c08db-f6e7-4c3b-95e9-a913bcdfc1aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:07.685552 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-475c08db-f6e7-4c3b-95e9-a913bcdfc1aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:07.686025 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-475c08db-f6e7-4c3b-95e9-a913bcdfc1aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:07.710897 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-475c08db-f6e7-4c3b-95e9-a913bcdfc1aa tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/ips" status: 200 len: 145 microversion: 2.1 time: 0.041765 Jul 14 16:14:07.711466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1528/2953] 10.222.0.99 () {58 vars in 1247 bytes} [Thu Jul 14 16:14:07 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/ips => generated 145 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:09.042584 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-72ba7c6b-56e4-4a70-aebd-dbf75e235235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c1f5ef2d-dc13-49a2-8f3a-fc3ab8783c08"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:14:09.043768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-72ba7c6b-56e4-4a70-aebd-dbf75e235235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:09.045977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=7 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:09.046865 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:09.053210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-72ba7c6b-56e4-4a70-aebd-dbf75e235235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:09.053657 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-72ba7c6b-56e4-4a70-aebd-dbf75e235235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:09.054413 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-72ba7c6b-56e4-4a70-aebd-dbf75e235235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:09.054846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-72ba7c6b-56e4-4a70-aebd-dbf75e235235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:09.292046 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-72ba7c6b-56e4-4a70-aebd-dbf75e235235 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "POST /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.253643 Jul 14 16:14:09.292656 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1426/2954] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 16:14:09 2022] POST /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments => generated 194 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:16.813118 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c807cc5d-ef5f-4fee-a69e-b80025d71e59 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:16.814261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c807cc5d-ef5f-4fee-a69e-b80025d71e59 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:16.823945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c807cc5d-ef5f-4fee-a69e-b80025d71e59 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:16.824479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c807cc5d-ef5f-4fee-a69e-b80025d71e59 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:16.825331 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c807cc5d-ef5f-4fee-a69e-b80025d71e59 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:16.825989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c807cc5d-ef5f-4fee-a69e-b80025d71e59 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:16.865735 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c807cc5d-ef5f-4fee-a69e-b80025d71e59 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056613 Jul 14 16:14:16.866298 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1529/2955] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:14:16 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:16.877593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-36b07ca9-dc6a-4bd0-956f-f3404ceea891 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:16.878291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-36b07ca9-dc6a-4bd0-956f-f3404ceea891 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:16.884559 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-36b07ca9-dc6a-4bd0-956f-f3404ceea891 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:16.885005 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-36b07ca9-dc6a-4bd0-956f-f3404ceea891 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:16.885852 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-36b07ca9-dc6a-4bd0-956f-f3404ceea891 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:16.886297 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-36b07ca9-dc6a-4bd0-956f-f3404ceea891 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:16.917665 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-36b07ca9-dc6a-4bd0-956f-f3404ceea891 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments/c1f5ef2d-dc13-49a2-8f3a-fc3ab8783c08" status: 200 len: 194 microversion: 2.1 time: 0.045101 Jul 14 16:14:16.918242 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1427/2956] 10.222.0.99 () {58 vars in 1412 bytes} [Thu Jul 14 16:14:16 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments/c1f5ef2d-dc13-49a2-8f3a-fc3ab8783c08 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:18.254231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-56784114-273c-4a1f-8356-08ea936a915d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "422b8611-d7ea-4347-a0fd-e2a03abdc16b"}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:14:18.255287 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-56784114-273c-4a1f-8356-08ea936a915d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:18.262112 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-56784114-273c-4a1f-8356-08ea936a915d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:18.262571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-56784114-273c-4a1f-8356-08ea936a915d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:18.263340 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-56784114-273c-4a1f-8356-08ea936a915d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:18.263816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-56784114-273c-4a1f-8356-08ea936a915d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:18.524521 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-56784114-273c-4a1f-8356-08ea936a915d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "POST /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274111 Jul 14 16:14:18.525111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1530/2957] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 16:14:18 2022] POST /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:26.039398 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c5c58b44-0878-4124-ab22-782a9f1ae598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:26.040374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c5c58b44-0878-4124-ab22-782a9f1ae598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:26.047336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c5c58b44-0878-4124-ab22-782a9f1ae598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:26.047840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c5c58b44-0878-4124-ab22-782a9f1ae598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:26.048627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c5c58b44-0878-4124-ab22-782a9f1ae598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:26.049057 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c5c58b44-0878-4124-ab22-782a9f1ae598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:26.082892 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c5c58b44-0878-4124-ab22-782a9f1ae598 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047333 Jul 14 16:14:26.083719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1428/2958] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:14:26 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:26.225824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-70585b90-5352-4482-8799-358799737f46 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:26.226443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-70585b90-5352-4482-8799-358799737f46 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:26.232900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70585b90-5352-4482-8799-358799737f46 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:26.233368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70585b90-5352-4482-8799-358799737f46 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:26.234122 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70585b90-5352-4482-8799-358799737f46 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:26.234565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-70585b90-5352-4482-8799-358799737f46 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:26.264075 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-70585b90-5352-4482-8799-358799737f46 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments/c1f5ef2d-dc13-49a2-8f3a-fc3ab8783c08" status: 200 len: 194 microversion: 2.1 time: 0.043658 Jul 14 16:14:26.264911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1531/2959] 10.222.0.99 () {58 vars in 1412 bytes} [Thu Jul 14 16:14:26 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments/c1f5ef2d-dc13-49a2-8f3a-fc3ab8783c08 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:26.274313 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5b227c72-fceb-4bf2-9839-b2b7b15aac6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:26.274757 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5b227c72-fceb-4bf2-9839-b2b7b15aac6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:26.280803 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b227c72-fceb-4bf2-9839-b2b7b15aac6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:26.281255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b227c72-fceb-4bf2-9839-b2b7b15aac6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:26.282020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b227c72-fceb-4bf2-9839-b2b7b15aac6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:26.282489 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b227c72-fceb-4bf2-9839-b2b7b15aac6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:26.365325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-5b227c72-fceb-4bf2-9839-b2b7b15aac6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lazy-loading 'services' on Instance uuid 2bb6e886-c18e-465b-ba45-b172d1639d11 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:14:26.447472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5b227c72-fceb-4bf2-9839-b2b7b15aac6d tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "DELETE /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments/c1f5ef2d-dc13-49a2-8f3a-fc3ab8783c08" status: 202 len: 0 microversion: 2.1 time: 0.177072 Jul 14 16:14:26.448134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1429/2960] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 16:14:26 2022] DELETE /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments/c1f5ef2d-dc13-49a2-8f3a-fc3ab8783c08 => generated 0 bytes in 179 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:14:27.559913 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0f004595-57db-462b-afaa-bb66697a957e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:27.560495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0f004595-57db-462b-afaa-bb66697a957e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:27.568185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f004595-57db-462b-afaa-bb66697a957e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:27.568637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f004595-57db-462b-afaa-bb66697a957e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:27.569396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f004595-57db-462b-afaa-bb66697a957e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:27.570033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0f004595-57db-462b-afaa-bb66697a957e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:27.600519 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0f004595-57db-462b-afaa-bb66697a957e tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments/422b8611-d7ea-4347-a0fd-e2a03abdc16b" status: 200 len: 194 microversion: 2.1 time: 0.044594 Jul 14 16:14:27.601111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1532/2961] 10.222.0.99 () {58 vars in 1412 bytes} [Thu Jul 14 16:14:27 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments/422b8611-d7ea-4347-a0fd-e2a03abdc16b => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:27.611912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-675ff265-2c3c-4c6c-b103-8e33632ab643 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:27.612490 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-675ff265-2c3c-4c6c-b103-8e33632ab643 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:27.618716 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-675ff265-2c3c-4c6c-b103-8e33632ab643 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:27.619173 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-675ff265-2c3c-4c6c-b103-8e33632ab643 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:27.619953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-675ff265-2c3c-4c6c-b103-8e33632ab643 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:27.620385 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-675ff265-2c3c-4c6c-b103-8e33632ab643 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:27.701127 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-675ff265-2c3c-4c6c-b103-8e33632ab643 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lazy-loading 'services' on Instance uuid 2bb6e886-c18e-465b-ba45-b172d1639d11 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:14:27.786195 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-675ff265-2c3c-4c6c-b103-8e33632ab643 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "DELETE /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments/422b8611-d7ea-4347-a0fd-e2a03abdc16b" status: 202 len: 0 microversion: 2.1 time: 0.178849 Jul 14 16:14:27.786913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1430/2962] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 16:14:27 2022] DELETE /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments/422b8611-d7ea-4347-a0fd-e2a03abdc16b => generated 0 bytes in 181 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:14:28.957140 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-81fdc40a-2899-4f70-9766-08ae39acfb72 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:28.958393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-81fdc40a-2899-4f70-9766-08ae39acfb72 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:28.966266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-81fdc40a-2899-4f70-9766-08ae39acfb72 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:28.966266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-81fdc40a-2899-4f70-9766-08ae39acfb72 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:28.966266 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-81fdc40a-2899-4f70-9766-08ae39acfb72 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:28.966823 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-81fdc40a-2899-4f70-9766-08ae39acfb72 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:28.998008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-81fdc40a-2899-4f70-9766-08ae39acfb72 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045666 Jul 14 16:14:28.998576 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1533/2963] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:14:28 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:14:29.106022 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b5d11c9b-3f4c-47f6-a44d-617fc72bb5b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:29.107025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b5d11c9b-3f4c-47f6-a44d-617fc72bb5b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:29.113519 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5d11c9b-3f4c-47f6-a44d-617fc72bb5b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:29.113977 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5d11c9b-3f4c-47f6-a44d-617fc72bb5b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:29.114742 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5d11c9b-3f4c-47f6-a44d-617fc72bb5b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:29.115184 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b5d11c9b-3f4c-47f6-a44d-617fc72bb5b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:29.145083 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b5d11c9b-3f4c-47f6-a44d-617fc72bb5b5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044121 Jul 14 16:14:29.145653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1431/2964] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:14:29 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:14:29.202644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1e7e714a-2a98-416a-9884-cd1fac1e1423 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:29.203146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1e7e714a-2a98-416a-9884-cd1fac1e1423 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:29.209870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1e7e714a-2a98-416a-9884-cd1fac1e1423 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:29.210330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1e7e714a-2a98-416a-9884-cd1fac1e1423 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:29.211120 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1e7e714a-2a98-416a-9884-cd1fac1e1423 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:29.211565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-1e7e714a-2a98-416a-9884-cd1fac1e1423 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:29.235890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-1e7e714a-2a98-416a-9884-cd1fac1e1423 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Going to try to terminate instance {{(pid=124503) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:14:29.318985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1e7e714a-2a98-416a-9884-cd1fac1e1423 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "DELETE /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 204 len: 0 microversion: 2.1 time: 0.119816 Jul 14 16:14:29.319889 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1534/2965] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:14:29 2022] DELETE /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:14:29.328163 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-61bbfa7b-bdc6-4e9c-b02a-0fb98d56bf51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:29.328769 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-61bbfa7b-bdc6-4e9c-b02a-0fb98d56bf51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:29.335385 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-61bbfa7b-bdc6-4e9c-b02a-0fb98d56bf51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:29.335878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-61bbfa7b-bdc6-4e9c-b02a-0fb98d56bf51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:29.336641 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-61bbfa7b-bdc6-4e9c-b02a-0fb98d56bf51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:29.337085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-61bbfa7b-bdc6-4e9c-b02a-0fb98d56bf51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:29.470793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-61bbfa7b-bdc6-4e9c-b02a-0fb98d56bf51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:29.478233 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-61bbfa7b-bdc6-4e9c-b02a-0fb98d56bf51 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1672 microversion: 2.1 time: 0.153912 Jul 14 16:14:29.478799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1432/2966] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:29 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:30.496323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b4e3152e-73ae-41f2-b756-2210c9ae1b12 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:30.497020 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b4e3152e-73ae-41f2-b756-2210c9ae1b12 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:30.503630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4e3152e-73ae-41f2-b756-2210c9ae1b12 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:30.504088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4e3152e-73ae-41f2-b756-2210c9ae1b12 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:30.505000 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4e3152e-73ae-41f2-b756-2210c9ae1b12 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:30.505314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b4e3152e-73ae-41f2-b756-2210c9ae1b12 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:30.637422 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-b4e3152e-73ae-41f2-b756-2210c9ae1b12 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:30.645742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b4e3152e-73ae-41f2-b756-2210c9ae1b12 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1672 microversion: 2.1 time: 0.153650 Jul 14 16:14:30.646332 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1535/2967] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:30 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1672 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:31.662833 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8d266530-ac21-480c-b845-998650aa0ed5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:31.663473 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8d266530-ac21-480c-b845-998650aa0ed5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:31.669913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d266530-ac21-480c-b845-998650aa0ed5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:31.670400 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d266530-ac21-480c-b845-998650aa0ed5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:31.671249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d266530-ac21-480c-b845-998650aa0ed5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:31.671880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8d266530-ac21-480c-b845-998650aa0ed5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:31.947956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8d266530-ac21-480c-b845-998650aa0ed5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:31.956156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8d266530-ac21-480c-b845-998650aa0ed5 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1672 microversion: 2.1 time: 0.297211 Jul 14 16:14:31.956821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1433/2968] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:31 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1672 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:32.525802 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-6bd8eb12-d0af-4092-ad89-45f7cc353811 req-6f9e225c-6d7c-40f9-889b-7f202ade89dc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2bb6e886-c18e-465b-ba45-b172d1639d11", "name": "network-vif-deleted", "tag": "4e421601-a8d5-48ee-b1d7-7b9bf1f0d7cd"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:14:32.535557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-6bd8eb12-d0af-4092-ad89-45f7cc353811 req-6f9e225c-6d7c-40f9-889b-7f202ade89dc service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:32.536158 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-6bd8eb12-d0af-4092-ad89-45f7cc353811 req-6f9e225c-6d7c-40f9-889b-7f202ade89dc service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:32.551338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-6bd8eb12-d0af-4092-ad89-45f7cc353811 req-6f9e225c-6d7c-40f9-889b-7f202ade89dc service nova] Creating event network-vif-deleted:4e421601-a8d5-48ee-b1d7-7b9bf1f0d7cd for instance 2bb6e886-c18e-465b-ba45-b172d1639d11 on hv-cinder-82651 Jul 14 16:14:32.556129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-6bd8eb12-d0af-4092-ad89-45f7cc353811 req-6f9e225c-6d7c-40f9-889b-7f202ade89dc service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033947 Jul 14 16:14:32.556908 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1536/2969] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:14:32.973809 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8ee05bf7-d889-42b5-b0a2-ff9fe8a8fb3b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:32.974404 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8ee05bf7-d889-42b5-b0a2-ff9fe8a8fb3b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:32.981232 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ee05bf7-d889-42b5-b0a2-ff9fe8a8fb3b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:32.981675 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ee05bf7-d889-42b5-b0a2-ff9fe8a8fb3b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:32.982430 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ee05bf7-d889-42b5-b0a2-ff9fe8a8fb3b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:32.983055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ee05bf7-d889-42b5-b0a2-ff9fe8a8fb3b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:33.018139 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ee05bf7-d889-42b5-b0a2-ff9fe8a8fb3b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:33.023848 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8ee05bf7-d889-42b5-b0a2-ff9fe8a8fb3b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:33.024247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-8ee05bf7-d889-42b5-b0a2-ff9fe8a8fb3b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lazy-loading 'fault' on Instance uuid 2bb6e886-c18e-465b-ba45-b172d1639d11 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:14:33.070330 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8ee05bf7-d889-42b5-b0a2-ff9fe8a8fb3b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '46f52ad195a34123982d238ea351172d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '67ea0d1ef31b495b8dad23f39cedf1bf', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:14:33.078158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8ee05bf7-d889-42b5-b0a2-ff9fe8a8fb3b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 200 len: 1327 microversion: 2.1 time: 0.108739 Jul 14 16:14:33.078739 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1434/2970] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:32 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 1327 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:14:34.097703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7b336c05-43be-4e5e-a2f5-64f3090ed21b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:34.098392 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7b336c05-43be-4e5e-a2f5-64f3090ed21b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:34.104821 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7b336c05-43be-4e5e-a2f5-64f3090ed21b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:34.105276 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7b336c05-43be-4e5e-a2f5-64f3090ed21b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:34.106035 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7b336c05-43be-4e5e-a2f5-64f3090ed21b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:34.106469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7b336c05-43be-4e5e-a2f5-64f3090ed21b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:34.119574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-7b336c05-43be-4e5e-a2f5-64f3090ed21b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] HTTP exception thrown: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7b336c05-43be-4e5e-a2f5-64f3090ed21b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Request method failure captured: Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 HTTP/1.1 Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgS-4Q10n__x9pLo9H4HyyVCSViURQOHJjOVPtrhou9XF5HwPz8tdwdHMutE7Bp3YVzRzDSx_ATxxriDPQ_5j6YQRyCO9XTdJIwm_O6HQ1GOdd-hHQ30X8JDgFNk7gLQPOc2qGY5R-sCoZL3pqcV8TP-HfAjy1Dyzx5JTWPDZX_edU Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 67ea0d1ef31b495b8dad23f39cedf1bf Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:14:34.121240 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:14:34.123115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:14:34.123115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:34.123115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 67ea0d1ef31b495b8dad23f39cedf1bf Jul 14 16:14:34.123115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:34.123115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-AttachVolumeTestJSON-129772734-project Jul 14 16:14:34.123115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:14:34.123115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:14:34.123115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 46f52ad195a34123982d238ea351172d Jul 14 16:14:34.123115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-AttachVolumeTestJSON-129772734-project Jul 14 16:14:34.123115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:14:34.123115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:34.123115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': '2bb6e886-c18e-465b-ba45-b172d1639d11'} Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:14:34.124356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:34.126190 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:34.128312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7b336c05-43be-4e5e-a2f5-64f3090ed21b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Returning 404 to user: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:14:34.128312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7b336c05-43be-4e5e-a2f5-64f3090ed21b tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 404 len: 111 microversion: 2.1 time: 0.030161 Jul 14 16:14:34.128312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1537/2971] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:34 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:14:34.131737 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7f5afa2d-153f-4074-95eb-75766402bd5a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '.version_select at 0x7f357fd8aca0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:34.150543 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7f5afa2d-153f-4074-95eb-75766402bd5a tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094861201" status: 202 len: 0 microversion: 2.1 time: 0.022919 Jul 14 16:14:34.151129 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1435/2972] 10.222.0.99 () {58 vars in 1220 bytes} [Thu Jul 14 16:14:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1094861201 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:14:37.040667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-40fbfee1-9e9e-4897-ab82-3d57e8a7e84f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:37.041217 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-40fbfee1-9e9e-4897-ab82-3d57e8a7e84f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:37.050944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40fbfee1-9e9e-4897-ab82-3d57e8a7e84f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:37.051522 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40fbfee1-9e9e-4897-ab82-3d57e8a7e84f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:37.052314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40fbfee1-9e9e-4897-ab82-3d57e8a7e84f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:37.052761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-40fbfee1-9e9e-4897-ab82-3d57e8a7e84f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:37.066338 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-40fbfee1-9e9e-4897-ab82-3d57e8a7e84f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] HTTP exception thrown: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-40fbfee1-9e9e-4897-ab82-3d57e8a7e84f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Request method failure captured: Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 HTTP/1.1 Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgS-4Q10n__x9pLo9H4HyyVCSViURQOHJjOVPtrhou9XF5HwPz8tdwdHMutE7Bp3YVzRzDSx_ATxxriDPQ_5j6YQRyCO9XTdJIwm_O6HQ1GOdd-hHQ30X8JDgFNk7gLQPOc2qGY5R-sCoZL3pqcV8TP-HfAjy1Dyzx5JTWPDZX_edU Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 67ea0d1ef31b495b8dad23f39cedf1bf Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:14:37.069716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:14:37.071495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:14:37.071495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:37.071495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 67ea0d1ef31b495b8dad23f39cedf1bf Jul 14 16:14:37.071495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:37.071495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-AttachVolumeTestJSON-129772734-project Jul 14 16:14:37.071495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:14:37.071495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:14:37.071495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 46f52ad195a34123982d238ea351172d Jul 14 16:14:37.071495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-AttachVolumeTestJSON-129772734-project Jul 14 16:14:37.071495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:14:37.071495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:37.071495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': '2bb6e886-c18e-465b-ba45-b172d1639d11'} Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:14:37.072530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:37.074064 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:37.075721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-40fbfee1-9e9e-4897-ab82-3d57e8a7e84f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Returning 404 to user: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:14:37.075721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-40fbfee1-9e9e-4897-ab82-3d57e8a7e84f tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "DELETE /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 404 len: 111 microversion: 2.1 time: 0.034896 Jul 14 16:14:37.075721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1538/2973] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:14:37 2022] DELETE /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:14:37.082239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fbd2f139-952a-40bd-bf4a-c0d55369a1e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:37.082849 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fbd2f139-952a-40bd-bf4a-c0d55369a1e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: 2bb6e886-c18e-465b-ba45-b172d1639d11] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:37.089707 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fbd2f139-952a-40bd-bf4a-c0d55369a1e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:37.090152 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fbd2f139-952a-40bd-bf4a-c0d55369a1e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:37.090914 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fbd2f139-952a-40bd-bf4a-c0d55369a1e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:37.091353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fbd2f139-952a-40bd-bf4a-c0d55369a1e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:37.112159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-fbd2f139-952a-40bd-bf4a-c0d55369a1e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] HTTP exception thrown: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fbd2f139-952a-40bd-bf4a-c0d55369a1e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Request method failure captured: Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 HTTP/1.1 Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgS-4Q10n__x9pLo9H4HyyVCSViURQOHJjOVPtrhou9XF5HwPz8tdwdHMutE7Bp3YVzRzDSx_ATxxriDPQ_5j6YQRyCO9XTdJIwm_O6HQ1GOdd-hHQ30X8JDgFNk7gLQPOc2qGY5R-sCoZL3pqcV8TP-HfAjy1Dyzx5JTWPDZX_edU Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 67ea0d1ef31b495b8dad23f39cedf1bf Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:14:37.115080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:14:37.116916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:14:37.116916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:37.116916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 67ea0d1ef31b495b8dad23f39cedf1bf Jul 14 16:14:37.116916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:37.116916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeTestJSON-129772734-project Jul 14 16:14:37.116916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:14:37.116916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:14:37.116916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 46f52ad195a34123982d238ea351172d Jul 14 16:14:37.116916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeTestJSON-129772734-project Jul 14 16:14:37.116916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:14:37.116916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:37.116916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '2bb6e886-c18e-465b-ba45-b172d1639d11'} Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:14:37.117931 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. Jul 14 16:14:37.119793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:14:37.121299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fbd2f139-952a-40bd-bf4a-c0d55369a1e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Returning 404 to user: Instance 2bb6e886-c18e-465b-ba45-b172d1639d11 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:14:37.121299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fbd2f139-952a-40bd-bf4a-c0d55369a1e8 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11" status: 404 len: 111 microversion: 2.1 time: 0.039889 Jul 14 16:14:37.121299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1436/2974] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:37 2022] GET /compute/v2.1/servers/2bb6e886-c18e-465b-ba45-b172d1639d11 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:14:38.271320 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b937fbc7-154f-47f2-803c-6cdfa0289eff tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:38.272143 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-b937fbc7-154f-47f2-803c-6cdfa0289eff tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:38.274563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=28,nova_api:UPDATE=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:38.280771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b937fbc7-154f-47f2-803c-6cdfa0289eff tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:38.281228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b937fbc7-154f-47f2-803c-6cdfa0289eff tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:38.282002 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b937fbc7-154f-47f2-803c-6cdfa0289eff tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:38.282441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-b937fbc7-154f-47f2-803c-6cdfa0289eff tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:38.286835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:14:38.302069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-b937fbc7-154f-47f2-803c-6cdfa0289eff tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] HTTP exception thrown: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b937fbc7-154f-47f2-803c-6cdfa0289eff tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Request method failure captured: Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 HTTP/1.1 Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgS-4Q10n__x9pLo9H4HyyVCSViURQOHJjOVPtrhou9XF5HwPz8tdwdHMutE7Bp3YVzRzDSx_ATxxriDPQ_5j6YQRyCO9XTdJIwm_O6HQ1GOdd-hHQ30X8JDgFNk7gLQPOc2qGY5R-sCoZL3pqcV8TP-HfAjy1Dyzx5JTWPDZX_edU Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 67ea0d1ef31b495b8dad23f39cedf1bf Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:14:38.303755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:14:38.305551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:14:38.305551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:38.305551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 67ea0d1ef31b495b8dad23f39cedf1bf Jul 14 16:14:38.305551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:38.305551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-AttachVolumeTestJSON-129772734-project Jul 14 16:14:38.305551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:14:38.305551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:14:38.305551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 46f52ad195a34123982d238ea351172d Jul 14 16:14:38.305551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-AttachVolumeTestJSON-129772734-project Jul 14 16:14:38.305551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:14:38.305551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:14:38.305551 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': 'f3d96a86-d045-44b2-b298-75df12f65c86'} Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:14:38.309456 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:14:38.310902 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:14:38.312362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-b937fbc7-154f-47f2-803c-6cdfa0289eff tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Returning 404 to user: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:14:38.312362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-b937fbc7-154f-47f2-803c-6cdfa0289eff tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "DELETE /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 404 len: 111 microversion: 2.1 time: 0.037848 Jul 14 16:14:38.312362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1539/2975] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:14:38 2022] DELETE /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:14:38.313553 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8df2b0e7-0feb-4ace-9747-47e6155b6572 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:14:38.314172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8df2b0e7-0feb-4ace-9747-47e6155b6572 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] [instance: f3d96a86-d045-44b2-b298-75df12f65c86] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:14:38.320937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8df2b0e7-0feb-4ace-9747-47e6155b6572 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:38.321397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8df2b0e7-0feb-4ace-9747-47e6155b6572 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:38.322194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8df2b0e7-0feb-4ace-9747-47e6155b6572 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:14:38.322637 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8df2b0e7-0feb-4ace-9747-47e6155b6572 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:14:38.336610 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-8df2b0e7-0feb-4ace-9747-47e6155b6572 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] HTTP exception thrown: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8df2b0e7-0feb-4ace-9747-47e6155b6572 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Request method failure captured: Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 HTTP/1.1 Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgS-4Q10n__x9pLo9H4HyyVCSViURQOHJjOVPtrhou9XF5HwPz8tdwdHMutE7Bp3YVzRzDSx_ATxxriDPQ_5j6YQRyCO9XTdJIwm_O6HQ1GOdd-hHQ30X8JDgFNk7gLQPOc2qGY5R-sCoZL3pqcV8TP-HfAjy1Dyzx5JTWPDZX_edU Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 67ea0d1ef31b495b8dad23f39cedf1bf Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:14:38.338143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:14:38.340050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/67ea0d1ef31b495b8dad23f39cedf1bf"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:14:38.340050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:38.340050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 67ea0d1ef31b495b8dad23f39cedf1bf Jul 14 16:14:38.340050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeTestJSON-129772734 Jul 14 16:14:38.340050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeTestJSON-129772734-project Jul 14 16:14:38.340050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:14:38.340050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:14:38.340050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 46f52ad195a34123982d238ea351172d Jul 14 16:14:38.340050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeTestJSON-129772734-project Jul 14 16:14:38.340050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:14:38.340050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:14:38.340050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'f3d96a86-d045-44b2-b298-75df12f65c86'} Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:14:38.341072 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. Jul 14 16:14:38.342949 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:14:38.344492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8df2b0e7-0feb-4ace-9747-47e6155b6572 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] Returning 404 to user: Instance f3d96a86-d045-44b2-b298-75df12f65c86 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:14:38.344492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8df2b0e7-0feb-4ace-9747-47e6155b6572 tempest-AttachVolumeTestJSON-129772734 tempest-AttachVolumeTestJSON-129772734-project] 10.222.0.99 "GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86" status: 404 len: 111 microversion: 2.1 time: 0.029764 Jul 14 16:14:38.344492 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1437/2976] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:14:38 2022] GET /compute/v2.1/servers/f3d96a86-d045-44b2-b298-75df12f65c86 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:15:51.626781 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:15:51.627389 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:15:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:16:48.903758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:16:48.904356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:16:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:17:13.383749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:17:13.384344 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:17:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:18:20.543970 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:18:20.544779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:18:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:18:58.927731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bff24c-ccf9-4f5c-9e49-e1d6533bf9fd] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 16:18:58.928918 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:58.933603 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e61b5a88-faee-445f-affa-f7f8d8385b40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:18:58.934088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e61b5a88-faee-445f-affa-f7f8d8385b40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:18:58.941430 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e61b5a88-faee-445f-affa-f7f8d8385b40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:58.941874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e61b5a88-faee-445f-affa-f7f8d8385b40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:58.942616 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e61b5a88-faee-445f-affa-f7f8d8385b40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:58.943055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e61b5a88-faee-445f-affa-f7f8d8385b40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:58.956152 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-e61b5a88-faee-445f-affa-f7f8d8385b40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] HTTP exception thrown: Instance e5c8cb95-bde5-4c91-99de-27aa44a822bf could not be found. Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e61b5a88-faee-445f-affa-f7f8d8385b40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Request method failure captured: Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf HTTP/1.1 Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0DgK5WXOpci8AcrNPn8DZdLLfUB41hSWokUR9H6KGxUfhPgB-BorBSZznPeBbS4gu94jx-hxaHDmhLG-t30F1OFghgkwn6GHIuifzVKnBtRjL6ElXPVnPijnlxUZTNEt3ToExP61Kr8jSycWU9MCu5vsLLyrO4eaZKYrYLFgLM2mFCI Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: 636b923a8a58435484086dc8394ccc23 Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:18:58.957676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:18:58.960449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_636b923a8a58435484086dc8394ccc23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/636b923a8a58435484086dc8394ccc23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/636b923a8a58435484086dc8394ccc23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/636b923a8a58435484086dc8394ccc23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:18:58.960449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:18:58.960449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: 636b923a8a58435484086dc8394ccc23 Jul 14 16:18:58.960449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:18:58.960449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-AttachVolumeShelveTestJSON-1064333928-project Jul 14 16:18:58.960449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:18:58.960449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:18:58.960449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 781567471d0f4ca4add4331d405febd4 Jul 14 16:18:58.960449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1064333928-project Jul 14 16:18:58.960449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:18:58.960449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance e5c8cb95-bde5-4c91-99de-27aa44a822bf could not be found. Jul 14 16:18:58.960449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': 'e5c8cb95-bde5-4c91-99de-27aa44a822bf'} Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5c8cb95-bde5-4c91-99de-27aa44a822bf could not be found. Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:18:58.962542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5c8cb95-bde5-4c91-99de-27aa44a822bf could not be found. Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5c8cb95-bde5-4c91-99de-27aa44a822bf could not be found. Jul 14 16:18:58.964943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:18:58.966759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e61b5a88-faee-445f-affa-f7f8d8385b40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Returning 404 to user: Instance e5c8cb95-bde5-4c91-99de-27aa44a822bf could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:18:58.966759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e61b5a88-faee-445f-affa-f7f8d8385b40 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "DELETE /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 404 len: 111 microversion: 2.20 time: 0.033408 Jul 14 16:18:58.966759 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1540/2977] 10.222.0.99 () {60 vars in 1279 bytes} [Thu Jul 14 16:18:58 2022] DELETE /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:18:58.967516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR oslo.messaging._drivers.impl_rabbit [-] [05b4667f-f95a-4031-8d09-b4e638561548] AMQP server on 10.222.0.99:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jul 14 16:18:58.968443 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=27,nova_api:DELETE=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:58.969336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:18:58.973437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-396748c6-e8d8-4e03-8254-c061606f4eb9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:18:58.974048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-396748c6-e8d8-4e03-8254-c061606f4eb9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] [instance: e5c8cb95-bde5-4c91-99de-27aa44a822bf] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:18:58.982713 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-396748c6-e8d8-4e03-8254-c061606f4eb9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:58.983173 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-396748c6-e8d8-4e03-8254-c061606f4eb9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:58.983971 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-396748c6-e8d8-4e03-8254-c061606f4eb9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:18:58.984419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-396748c6-e8d8-4e03-8254-c061606f4eb9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:18:58.999963 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-396748c6-e8d8-4e03-8254-c061606f4eb9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] HTTP exception thrown: Instance e5c8cb95-bde5-4c91-99de-27aa44a822bf could not be found. Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-396748c6-e8d8-4e03-8254-c061606f4eb9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Request method failure captured: Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf HTTP/1.1 Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0DgK5WXOpci8AcrNPn8DZdLLfUB41hSWokUR9H6KGxUfhPgB-BorBSZznPeBbS4gu94jx-hxaHDmhLG-t30F1OFghgkwn6GHIuifzVKnBtRjL6ElXPVnPijnlxUZTNEt3ToExP61Kr8jSycWU9MCu5vsLLyrO4eaZKYrYLFgLM2mFCI Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Openstack-Nova-Api-Version: 2.20 Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: 636b923a8a58435484086dc8394ccc23 Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:18:59.001520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:18:59.003364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_636b923a8a58435484086dc8394ccc23"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/636b923a8a58435484086dc8394ccc23"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/636b923a8a58435484086dc8394ccc23"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/636b923a8a58435484086dc8394ccc23"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:18:59.003364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:18:59.003364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: 636b923a8a58435484086dc8394ccc23 Jul 14 16:18:59.003364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1064333928 Jul 14 16:18:59.003364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeShelveTestJSON-1064333928-project Jul 14 16:18:59.003364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:18:59.003364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:18:59.003364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 781567471d0f4ca4add4331d405febd4 Jul 14 16:18:59.003364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1064333928-project Jul 14 16:18:59.003364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:18:59.003364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance e5c8cb95-bde5-4c91-99de-27aa44a822bf could not be found. Jul 14 16:18:59.003364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'e5c8cb95-bde5-4c91-99de-27aa44a822bf'} Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e5c8cb95-bde5-4c91-99de-27aa44a822bf could not be found. Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:18:59.004439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e5c8cb95-bde5-4c91-99de-27aa44a822bf could not be found. Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e5c8cb95-bde5-4c91-99de-27aa44a822bf could not be found. Jul 14 16:18:59.006147 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:18:59.007754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-396748c6-e8d8-4e03-8254-c061606f4eb9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] Returning 404 to user: Instance e5c8cb95-bde5-4c91-99de-27aa44a822bf could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:18:59.007754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-396748c6-e8d8-4e03-8254-c061606f4eb9 tempest-AttachVolumeShelveTestJSON-1064333928 tempest-AttachVolumeShelveTestJSON-1064333928-project] 10.222.0.99 "GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf" status: 404 len: 111 microversion: 2.20 time: 0.038312 Jul 14 16:18:59.007754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1438/2978] 10.222.0.99 () {60 vars in 1276 bytes} [Thu Jul 14 16:18:58 2022] GET /compute/v2.1/servers/e5c8cb95-bde5-4c91-99de-27aa44a822bf => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:19:08.081632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bff24c-ccf9-4f5c-9e49-e1d6533bf9fd] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 49494. Jul 14 16:19:08.212072 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a5b83e9f-ce38-4ffb-85ca-01e77c0dd3ab tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: .version_select at 0x7f357ff5e700>, body: {"keypair": {"name": "tempest-keypair-511405352", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKCj8ZZ3gzmzaawIPgaCyQCZknt7WHXa8SMyJMEf4i+tMyzbgQ9SDX98P2bXvGLiVU+5Y3aNEIn1da+L/t2e+P0avDa4Nrx/hbJscWT4SvPfUm6/dMWOTFWH/ecJsT0JXw=="}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:19:08.227033 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-a5b83e9f-ce38-4ffb-85ca-01e77c0dd3ab tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for project c09479647ca24b63b744f3dd55111cb3. Resources: {'key_pairs'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:19:08.233032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-a5b83e9f-ce38-4ffb-85ca-01e77c0dd3ab tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for user b5dbfe771fbe4372951006b71082391a and project c09479647ca24b63b744f3dd55111cb3. Resources: {'key_pairs'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:19:08.246246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR oslo.messaging._drivers.impl_rabbit [None req-a5b83e9f-ce38-4ffb-85ca-01e77c0dd3ab tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [abba292d-f6c9-44d8-a304-fefc4d161067] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 16:19:08.948224 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:09.255221 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [None req-a5b83e9f-ce38-4ffb-85ca-01e77c0dd3ab tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [abba292d-f6c9-44d8-a304-fefc4d161067] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 49496. Jul 14 16:19:09.270154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a5b83e9f-ce38-4ffb-85ca-01e77c0dd3ab tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.200923 Jul 14 16:19:09.270812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1541/2979] 10.222.0.99 () {60 vars in 1158 bytes} [Thu Jul 14 16:19:08 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:19:10.730560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1859538965", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7e903e9-24ef-4d9c-a328-ca11ef2805b4"}], "security_groups": [{"name": "tempest-securitygroup--458531402"}], "key_name": "tempest-keypair-511405352", "user_data": "}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:19:10.738540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:10.739213 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:10.760218 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] [05b4667f-f95a-4031-8d09-b4e638561548] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 49510. Jul 14 16:19:11.057746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.network.neutron [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] validate_networks() for [('d7e903e9-24ef-4d9c-a328-ca11ef2805b4', None, None, None, None, None)] {{(pid=124502) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:19:11.573910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Flavor limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:19:11.574343 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Image limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:19:11.574839 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Flavor pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:19:11.575243 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Image pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:19:11.575684 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:19:11.585113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:11.585568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:11.586364 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:11.586808 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:11.604956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for project c09479647ca24b63b744f3dd55111cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:19:11.609754 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for user b5dbfe771fbe4372951006b71082391a and project c09479647ca24b63b744f3dd55111cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:19:11.622913 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Going to run 1 instances... {{(pid=124502) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:19:11.625253 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124502) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:19:11.678880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d8d8844d-2d0f-4fde-9a6e-0d807f11978b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.953162 Jul 14 16:19:11.684317 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1439/2980] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 16:19:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 955 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:19:11.693183 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0802369d-16d8-4533-b005-a245f07959a3 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:11.694113 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0802369d-16d8-4533-b005-a245f07959a3 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:11.835184 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0802369d-16d8-4533-b005-a245f07959a3 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:11.843205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0802369d-16d8-4533-b005-a245f07959a3 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1241 microversion: 2.1 time: 0.156214 Jul 14 16:19:11.843816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1542/2981] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:11 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1241 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:12.862230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e881af4b-8c32-4258-8659-1379588745ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:12.862921 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e881af4b-8c32-4258-8659-1379588745ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:12.870531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e881af4b-8c32-4258-8659-1379588745ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:12.870985 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e881af4b-8c32-4258-8659-1379588745ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:12.871822 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e881af4b-8c32-4258-8659-1379588745ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:12.872265 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e881af4b-8c32-4258-8659-1379588745ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:12.955903 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e881af4b-8c32-4258-8659-1379588745ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:12.965224 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e881af4b-8c32-4258-8659-1379588745ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1301 microversion: 2.1 time: 0.107359 Jul 14 16:19:12.966169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1440/2982] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:12 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1301 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:19:13.984023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-adb6fec0-1302-481a-9557-6459a660449a tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:13.984633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-adb6fec0-1302-481a-9557-6459a660449a tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:13.991403 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-adb6fec0-1302-481a-9557-6459a660449a tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:13.991877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-adb6fec0-1302-481a-9557-6459a660449a tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:13.992641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-adb6fec0-1302-481a-9557-6459a660449a tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:13.993074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-adb6fec0-1302-481a-9557-6459a660449a tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:14.137462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-adb6fec0-1302-481a-9557-6459a660449a tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:14.145860 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-adb6fec0-1302-481a-9557-6459a660449a tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1366 microversion: 2.1 time: 0.166861 Jul 14 16:19:14.146439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1543/2983] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:13 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1366 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:14.489916 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-5804f8f2-5fc3-4c40-a3e5-800cf0ae4a6f req-10580032-819a-40c1-85e3-a0218306a6cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1790591-bc73-4e04-ba8d-a52aadac6194", "tag": "1116daf0-65f7-4558-b38f-a510a32f447c"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:19:14.500370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-5804f8f2-5fc3-4c40-a3e5-800cf0ae4a6f req-10580032-819a-40c1-85e3-a0218306a6cd service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:14.500917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-5804f8f2-5fc3-4c40-a3e5-800cf0ae4a6f req-10580032-819a-40c1-85e3-a0218306a6cd service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:14.513156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-5804f8f2-5fc3-4c40-a3e5-800cf0ae4a6f req-10580032-819a-40c1-85e3-a0218306a6cd service nova] Creating event network-changed:1116daf0-65f7-4558-b38f-a510a32f447c for instance c1790591-bc73-4e04-ba8d-a52aadac6194 on hv-cinder-82651 Jul 14 16:19:14.516983 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR oslo.messaging._drivers.impl_rabbit [req-5804f8f2-5fc3-4c40-a3e5-800cf0ae4a6f req-10580032-819a-40c1-85e3-a0218306a6cd service nova] [b48851c6-dbfd-41b0-8993-0bb7cc36d21b] AMQP server on 10.222.0.99:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Jul 14 16:19:15.163553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c3372ea2-fc28-424d-9871-3d6b82860f7d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:15.164367 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c3372ea2-fc28-424d-9871-3d6b82860f7d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:15.171219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3372ea2-fc28-424d-9871-3d6b82860f7d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:15.171692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3372ea2-fc28-424d-9871-3d6b82860f7d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:15.172462 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3372ea2-fc28-424d-9871-3d6b82860f7d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:15.172906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-c3372ea2-fc28-424d-9871-3d6b82860f7d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:15.303965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c3372ea2-fc28-424d-9871-3d6b82860f7d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:15.311328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c3372ea2-fc28-424d-9871-3d6b82860f7d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1366 microversion: 2.1 time: 0.151714 Jul 14 16:19:15.311933 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1544/2984] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:15 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:19:15.526596 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [req-5804f8f2-5fc3-4c40-a3e5-800cf0ae4a6f req-10580032-819a-40c1-85e3-a0218306a6cd service nova] [b48851c6-dbfd-41b0-8993-0bb7cc36d21b] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 49558. Jul 14 16:19:15.529711 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-5804f8f2-5fc3-4c40-a3e5-800cf0ae4a6f req-10580032-819a-40c1-85e3-a0218306a6cd service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 1.123371 Jul 14 16:19:15.530320 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1441/2985] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 1125 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:19:16.328219 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8c3fd92e-a03c-49fd-b554-1e6f7e261a32 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:16.328833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8c3fd92e-a03c-49fd-b554-1e6f7e261a32 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:16.335333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8c3fd92e-a03c-49fd-b554-1e6f7e261a32 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:16.335835 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8c3fd92e-a03c-49fd-b554-1e6f7e261a32 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:16.336596 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8c3fd92e-a03c-49fd-b554-1e6f7e261a32 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:16.337032 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8c3fd92e-a03c-49fd-b554-1e6f7e261a32 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:16.466653 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8c3fd92e-a03c-49fd-b554-1e6f7e261a32 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:16.474268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8c3fd92e-a03c-49fd-b554-1e6f7e261a32 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1366 microversion: 2.1 time: 0.149889 Jul 14 16:19:16.474830 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1545/2986] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:16 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:17.498342 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1952b287-994c-4330-adad-a846d0ec53e0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:17.499618 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1952b287-994c-4330-adad-a846d0ec53e0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:17.519214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1952b287-994c-4330-adad-a846d0ec53e0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:17.520634 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1952b287-994c-4330-adad-a846d0ec53e0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:17.521498 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1952b287-994c-4330-adad-a846d0ec53e0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:17.522294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1952b287-994c-4330-adad-a846d0ec53e0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:17.680130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1952b287-994c-4330-adad-a846d0ec53e0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:17.688358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1952b287-994c-4330-adad-a846d0ec53e0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1366 microversion: 2.1 time: 0.199681 Jul 14 16:19:17.688936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1442/2987] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:17 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1366 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:18.705785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-27e6cba6-079a-4d2f-a8e8-aeb25a889472 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:18.706423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-27e6cba6-079a-4d2f-a8e8-aeb25a889472 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:18.713533 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27e6cba6-079a-4d2f-a8e8-aeb25a889472 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:18.713981 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27e6cba6-079a-4d2f-a8e8-aeb25a889472 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:18.714858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27e6cba6-079a-4d2f-a8e8-aeb25a889472 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:18.715305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27e6cba6-079a-4d2f-a8e8-aeb25a889472 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:18.847431 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-27e6cba6-079a-4d2f-a8e8-aeb25a889472 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:18.855647 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-27e6cba6-079a-4d2f-a8e8-aeb25a889472 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1366 microversion: 2.1 time: 0.153767 Jul 14 16:19:18.856210 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1546/2988] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:18 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:19:19.627741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-373af884-8828-409a-a2d0-210b7652e69b req-d3565dc7-16c9-4327-a76a-c52c75230e9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1790591-bc73-4e04-ba8d-a52aadac6194", "name": "network-vif-plugged", "status": "completed", "tag": "1116daf0-65f7-4558-b38f-a510a32f447c"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:19:19.635649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-373af884-8828-409a-a2d0-210b7652e69b req-d3565dc7-16c9-4327-a76a-c52c75230e9e service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:19.636097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-373af884-8828-409a-a2d0-210b7652e69b req-d3565dc7-16c9-4327-a76a-c52c75230e9e service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:19.646953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-373af884-8828-409a-a2d0-210b7652e69b req-d3565dc7-16c9-4327-a76a-c52c75230e9e service nova] Creating event network-vif-plugged:1116daf0-65f7-4558-b38f-a510a32f447c for instance c1790591-bc73-4e04-ba8d-a52aadac6194 on hv-cinder-82651 Jul 14 16:19:19.652480 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-373af884-8828-409a-a2d0-210b7652e69b req-d3565dc7-16c9-4327-a76a-c52c75230e9e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086025 Jul 14 16:19:19.653053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1443/2989] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:19:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:19:19.872250 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-18ccc99c-5a4d-4b89-bce0-2206c02c4bff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:19.872871 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-18ccc99c-5a4d-4b89-bce0-2206c02c4bff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:19.880138 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-18ccc99c-5a4d-4b89-bce0-2206c02c4bff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:19.880595 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-18ccc99c-5a4d-4b89-bce0-2206c02c4bff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:19.881366 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-18ccc99c-5a4d-4b89-bce0-2206c02c4bff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:19.881808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-18ccc99c-5a4d-4b89-bce0-2206c02c4bff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:20.014623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-18ccc99c-5a4d-4b89-bce0-2206c02c4bff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:20.021951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-18ccc99c-5a4d-4b89-bce0-2206c02c4bff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1366 microversion: 2.1 time: 0.153632 Jul 14 16:19:20.022510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1547/2990] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:19 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:21.040631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-86202216-278d-4240-8bd3-4df90f96039c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:21.041263 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-86202216-278d-4240-8bd3-4df90f96039c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:21.047684 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-86202216-278d-4240-8bd3-4df90f96039c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:21.048143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-86202216-278d-4240-8bd3-4df90f96039c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:21.048905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-86202216-278d-4240-8bd3-4df90f96039c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:21.049345 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-86202216-278d-4240-8bd3-4df90f96039c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:21.185758 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-86202216-278d-4240-8bd3-4df90f96039c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:21.193583 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-86202216-278d-4240-8bd3-4df90f96039c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1366 microversion: 2.1 time: 0.157938 Jul 14 16:19:21.194143 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1444/2991] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:21 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:22.211764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ca36f4df-303b-434b-8408-baca77f16ce3 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:22.212555 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ca36f4df-303b-434b-8408-baca77f16ce3 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:22.214826 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=6 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:22.220144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ca36f4df-303b-434b-8408-baca77f16ce3 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:22.220587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ca36f4df-303b-434b-8408-baca77f16ce3 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:22.221337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ca36f4df-303b-434b-8408-baca77f16ce3 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:22.221764 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ca36f4df-303b-434b-8408-baca77f16ce3 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:22.356636 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ca36f4df-303b-434b-8408-baca77f16ce3 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:19:22.364031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ca36f4df-303b-434b-8408-baca77f16ce3 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1557 microversion: 2.1 time: 0.156129 Jul 14 16:19:22.364600 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1548/2992] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:19:22 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1557 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:19:22.381310 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-49dc9914-372d-4924-90f9-f6c31587af07 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:19:22.381818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-49dc9914-372d-4924-90f9-f6c31587af07 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:19:22.383819 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:22.385205 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=6 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:19:22.392833 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-49dc9914-372d-4924-90f9-f6c31587af07 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:22.393281 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-49dc9914-372d-4924-90f9-f6c31587af07 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:22.394055 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-49dc9914-372d-4924-90f9-f6c31587af07 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:22.394497 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-49dc9914-372d-4924-90f9-f6c31587af07 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:22.472067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-49dc9914-372d-4924-90f9-f6c31587af07 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.094560 Jul 14 16:19:22.472664 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1445/2993] 10.222.0.99 () {58 vars in 1274 bytes} [Thu Jul 14 16:19:22 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194/os-interface => generated 285 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:19:23.715984 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-f14a29af-add1-412d-a3c1-c0fb3fa596c6 req-f99cfc49-4b2a-4b15-89fd-49ee87538ff7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c1790591-bc73-4e04-ba8d-a52aadac6194", "tag": "1116daf0-65f7-4558-b38f-a510a32f447c"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:19:23.724502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-f14a29af-add1-412d-a3c1-c0fb3fa596c6 req-f99cfc49-4b2a-4b15-89fd-49ee87538ff7 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:19:23.724951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-f14a29af-add1-412d-a3c1-c0fb3fa596c6 req-f99cfc49-4b2a-4b15-89fd-49ee87538ff7 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:19:23.736342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-f14a29af-add1-412d-a3c1-c0fb3fa596c6 req-f99cfc49-4b2a-4b15-89fd-49ee87538ff7 service nova] Creating event network-changed:1116daf0-65f7-4558-b38f-a510a32f447c for instance c1790591-bc73-4e04-ba8d-a52aadac6194 on hv-cinder-82651 Jul 14 16:19:23.742362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-f14a29af-add1-412d-a3c1-c0fb3fa596c6 req-f99cfc49-4b2a-4b15-89fd-49ee87538ff7 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030721 Jul 14 16:19:23.742956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1549/2994] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:19:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:20:03.871578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:20:03.872282 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:20:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:20:07.437241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=27,nova_api:INSERT=3 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:07.438096 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=28 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:07.442334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-26675121-5f40-4f0e-b350-dc484efaf4b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:20:07.442867 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-26675121-5f40-4f0e-b350-dc484efaf4b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:20:07.450030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26675121-5f40-4f0e-b350-dc484efaf4b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:07.450513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26675121-5f40-4f0e-b350-dc484efaf4b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:07.451300 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26675121-5f40-4f0e-b350-dc484efaf4b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:07.452334 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-26675121-5f40-4f0e-b350-dc484efaf4b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:07.478491 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-26675121-5f40-4f0e-b350-dc484efaf4b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194/ips" status: 200 len: 151 microversion: 2.1 time: 0.043259 Jul 14 16:20:07.479071 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1446/2995] 10.222.0.99 () {58 vars in 1247 bytes} [Thu Jul 14 16:20:07 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:20:08.821483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:08.822238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=38 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:08.826563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d8951e08-072f-42ce-aca8-b9130f049310 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1006a622-81e5-455f-b824-11784f4c556b"}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:20:08.827974 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d8951e08-072f-42ce-aca8-b9130f049310 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:20:08.839068 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8951e08-072f-42ce-aca8-b9130f049310 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:08.839524 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8951e08-072f-42ce-aca8-b9130f049310 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:08.840321 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8951e08-072f-42ce-aca8-b9130f049310 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:08.840761 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d8951e08-072f-42ce-aca8-b9130f049310 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:09.081021 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d8951e08-072f-42ce-aca8-b9130f049310 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261042 Jul 14 16:20:09.081890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1550/2996] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 16:20:08 2022] POST /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:20:16.613050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f1393530-f422-454b-80b2-435eb538f16c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: .version_select at 0x7f35777ef9d0>, body: {"keypair": {"name": "tempest-keypair-864711499", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOxlT58/pCwdWeKyTtkxbH/JknrU5qLdhGGIL4OMQo8tcNCH0uEYOAzdcJrRWa8ard9eNTTomeCdk5ZasNNW+vzFjC8Dk5Tqjc0MrUbZu/Y0ZflqCJYL8e++bI0Bw1+APQ=="}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:20:16.628048 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-f1393530-f422-454b-80b2-435eb538f16c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for project c09479647ca24b63b744f3dd55111cb3. Resources: {'key_pairs'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:20:16.631879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-f1393530-f422-454b-80b2-435eb538f16c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for user b5dbfe771fbe4372951006b71082391a and project c09479647ca24b63b744f3dd55111cb3. Resources: {'key_pairs'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:20:16.658368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f1393530-f422-454b-80b2-435eb538f16c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.050045 Jul 14 16:20:16.658975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1447/2997] 10.222.0.99 () {60 vars in 1158 bytes} [Thu Jul 14 16:20:16 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:20:17.907400 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-795104117", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7e903e9-24ef-4d9c-a328-ca11ef2805b4"}], "security_groups": [{"name": "tempest-securitygroup--1860890827"}], "key_name": "tempest-keypair-864711499", "user_data": "}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:20:18.012129 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.network.neutron [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] validate_networks() for [('d7e903e9-24ef-4d9c-a328-ca11ef2805b4', None, None, None, None, None)] {{(pid=124503) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:20:18.438169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Flavor limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:20:18.438587 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Image limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:20:18.439060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Flavor pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:20:18.439475 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Image pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:20:18.439920 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:20:18.448762 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:18.449209 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:18.450001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:18.450434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:18.467166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for project c09479647ca24b63b744f3dd55111cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:20:18.471941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for user b5dbfe771fbe4372951006b71082391a and project c09479647ca24b63b744f3dd55111cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:20:18.482939 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Going to run 1 instances... {{(pid=124503) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:20:18.486110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124503) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:20:18.533177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-eb017273-7d66-4aa4-bf88-fc80eb725858 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.630926 Jul 14 16:20:18.533923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1551/2998] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 16:20:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 632 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:20:18.541014 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=4 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:18.546093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-98ace431-2b10-4225-9aec-2cfb4c09a99c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:20:18.547267 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-98ace431-2b10-4225-9aec-2cfb4c09a99c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:20:18.605652 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-98ace431-2b10-4225-9aec-2cfb4c09a99c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:20:18.614348 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-98ace431-2b10-4225-9aec-2cfb4c09a99c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 200 len: 1240 microversion: 2.1 time: 0.073796 Jul 14 16:20:18.615335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1448/2999] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:20:18 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 1240 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:20:19.632212 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-32cf44ce-2bca-42b9-9e4e-6f5262a9a7d5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:20:19.633500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-32cf44ce-2bca-42b9-9e4e-6f5262a9a7d5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:20:19.640054 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-32cf44ce-2bca-42b9-9e4e-6f5262a9a7d5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:19.641394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-32cf44ce-2bca-42b9-9e4e-6f5262a9a7d5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:19.642196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-32cf44ce-2bca-42b9-9e4e-6f5262a9a7d5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:19.642780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-32cf44ce-2bca-42b9-9e4e-6f5262a9a7d5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:19.709463 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-32cf44ce-2bca-42b9-9e4e-6f5262a9a7d5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:20:19.717285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-32cf44ce-2bca-42b9-9e4e-6f5262a9a7d5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 200 len: 1310 microversion: 2.1 time: 0.089588 Jul 14 16:20:19.717972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1552/3000] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:20:19 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:20:20.737073 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d79477be-bbef-4a38-a6c3-324cc6e18e92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:20:20.740174 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d79477be-bbef-4a38-a6c3-324cc6e18e92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:20:20.748775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d79477be-bbef-4a38-a6c3-324cc6e18e92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:20.749361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d79477be-bbef-4a38-a6c3-324cc6e18e92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:20.750628 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d79477be-bbef-4a38-a6c3-324cc6e18e92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:20.751261 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d79477be-bbef-4a38-a6c3-324cc6e18e92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:20.964287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d79477be-bbef-4a38-a6c3-324cc6e18e92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:20:20.971643 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d79477be-bbef-4a38-a6c3-324cc6e18e92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 200 len: 1366 microversion: 2.1 time: 0.241250 Jul 14 16:20:20.972223 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1449/3001] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:20:20 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:20:21.018569 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-16756a7e-ce7d-41f1-9fa0-c280a111cbe3 req-5929f9a5-7aa8-47ee-b5a1-3435519cd463 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a340d149-aa6e-4ab7-9d2e-a77a44d408a5", "tag": "1bde09d5-247f-49eb-af0c-7342dbb4673c"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:20:21.031750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-16756a7e-ce7d-41f1-9fa0-c280a111cbe3 req-5929f9a5-7aa8-47ee-b5a1-3435519cd463 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:21.032203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-16756a7e-ce7d-41f1-9fa0-c280a111cbe3 req-5929f9a5-7aa8-47ee-b5a1-3435519cd463 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:21.047448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-16756a7e-ce7d-41f1-9fa0-c280a111cbe3 req-5929f9a5-7aa8-47ee-b5a1-3435519cd463 service nova] Creating event network-changed:1bde09d5-247f-49eb-af0c-7342dbb4673c for instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 on hv-cinder-82651 Jul 14 16:20:21.053684 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-16756a7e-ce7d-41f1-9fa0-c280a111cbe3 req-5929f9a5-7aa8-47ee-b5a1-3435519cd463 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050378 Jul 14 16:20:21.054783 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1553/3002] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:20:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:20:21.989575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b9a14087-c540-4651-83c2-e39d0da1c71d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:20:21.990287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b9a14087-c540-4651-83c2-e39d0da1c71d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:20:21.996793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b9a14087-c540-4651-83c2-e39d0da1c71d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:21.997248 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b9a14087-c540-4651-83c2-e39d0da1c71d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:21.998020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b9a14087-c540-4651-83c2-e39d0da1c71d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:21.998466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b9a14087-c540-4651-83c2-e39d0da1c71d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:22.129947 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b9a14087-c540-4651-83c2-e39d0da1c71d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:20:22.137435 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b9a14087-c540-4651-83c2-e39d0da1c71d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 200 len: 1366 microversion: 2.1 time: 0.151788 Jul 14 16:20:22.138005 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1450/3003] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:20:21 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 1366 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:20:23.154931 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2932b6f8-eb6e-4d0a-bc6d-1f184371b115 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:20:23.156205 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2932b6f8-eb6e-4d0a-bc6d-1f184371b115 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:20:23.163182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2932b6f8-eb6e-4d0a-bc6d-1f184371b115 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:23.163645 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2932b6f8-eb6e-4d0a-bc6d-1f184371b115 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:23.164402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2932b6f8-eb6e-4d0a-bc6d-1f184371b115 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:23.164831 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2932b6f8-eb6e-4d0a-bc6d-1f184371b115 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:23.306837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2932b6f8-eb6e-4d0a-bc6d-1f184371b115 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:20:23.314483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2932b6f8-eb6e-4d0a-bc6d-1f184371b115 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 200 len: 1366 microversion: 2.1 time: 0.163762 Jul 14 16:20:23.315039 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1554/3004] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:20:23 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 1366 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:20:24.332191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-134ee5b6-efd0-4411-aaea-b0fb462bc071 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:20:24.332830 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-134ee5b6-efd0-4411-aaea-b0fb462bc071 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:20:24.339166 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-134ee5b6-efd0-4411-aaea-b0fb462bc071 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:24.339640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-134ee5b6-efd0-4411-aaea-b0fb462bc071 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:24.340406 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-134ee5b6-efd0-4411-aaea-b0fb462bc071 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:24.341102 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-134ee5b6-efd0-4411-aaea-b0fb462bc071 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:24.477912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-134ee5b6-efd0-4411-aaea-b0fb462bc071 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:20:24.485984 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-134ee5b6-efd0-4411-aaea-b0fb462bc071 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 200 len: 1366 microversion: 2.1 time: 0.158736 Jul 14 16:20:24.486558 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1451/3005] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:20:24 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:20:25.502427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7f501ad8-693b-467f-9e16-227be858c30b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:20:25.503125 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7f501ad8-693b-467f-9e16-227be858c30b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:20:25.509692 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f501ad8-693b-467f-9e16-227be858c30b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:25.510141 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f501ad8-693b-467f-9e16-227be858c30b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:25.510898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f501ad8-693b-467f-9e16-227be858c30b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:25.511334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7f501ad8-693b-467f-9e16-227be858c30b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:25.642824 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7f501ad8-693b-467f-9e16-227be858c30b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:20:25.650391 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7f501ad8-693b-467f-9e16-227be858c30b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 200 len: 1366 microversion: 2.1 time: 0.152425 Jul 14 16:20:25.650962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1555/3006] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:20:25 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:20:25.921826 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-5e199588-9131-48ab-b250-a695b7b769f9 req-8bab4d5b-6dcd-45cb-b299-b5c748bd4e2b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a340d149-aa6e-4ab7-9d2e-a77a44d408a5", "name": "network-vif-plugged", "status": "completed", "tag": "1bde09d5-247f-49eb-af0c-7342dbb4673c"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:20:25.931687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-5e199588-9131-48ab-b250-a695b7b769f9 req-8bab4d5b-6dcd-45cb-b299-b5c748bd4e2b service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:25.932381 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-5e199588-9131-48ab-b250-a695b7b769f9 req-8bab4d5b-6dcd-45cb-b299-b5c748bd4e2b service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:25.945898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-5e199588-9131-48ab-b250-a695b7b769f9 req-8bab4d5b-6dcd-45cb-b299-b5c748bd4e2b service nova] Creating event network-vif-plugged:1bde09d5-247f-49eb-af0c-7342dbb4673c for instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 on hv-cinder-82651 Jul 14 16:20:25.951356 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-5e199588-9131-48ab-b250-a695b7b769f9 req-8bab4d5b-6dcd-45cb-b299-b5c748bd4e2b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033115 Jul 14 16:20:25.952686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1452/3007] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:20:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:20:26.669038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-231a3292-bd12-4f1e-8900-277b646d4f36 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:20:26.669652 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-231a3292-bd12-4f1e-8900-277b646d4f36 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:20:26.676571 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-231a3292-bd12-4f1e-8900-277b646d4f36 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:26.677022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-231a3292-bd12-4f1e-8900-277b646d4f36 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:26.677785 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-231a3292-bd12-4f1e-8900-277b646d4f36 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:26.678512 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-231a3292-bd12-4f1e-8900-277b646d4f36 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:26.809567 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-231a3292-bd12-4f1e-8900-277b646d4f36 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:20:26.817729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-231a3292-bd12-4f1e-8900-277b646d4f36 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 200 len: 1366 microversion: 2.1 time: 0.152753 Jul 14 16:20:26.818295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1556/3008] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:20:26 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:20:27.835766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6264cb16-3937-49a8-9153-5a9e10e8ac22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:20:27.836460 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6264cb16-3937-49a8-9153-5a9e10e8ac22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:20:27.843339 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6264cb16-3937-49a8-9153-5a9e10e8ac22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:27.844377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6264cb16-3937-49a8-9153-5a9e10e8ac22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:27.845311 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6264cb16-3937-49a8-9153-5a9e10e8ac22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:27.845749 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6264cb16-3937-49a8-9153-5a9e10e8ac22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:27.982252 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6264cb16-3937-49a8-9153-5a9e10e8ac22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:20:27.990090 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6264cb16-3937-49a8-9153-5a9e10e8ac22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 200 len: 1556 microversion: 2.1 time: 0.158700 Jul 14 16:20:27.993866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1453/3009] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:20:27 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 1556 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:20:28.006657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f8773581-754b-4103-a656-2ef54218abf5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:20:28.007262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f8773581-754b-4103-a656-2ef54218abf5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:20:28.013530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8773581-754b-4103-a656-2ef54218abf5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:28.013975 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8773581-754b-4103-a656-2ef54218abf5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:28.014716 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8773581-754b-4103-a656-2ef54218abf5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:28.015663 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f8773581-754b-4103-a656-2ef54218abf5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:28.093990 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f8773581-754b-4103-a656-2ef54218abf5 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090910 Jul 14 16:20:28.094659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1557/3010] 10.222.0.99 () {58 vars in 1274 bytes} [Thu Jul 14 16:20:28 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:20:29.021687 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=6 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:20:29.095922 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-44a89dd5-b1b6-4277-bcc4-da94c114d7b5 req-d6080f7f-5926-473b-a848-c9320a0bac20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a340d149-aa6e-4ab7-9d2e-a77a44d408a5", "tag": "1bde09d5-247f-49eb-af0c-7342dbb4673c"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:20:29.107586 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-44a89dd5-b1b6-4277-bcc4-da94c114d7b5 req-d6080f7f-5926-473b-a848-c9320a0bac20 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:20:29.108067 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-44a89dd5-b1b6-4277-bcc4-da94c114d7b5 req-d6080f7f-5926-473b-a848-c9320a0bac20 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:20:29.120767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-44a89dd5-b1b6-4277-bcc4-da94c114d7b5 req-d6080f7f-5926-473b-a848-c9320a0bac20 service nova] Creating event network-changed:1bde09d5-247f-49eb-af0c-7342dbb4673c for instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 on hv-cinder-82651 Jul 14 16:20:29.126551 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-44a89dd5-b1b6-4277-bcc4-da94c114d7b5 req-d6080f7f-5926-473b-a848-c9320a0bac20 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.109306 Jul 14 16:20:29.127149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1454/3011] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:20:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:12.976398 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:12.977034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=6 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:12.978630 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:12.979324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=43,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:12.983525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fddb0bd3-6506-4f73-989c-864f9d049080 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:12.984093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-fddb0bd3-6506-4f73-989c-864f9d049080 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:12.993808 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fddb0bd3-6506-4f73-989c-864f9d049080 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:12.994262 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fddb0bd3-6506-4f73-989c-864f9d049080 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:12.995030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fddb0bd3-6506-4f73-989c-864f9d049080 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:12.995467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-fddb0bd3-6506-4f73-989c-864f9d049080 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:13.022906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fddb0bd3-6506-4f73-989c-864f9d049080 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5/ips" status: 200 len: 150 microversion: 2.1 time: 0.047532 Jul 14 16:21:13.023493 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1558/3012] 10.222.0.99 () {58 vars in 1247 bytes} [Thu Jul 14 16:21:12 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:13.031653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=29,nova_api:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:13.032391 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=28 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:13.037788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8a714d16-25f9-48e4-965e-c2e530babb96 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1006a622-81e5-455f-b824-11784f4c556b"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:13.038919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8a714d16-25f9-48e4-965e-c2e530babb96 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:13.046529 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a714d16-25f9-48e4-965e-c2e530babb96 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:13.046978 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a714d16-25f9-48e4-965e-c2e530babb96 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:13.047760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a714d16-25f9-48e4-965e-c2e530babb96 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:13.048194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8a714d16-25f9-48e4-965e-c2e530babb96 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:13.129805 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-8a714d16-25f9-48e4-965e-c2e530babb96 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Invalid volume: volume 1006a622-81e5-455f-b824-11784f4c556b is already attached to instances: c1790591-bc73-4e04-ba8d-a52aadac6194 Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8a714d16-25f9-48e4-965e-c2e530babb96 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: POST /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5/os-volume_attachments HTTP/1.1 Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 74 Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:21:13.132197 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:21:13.134075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:21:13.134075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:21:13.134075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:21:13.134075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:21:13.134075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:21:13.134075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:21:13.134075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:21:13.134075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:21:13.134075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:21:13.134075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Jul 14 16:21:13.134075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {"volumeAttachment": {"volumeId": "1006a622-81e5-455f-b824-11784f4c556b"}} Jul 14 16:21:13.134075 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Invalid volume: volume 1006a622-81e5-455f-b824-11784f4c556b is already attached to instances: c1790591-bc73-4e04-ba8d-a52aadac6194 Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'server_id': 'a340d149-aa6e-4ab7-9d2e-a77a44d408a5', 'body': {'volumeAttachment': {'volumeId': '1006a622-81e5-455f-b824-11784f4c556b'}}} Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1006a622-81e5-455f-b824-11784f4c556b is already attached to instances: c1790591-bc73-4e04-ba8d-a52aadac6194 Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:13.135260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1006a622-81e5-455f-b824-11784f4c556b is already attached to instances: c1790591-bc73-4e04-ba8d-a52aadac6194 Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:21:13.137212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:21:13.139455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:21:13.139455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:21:13.139455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:21:13.139455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1006a622-81e5-455f-b824-11784f4c556b is already attached to instances: c1790591-bc73-4e04-ba8d-a52aadac6194 Jul 14 16:21:13.139455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:13.139455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8a714d16-25f9-48e4-965e-c2e530babb96 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 400 to user: Invalid volume: volume 1006a622-81e5-455f-b824-11784f4c556b is already attached to instances: c1790591-bc73-4e04-ba8d-a52aadac6194 {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:21:13.139455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8a714d16-25f9-48e4-965e-c2e530babb96 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.103564 Jul 14 16:21:13.139455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1455/3013] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 16:21:13 2022] POST /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5/os-volume_attachments => generated 174 bytes in 105 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jul 14 16:21:13.152755 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-df93453e-da10-40bd-bf65-4dd4c679b62b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:13.153252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-df93453e-da10-40bd-bf65-4dd4c679b62b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:13.159756 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-df93453e-da10-40bd-bf65-4dd4c679b62b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:13.160214 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-df93453e-da10-40bd-bf65-4dd4c679b62b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:13.160967 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-df93453e-da10-40bd-bf65-4dd4c679b62b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:13.161406 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-df93453e-da10-40bd-bf65-4dd4c679b62b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:13.186574 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-df93453e-da10-40bd-bf65-4dd4c679b62b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Going to try to terminate instance {{(pid=124503) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:21:13.272921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-df93453e-da10-40bd-bf65-4dd4c679b62b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 204 len: 0 microversion: 2.1 time: 0.130959 Jul 14 16:21:13.273873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1559/3014] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:21:13 2022] DELETE /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:21:13.282692 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-878e8a00-33ac-414e-9a00-b560a23f38e7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:13.283304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-878e8a00-33ac-414e-9a00-b560a23f38e7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:13.291698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-878e8a00-33ac-414e-9a00-b560a23f38e7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:13.292160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-878e8a00-33ac-414e-9a00-b560a23f38e7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:13.292923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-878e8a00-33ac-414e-9a00-b560a23f38e7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:13.293366 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-878e8a00-33ac-414e-9a00-b560a23f38e7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:13.449878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-878e8a00-33ac-414e-9a00-b560a23f38e7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:13.458647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-878e8a00-33ac-414e-9a00-b560a23f38e7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 200 len: 1681 microversion: 2.1 time: 0.179882 Jul 14 16:21:13.459249 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1456/3015] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:13 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 1681 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:14.481717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9a614dd9-f0d5-44e3-8f66-1795045c53e4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:14.482615 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9a614dd9-f0d5-44e3-8f66-1795045c53e4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:14.490061 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a614dd9-f0d5-44e3-8f66-1795045c53e4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:14.490509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a614dd9-f0d5-44e3-8f66-1795045c53e4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:14.491265 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a614dd9-f0d5-44e3-8f66-1795045c53e4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:14.491734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9a614dd9-f0d5-44e3-8f66-1795045c53e4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:14.658441 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-9a614dd9-f0d5-44e3-8f66-1795045c53e4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:14.668777 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9a614dd9-f0d5-44e3-8f66-1795045c53e4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 200 len: 1681 microversion: 2.1 time: 0.191533 Jul 14 16:21:14.669376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1560/3016] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:14 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 1681 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:15.701359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fc8c9314-92ca-4074-b300-e870f9246714 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:15.701991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fc8c9314-92ca-4074-b300-e870f9246714 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:15.709717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fc8c9314-92ca-4074-b300-e870f9246714 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:15.710167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fc8c9314-92ca-4074-b300-e870f9246714 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:15.711000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fc8c9314-92ca-4074-b300-e870f9246714 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:15.711517 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fc8c9314-92ca-4074-b300-e870f9246714 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:15.828798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fc8c9314-92ca-4074-b300-e870f9246714 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:15.836424 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fc8c9314-92ca-4074-b300-e870f9246714 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 200 len: 1613 microversion: 2.1 time: 0.139179 Jul 14 16:21:15.837004 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1457/3017] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:15 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 1613 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:16.269362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-0065d694-f115-4449-996d-60b30957e056 req-519c1785-8fe1-4c1f-b068-59235bdd0be2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a340d149-aa6e-4ab7-9d2e-a77a44d408a5", "name": "network-vif-deleted", "tag": "1bde09d5-247f-49eb-af0c-7342dbb4673c"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:16.280939 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-0065d694-f115-4449-996d-60b30957e056 req-519c1785-8fe1-4c1f-b068-59235bdd0be2 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:16.281403 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-0065d694-f115-4449-996d-60b30957e056 req-519c1785-8fe1-4c1f-b068-59235bdd0be2 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:16.297136 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-0065d694-f115-4449-996d-60b30957e056 req-519c1785-8fe1-4c1f-b068-59235bdd0be2 service nova] Creating event network-vif-deleted:1bde09d5-247f-49eb-af0c-7342dbb4673c for instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 on hv-cinder-82651 Jul 14 16:21:16.303800 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-0065d694-f115-4449-996d-60b30957e056 req-519c1785-8fe1-4c1f-b068-59235bdd0be2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038560 Jul 14 16:21:16.305031 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1561/3018] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:21:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:16.854861 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e0a1f876-3829-484b-97cf-d89c5de93dc4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:16.855936 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e0a1f876-3829-484b-97cf-d89c5de93dc4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:16.863770 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0a1f876-3829-484b-97cf-d89c5de93dc4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:16.864370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0a1f876-3829-484b-97cf-d89c5de93dc4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:16.865406 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0a1f876-3829-484b-97cf-d89c5de93dc4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:16.866407 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0a1f876-3829-484b-97cf-d89c5de93dc4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:16.882357 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-e0a1f876-3829-484b-97cf-d89c5de93dc4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e0a1f876-3829-484b-97cf-d89c5de93dc4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 HTTP/1.1 Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:21:16.883980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:21:16.885814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:21:16.885814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:21:16.885814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:21:16.885814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:21:16.885814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:21:16.885814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:21:16.885814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:21:16.885814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:21:16.885814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:21:16.885814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:21:16.885814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:21:16.885814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'a340d149-aa6e-4ab7-9d2e-a77a44d408a5'} Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:21:16.886946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:21:16.889810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:16.891585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e0a1f876-3829-484b-97cf-d89c5de93dc4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 404 to user: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:21:16.891585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e0a1f876-3829-484b-97cf-d89c5de93dc4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 404 len: 111 microversion: 2.1 time: 0.035956 Jul 14 16:21:16.891585 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1458/3019] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:16 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:21:16.896518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-fdc0b988-ba94-48fb-a6f2-5bfb5d8a1f5e tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '.version_select at 0x7f357fede8b0>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:16.915251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-fdc0b988-ba94-48fb-a6f2-5bfb5d8a1f5e tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-864711499" status: 202 len: 0 microversion: 2.1 time: 0.023150 Jul 14 16:21:16.915989 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1562/3020] 10.222.0.99 () {58 vars in 1217 bytes} [Thu Jul 14 16:21:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-864711499 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:21:17.739218 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9b68fbe1-d83a-4d34-8465-61f37fd2ba1f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:17.739705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9b68fbe1-d83a-4d34-8465-61f37fd2ba1f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:17.745766 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b68fbe1-d83a-4d34-8465-61f37fd2ba1f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:17.746215 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b68fbe1-d83a-4d34-8465-61f37fd2ba1f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:17.746972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b68fbe1-d83a-4d34-8465-61f37fd2ba1f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:17.747412 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9b68fbe1-d83a-4d34-8465-61f37fd2ba1f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:17.833414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-9b68fbe1-d83a-4d34-8465-61f37fd2ba1f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lazy-loading 'services' on Instance uuid c1790591-bc73-4e04-ba8d-a52aadac6194 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:21:17.908132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9b68fbe1-d83a-4d34-8465-61f37fd2ba1f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194/os-volume_attachments/1006a622-81e5-455f-b824-11784f4c556b" status: 202 len: 0 microversion: 2.1 time: 0.172896 Jul 14 16:21:17.909875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1459/3021] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 16:21:17 2022] DELETE /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194/os-volume_attachments/1006a622-81e5-455f-b824-11784f4c556b => generated 0 bytes in 174 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jul 14 16:21:17.919390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8764e6cb-3b52-4931-9e30-b65bff7258a1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:17.920454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8764e6cb-3b52-4931-9e30-b65bff7258a1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:17.927252 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8764e6cb-3b52-4931-9e30-b65bff7258a1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:17.927745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8764e6cb-3b52-4931-9e30-b65bff7258a1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:17.928591 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8764e6cb-3b52-4931-9e30-b65bff7258a1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:17.929295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8764e6cb-3b52-4931-9e30-b65bff7258a1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:17.961530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8764e6cb-3b52-4931-9e30-b65bff7258a1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046601 Jul 14 16:21:17.962109 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1563/3022] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:21:17 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:18.974557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6869fd2a-7831-4a7f-9015-4440cbef7b92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:18.975655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6869fd2a-7831-4a7f-9015-4440cbef7b92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:18.981921 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6869fd2a-7831-4a7f-9015-4440cbef7b92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:18.982362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6869fd2a-7831-4a7f-9015-4440cbef7b92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:18.983113 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6869fd2a-7831-4a7f-9015-4440cbef7b92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:18.983544 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6869fd2a-7831-4a7f-9015-4440cbef7b92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:19.017141 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6869fd2a-7831-4a7f-9015-4440cbef7b92 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047859 Jul 14 16:21:19.017699 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1460/3023] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:21:18 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:21:19.077604 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2f2c7b36-aa6b-4295-9334-89581e24bf69 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:19.078149 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2f2c7b36-aa6b-4295-9334-89581e24bf69 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:19.085915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f2c7b36-aa6b-4295-9334-89581e24bf69 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:19.086371 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f2c7b36-aa6b-4295-9334-89581e24bf69 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:19.087144 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f2c7b36-aa6b-4295-9334-89581e24bf69 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:19.087613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f2c7b36-aa6b-4295-9334-89581e24bf69 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:19.120368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2f2c7b36-aa6b-4295-9334-89581e24bf69 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Going to try to terminate instance {{(pid=124503) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:21:19.201728 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2f2c7b36-aa6b-4295-9334-89581e24bf69 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 204 len: 0 microversion: 2.1 time: 0.127537 Jul 14 16:21:19.202575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1564/3024] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:21:19 2022] DELETE /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:21:19.211175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7566694-bdea-4315-87b4-b82b2a041537 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:19.211825 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d7566694-bdea-4315-87b4-b82b2a041537 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:19.217884 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7566694-bdea-4315-87b4-b82b2a041537 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:19.218335 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7566694-bdea-4315-87b4-b82b2a041537 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:19.219088 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7566694-bdea-4315-87b4-b82b2a041537 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:19.219530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7566694-bdea-4315-87b4-b82b2a041537 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:19.357980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d7566694-bdea-4315-87b4-b82b2a041537 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:19.365793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d7566694-bdea-4315-87b4-b82b2a041537 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1682 microversion: 2.1 time: 0.158486 Jul 14 16:21:19.366371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1461/3025] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:19 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1682 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:20.384598 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8fc75101-3f1d-4dec-b849-f7dd1ed6ec40 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:20.385189 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8fc75101-3f1d-4dec-b849-f7dd1ed6ec40 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:20.392099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8fc75101-3f1d-4dec-b849-f7dd1ed6ec40 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:20.392546 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8fc75101-3f1d-4dec-b849-f7dd1ed6ec40 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:20.394117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8fc75101-3f1d-4dec-b849-f7dd1ed6ec40 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:20.394560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-8fc75101-3f1d-4dec-b849-f7dd1ed6ec40 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:20.549613 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8fc75101-3f1d-4dec-b849-f7dd1ed6ec40 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:20.559458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8fc75101-3f1d-4dec-b849-f7dd1ed6ec40 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1682 microversion: 2.1 time: 0.178574 Jul 14 16:21:20.560085 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1565/3026] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:20 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1682 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:21.577698 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9d55433b-e282-4fbe-ab10-1fae21bb0dff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:21.578298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9d55433b-e282-4fbe-ab10-1fae21bb0dff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:21.585918 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9d55433b-e282-4fbe-ab10-1fae21bb0dff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:21.586378 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9d55433b-e282-4fbe-ab10-1fae21bb0dff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:21.587343 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9d55433b-e282-4fbe-ab10-1fae21bb0dff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:21.587814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9d55433b-e282-4fbe-ab10-1fae21bb0dff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:21.826771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-9d55433b-e282-4fbe-ab10-1fae21bb0dff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:21.834783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9d55433b-e282-4fbe-ab10-1fae21bb0dff tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 200 len: 1682 microversion: 2.1 time: 0.260947 Jul 14 16:21:21.835362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1462/3027] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:21 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 1682 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:22.208101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-df239955-45f7-4b2a-8c08-2eccc33f654c req-e8b82128-533e-429b-91ff-e291a37bcd55 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c1790591-bc73-4e04-ba8d-a52aadac6194", "name": "network-vif-deleted", "tag": "1116daf0-65f7-4558-b38f-a510a32f447c"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:22.223619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-df239955-45f7-4b2a-8c08-2eccc33f654c req-e8b82128-533e-429b-91ff-e291a37bcd55 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:22.224380 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-df239955-45f7-4b2a-8c08-2eccc33f654c req-e8b82128-533e-429b-91ff-e291a37bcd55 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:22.242526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-df239955-45f7-4b2a-8c08-2eccc33f654c req-e8b82128-533e-429b-91ff-e291a37bcd55 service nova] Creating event network-vif-deleted:1116daf0-65f7-4558-b38f-a510a32f447c for instance c1790591-bc73-4e04-ba8d-a52aadac6194 on hv-cinder-82651 Jul 14 16:21:22.248501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-df239955-45f7-4b2a-8c08-2eccc33f654c req-e8b82128-533e-429b-91ff-e291a37bcd55 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045984 Jul 14 16:21:22.249396 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1566/3028] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:21:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:22.852942 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6ecbf1cb-486e-4ccf-a650-64504617092d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:22.853565 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6ecbf1cb-486e-4ccf-a650-64504617092d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:22.860171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ecbf1cb-486e-4ccf-a650-64504617092d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:22.860627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ecbf1cb-486e-4ccf-a650-64504617092d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:22.861396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ecbf1cb-486e-4ccf-a650-64504617092d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:22.862410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6ecbf1cb-486e-4ccf-a650-64504617092d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:22.876373 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-6ecbf1cb-486e-4ccf-a650-64504617092d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6ecbf1cb-486e-4ccf-a650-64504617092d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 HTTP/1.1 Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:21:22.878630 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:21:22.880472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:21:22.880472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:21:22.880472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:21:22.880472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:21:22.880472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:21:22.880472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:21:22.880472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:21:22.880472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:21:22.880472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:21:22.880472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:21:22.880472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:21:22.880472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'c1790591-bc73-4e04-ba8d-a52aadac6194'} Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:21:22.881358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:21:22.882834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:21:22.884702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6ecbf1cb-486e-4ccf-a650-64504617092d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 404 to user: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:21:22.884702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6ecbf1cb-486e-4ccf-a650-64504617092d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 404 len: 111 microversion: 2.1 time: 0.031010 Jul 14 16:21:22.884702 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1463/3029] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:22 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:21:22.890698 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-aff98324-ec30-483f-9e7a-17037c909e3c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '.version_select at 0x7f357c1793a0>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:22.911945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-aff98324-ec30-483f-9e7a-17037c909e3c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-511405352" status: 202 len: 0 microversion: 2.1 time: 0.025448 Jul 14 16:21:22.912545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1567/3030] 10.222.0.99 () {58 vars in 1217 bytes} [Thu Jul 14 16:21:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-511405352 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:21:23.580431 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8708bf30-17cd-4c47-b57a-38e665ebbaf1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: .version_select at 0x7f35777698b0>, body: {"keypair": {"name": "tempest-keypair-329462040", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAHlpuiG7AXauoVImCF7iCjlyZ9eqH5wqkkZWsXJ80qFIWWoiJMM/6C1kraeoDTfVneShp3bJc/8jDtDcdUfWJ3iqDMo8XCz481yp+5tqp8+vxXisC4gZB7k8c6FzywROg=="}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:23.595039 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-8708bf30-17cd-4c47-b57a-38e665ebbaf1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for project c09479647ca24b63b744f3dd55111cb3. Resources: {'key_pairs'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:21:23.599570 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-8708bf30-17cd-4c47-b57a-38e665ebbaf1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for user b5dbfe771fbe4372951006b71082391a and project c09479647ca24b63b744f3dd55111cb3. Resources: {'key_pairs'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:21:23.621821 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8708bf30-17cd-4c47-b57a-38e665ebbaf1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045191 Jul 14 16:21:23.622436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1464/3031] 10.222.0.99 () {60 vars in 1158 bytes} [Thu Jul 14 16:21:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:25.235336 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1444997526", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7e903e9-24ef-4d9c-a328-ca11ef2805b4"}], "security_groups": [{"name": "tempest-securitygroup--348235982"}], "key_name": "tempest-keypair-329462040", "user_data": "}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:25.349454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.network.neutron [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] validate_networks() for [('d7e903e9-24ef-4d9c-a328-ca11ef2805b4', None, None, None, None, None)] {{(pid=124503) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:21:25.736273 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Flavor limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:21:25.736625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Image limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:21:25.737171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Flavor pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:21:25.737585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Image pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:21:25.738001 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:21:25.747836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:25.748278 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:25.749056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:25.749491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:25.766303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for project c09479647ca24b63b744f3dd55111cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:21:25.770979 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for user b5dbfe771fbe4372951006b71082391a and project c09479647ca24b63b744f3dd55111cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:21:25.782296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Going to run 1 instances... {{(pid=124503) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:21:25.784870 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124503) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:21:25.833425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dfad4603-d977-45c8-b645-324515568be1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.602444 Jul 14 16:21:25.834074 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1568/3032] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 16:21:25 2022] POST /compute/v2.1/servers => generated 401 bytes in 604 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:21:25.844568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8d7d1abd-fb8b-4659-aa1e-11b131cb3629 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:25.845188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8d7d1abd-fb8b-4659-aa1e-11b131cb3629 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:25.899200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-8d7d1abd-fb8b-4659-aa1e-11b131cb3629 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:25.906767 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8d7d1abd-fb8b-4659-aa1e-11b131cb3629 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 200 len: 1241 microversion: 2.1 time: 0.066541 Jul 14 16:21:25.907326 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1465/3033] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:25 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 1241 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:26.925718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2bc10dcb-2af0-49bb-a54e-e4035742b4fb tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:26.926369 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2bc10dcb-2af0-49bb-a54e-e4035742b4fb tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:26.934368 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2bc10dcb-2af0-49bb-a54e-e4035742b4fb tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:26.935284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2bc10dcb-2af0-49bb-a54e-e4035742b4fb tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:26.936312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2bc10dcb-2af0-49bb-a54e-e4035742b4fb tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:26.936818 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2bc10dcb-2af0-49bb-a54e-e4035742b4fb tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:27.012116 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2bc10dcb-2af0-49bb-a54e-e4035742b4fb tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:27.020783 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2bc10dcb-2af0-49bb-a54e-e4035742b4fb tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 200 len: 1299 microversion: 2.1 time: 0.100729 Jul 14 16:21:27.021365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1569/3034] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:26 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 1299 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:28.038571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c4f893c0-84f8-499d-b3cb-a5f44fee03ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:28.039188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c4f893c0-84f8-499d-b3cb-a5f44fee03ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:28.048105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c4f893c0-84f8-499d-b3cb-a5f44fee03ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:28.048569 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c4f893c0-84f8-499d-b3cb-a5f44fee03ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:28.049447 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c4f893c0-84f8-499d-b3cb-a5f44fee03ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:28.050219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c4f893c0-84f8-499d-b3cb-a5f44fee03ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:28.287203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c4f893c0-84f8-499d-b3cb-a5f44fee03ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:28.296504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c4f893c0-84f8-499d-b3cb-a5f44fee03ca tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 200 len: 1366 microversion: 2.1 time: 0.262118 Jul 14 16:21:28.297308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1466/3035] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:28 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 1366 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:28.307861 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-56a58a71-2fa8-4282-b414-6949b32ca9c4 req-d5acdc62-7fab-4f30-b403-84720ee9b240 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3436a5aa-587e-4efa-95f5-f1acae56f896", "tag": "5e3d32d2-30a8-4b54-b2f5-7681ff743e1c"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:28.317862 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-56a58a71-2fa8-4282-b414-6949b32ca9c4 req-d5acdc62-7fab-4f30-b403-84720ee9b240 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:28.318585 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-56a58a71-2fa8-4282-b414-6949b32ca9c4 req-d5acdc62-7fab-4f30-b403-84720ee9b240 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:28.332880 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-56a58a71-2fa8-4282-b414-6949b32ca9c4 req-d5acdc62-7fab-4f30-b403-84720ee9b240 service nova] Creating event network-changed:5e3d32d2-30a8-4b54-b2f5-7681ff743e1c for instance 3436a5aa-587e-4efa-95f5-f1acae56f896 on hv-cinder-82651 Jul 14 16:21:28.338170 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-56a58a71-2fa8-4282-b414-6949b32ca9c4 req-d5acdc62-7fab-4f30-b403-84720ee9b240 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034182 Jul 14 16:21:28.338836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1570/3036] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:21:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:29.315727 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ae324e09-6dcc-413d-8ae3-dd27d3793aa9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:29.316405 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ae324e09-6dcc-413d-8ae3-dd27d3793aa9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:29.322941 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ae324e09-6dcc-413d-8ae3-dd27d3793aa9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:29.323400 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ae324e09-6dcc-413d-8ae3-dd27d3793aa9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:29.324203 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ae324e09-6dcc-413d-8ae3-dd27d3793aa9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:29.324646 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ae324e09-6dcc-413d-8ae3-dd27d3793aa9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:29.458167 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ae324e09-6dcc-413d-8ae3-dd27d3793aa9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:29.465531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ae324e09-6dcc-413d-8ae3-dd27d3793aa9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 200 len: 1366 microversion: 2.1 time: 0.154400 Jul 14 16:21:29.466100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1467/3037] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:29 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:30.483394 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-33c50f9f-c4f8-43ba-8c57-38ec124718f2 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:30.484115 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-33c50f9f-c4f8-43ba-8c57-38ec124718f2 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:30.491057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-33c50f9f-c4f8-43ba-8c57-38ec124718f2 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:30.491500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-33c50f9f-c4f8-43ba-8c57-38ec124718f2 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:30.492284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-33c50f9f-c4f8-43ba-8c57-38ec124718f2 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:30.492722 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-33c50f9f-c4f8-43ba-8c57-38ec124718f2 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:30.626179 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-33c50f9f-c4f8-43ba-8c57-38ec124718f2 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:30.634815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-33c50f9f-c4f8-43ba-8c57-38ec124718f2 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 200 len: 1366 microversion: 2.1 time: 0.156187 Jul 14 16:21:30.635381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1571/3038] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:30 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:31.652074 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d7653bf3-1c54-410f-bf45-1955077e88b4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:31.652956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d7653bf3-1c54-410f-bf45-1955077e88b4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:31.659540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7653bf3-1c54-410f-bf45-1955077e88b4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:31.660025 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7653bf3-1c54-410f-bf45-1955077e88b4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:31.660816 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7653bf3-1c54-410f-bf45-1955077e88b4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:31.661255 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d7653bf3-1c54-410f-bf45-1955077e88b4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:31.801332 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d7653bf3-1c54-410f-bf45-1955077e88b4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:31.809325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d7653bf3-1c54-410f-bf45-1955077e88b4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 200 len: 1366 microversion: 2.1 time: 0.161113 Jul 14 16:21:31.809893 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1468/3039] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:31 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:32.360242 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-640f1e12-941c-432f-b581-56d4690b3044 req-31f9ed87-6f46-4249-a5a2-8e4e762f155c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3436a5aa-587e-4efa-95f5-f1acae56f896", "name": "network-vif-plugged", "status": "completed", "tag": "5e3d32d2-30a8-4b54-b2f5-7681ff743e1c"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:32.369804 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-640f1e12-941c-432f-b581-56d4690b3044 req-31f9ed87-6f46-4249-a5a2-8e4e762f155c service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:32.370244 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-640f1e12-941c-432f-b581-56d4690b3044 req-31f9ed87-6f46-4249-a5a2-8e4e762f155c service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:32.381486 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-640f1e12-941c-432f-b581-56d4690b3044 req-31f9ed87-6f46-4249-a5a2-8e4e762f155c service nova] Creating event network-vif-plugged:5e3d32d2-30a8-4b54-b2f5-7681ff743e1c for instance 3436a5aa-587e-4efa-95f5-f1acae56f896 on hv-cinder-82651 Jul 14 16:21:32.386187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-640f1e12-941c-432f-b581-56d4690b3044 req-31f9ed87-6f46-4249-a5a2-8e4e762f155c service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029648 Jul 14 16:21:32.386937 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1572/3040] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:21:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:32.826169 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4e03d2da-d4e9-458c-bb68-67b5de0e033c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:32.826788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4e03d2da-d4e9-458c-bb68-67b5de0e033c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:32.833962 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e03d2da-d4e9-458c-bb68-67b5de0e033c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:32.834414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e03d2da-d4e9-458c-bb68-67b5de0e033c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:32.835172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e03d2da-d4e9-458c-bb68-67b5de0e033c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:32.835633 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4e03d2da-d4e9-458c-bb68-67b5de0e033c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:32.972377 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4e03d2da-d4e9-458c-bb68-67b5de0e033c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:32.983621 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4e03d2da-d4e9-458c-bb68-67b5de0e033c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 200 len: 1366 microversion: 2.1 time: 0.161206 Jul 14 16:21:32.984199 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1469/3041] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:32 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:34.003269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-faf69168-5bcf-4842-bc69-8296d2d076a4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:34.004632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-faf69168-5bcf-4842-bc69-8296d2d076a4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:34.011200 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-faf69168-5bcf-4842-bc69-8296d2d076a4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:34.011676 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-faf69168-5bcf-4842-bc69-8296d2d076a4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:34.012432 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-faf69168-5bcf-4842-bc69-8296d2d076a4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:34.012879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-faf69168-5bcf-4842-bc69-8296d2d076a4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:34.145127 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-faf69168-5bcf-4842-bc69-8296d2d076a4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:34.152494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-faf69168-5bcf-4842-bc69-8296d2d076a4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 200 len: 1366 microversion: 2.1 time: 0.153939 Jul 14 16:21:34.153069 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1573/3042] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:33 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:35.169888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-45e7836d-4d3f-4f7c-a60a-246996b1267b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:35.170513 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-45e7836d-4d3f-4f7c-a60a-246996b1267b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:35.177974 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45e7836d-4d3f-4f7c-a60a-246996b1267b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:35.178441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45e7836d-4d3f-4f7c-a60a-246996b1267b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:35.179212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45e7836d-4d3f-4f7c-a60a-246996b1267b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:35.179938 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-45e7836d-4d3f-4f7c-a60a-246996b1267b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:35.312338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-45e7836d-4d3f-4f7c-a60a-246996b1267b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:21:35.320219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-45e7836d-4d3f-4f7c-a60a-246996b1267b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 200 len: 1556 microversion: 2.1 time: 0.154236 Jul 14 16:21:35.320783 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1470/3043] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:21:35 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 1556 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:21:35.336650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9c9295c3-65d9-45b7-8afb-116d5bf3f9d7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:21:35.337196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-9c9295c3-65d9-45b7-8afb-116d5bf3f9d7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:21:35.343494 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c9295c3-65d9-45b7-8afb-116d5bf3f9d7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:35.343982 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c9295c3-65d9-45b7-8afb-116d5bf3f9d7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:35.344731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c9295c3-65d9-45b7-8afb-116d5bf3f9d7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:35.345161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-9c9295c3-65d9-45b7-8afb-116d5bf3f9d7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:35.421584 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9c9295c3-65d9-45b7-8afb-116d5bf3f9d7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089220 Jul 14 16:21:35.422131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1574/3044] 10.222.0.99 () {58 vars in 1274 bytes} [Thu Jul 14 16:21:35 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:21:36.382078 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-e157ed97-35be-4851-872c-4a8301945a34 req-3b2b514e-af33-4c78-b8b9-23b749c1f95b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3436a5aa-587e-4efa-95f5-f1acae56f896", "tag": "5e3d32d2-30a8-4b54-b2f5-7681ff743e1c"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:21:36.385807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=6 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:21:36.392234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-e157ed97-35be-4851-872c-4a8301945a34 req-3b2b514e-af33-4c78-b8b9-23b749c1f95b service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:21:36.392719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-e157ed97-35be-4851-872c-4a8301945a34 req-3b2b514e-af33-4c78-b8b9-23b749c1f95b service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:21:36.403956 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-e157ed97-35be-4851-872c-4a8301945a34 req-3b2b514e-af33-4c78-b8b9-23b749c1f95b service nova] Creating event network-changed:5e3d32d2-30a8-4b54-b2f5-7681ff743e1c for instance 3436a5aa-587e-4efa-95f5-f1acae56f896 on hv-cinder-82651 Jul 14 16:21:36.408868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-e157ed97-35be-4851-872c-4a8301945a34 req-3b2b514e-af33-4c78-b8b9-23b749c1f95b service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031298 Jul 14 16:21:36.409457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1471/3045] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:21:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:21:48.913881 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:21:48.914859 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:21:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:22:20.193376 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:20.194231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=6 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:20.195745 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:20.196362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:20.200526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5a2525df-767c-4f4b-a3e5-6f035cf3e781 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:20.201023 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5a2525df-767c-4f4b-a3e5-6f035cf3e781 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:20.211530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a2525df-767c-4f4b-a3e5-6f035cf3e781 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:20.212006 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a2525df-767c-4f4b-a3e5-6f035cf3e781 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:20.212774 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a2525df-767c-4f4b-a3e5-6f035cf3e781 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:20.213213 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5a2525df-767c-4f4b-a3e5-6f035cf3e781 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:20.239291 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5a2525df-767c-4f4b-a3e5-6f035cf3e781 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/ips" status: 200 len: 150 microversion: 2.1 time: 0.046788 Jul 14 16:22:20.239963 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1575/3046] 10.222.0.99 () {58 vars in 1247 bytes} [Thu Jul 14 16:22:20 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/ips => generated 150 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:22:21.551549 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:21.552449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=81,nova_cell1:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:21.557214 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6519ed0b-34c3-453b-81b1-fe73352d4fd0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f427da78-88fc-46cc-8abc-2b5feb694557"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:22:21.558380 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6519ed0b-34c3-453b-81b1-fe73352d4fd0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:21.566091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6519ed0b-34c3-453b-81b1-fe73352d4fd0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:21.567359 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6519ed0b-34c3-453b-81b1-fe73352d4fd0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:21.568390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6519ed0b-34c3-453b-81b1-fe73352d4fd0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:21.568828 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6519ed0b-34c3-453b-81b1-fe73352d4fd0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:21.811286 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6519ed0b-34c3-453b-81b1-fe73352d4fd0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261711 Jul 14 16:22:21.811925 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1472/3047] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 16:22:21 2022] POST /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-volume_attachments => generated 194 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:22:29.309187 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2ca6e448-97b7-4c9c-a80b-1aa8ff4cd4a0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f427da78-88fc-46cc-8abc-2b5feb694557"}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:22:29.310251 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2ca6e448-97b7-4c9c-a80b-1aa8ff4cd4a0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:29.317059 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2ca6e448-97b7-4c9c-a80b-1aa8ff4cd4a0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:29.317514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2ca6e448-97b7-4c9c-a80b-1aa8ff4cd4a0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:29.318275 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2ca6e448-97b7-4c9c-a80b-1aa8ff4cd4a0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:29.318710 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2ca6e448-97b7-4c9c-a80b-1aa8ff4cd4a0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:29.397845 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-2ca6e448-97b7-4c9c-a80b-1aa8ff4cd4a0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Invalid volume: volume f427da78-88fc-46cc-8abc-2b5feb694557 is already attached to instances: 3436a5aa-587e-4efa-95f5-f1acae56f896 Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2ca6e448-97b7-4c9c-a80b-1aa8ff4cd4a0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: POST /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-volume_attachments HTTP/1.1 Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 74 Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:22:29.399590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:22:29.401561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:22:29.401561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:22:29.401561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:22:29.401561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:22:29.401561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:22:29.401561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:22:29.401561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:22:29.401561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:22:29.401561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:22:29.401561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Jul 14 16:22:29.401561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {"volumeAttachment": {"volumeId": "f427da78-88fc-46cc-8abc-2b5feb694557"}} Jul 14 16:22:29.401561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Invalid volume: volume f427da78-88fc-46cc-8abc-2b5feb694557 is already attached to instances: 3436a5aa-587e-4efa-95f5-f1acae56f896 Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'server_id': '3436a5aa-587e-4efa-95f5-f1acae56f896', 'body': {'volumeAttachment': {'volumeId': 'f427da78-88fc-46cc-8abc-2b5feb694557'}}} Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume f427da78-88fc-46cc-8abc-2b5feb694557 is already attached to instances: 3436a5aa-587e-4efa-95f5-f1acae56f896 Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:22:29.402504 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume f427da78-88fc-46cc-8abc-2b5feb694557 is already attached to instances: 3436a5aa-587e-4efa-95f5-f1acae56f896 Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:22:29.404683 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:22:29.406466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:22:29.406466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:22:29.406466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:22:29.406466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume f427da78-88fc-46cc-8abc-2b5feb694557 is already attached to instances: 3436a5aa-587e-4efa-95f5-f1acae56f896 Jul 14 16:22:29.406466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:22:29.406466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2ca6e448-97b7-4c9c-a80b-1aa8ff4cd4a0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 400 to user: Invalid volume: volume f427da78-88fc-46cc-8abc-2b5feb694557 is already attached to instances: 3436a5aa-587e-4efa-95f5-f1acae56f896 {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:22:29.406466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2ca6e448-97b7-4c9c-a80b-1aa8ff4cd4a0 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.096240 Jul 14 16:22:29.406466 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1576/3048] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 16:22:29 2022] POST /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-volume_attachments => generated 174 bytes in 97 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jul 14 16:22:29.463358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-146998ef-5d33-4e98-9648-1f780332b370 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:29.463912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-146998ef-5d33-4e98-9648-1f780332b370 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:29.470080 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-146998ef-5d33-4e98-9648-1f780332b370 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:29.470526 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-146998ef-5d33-4e98-9648-1f780332b370 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:29.471269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-146998ef-5d33-4e98-9648-1f780332b370 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:29.471732 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-146998ef-5d33-4e98-9648-1f780332b370 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:29.557089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-146998ef-5d33-4e98-9648-1f780332b370 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lazy-loading 'services' on Instance uuid 3436a5aa-587e-4efa-95f5-f1acae56f896 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:22:29.628394 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-146998ef-5d33-4e98-9648-1f780332b370 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-volume_attachments/f427da78-88fc-46cc-8abc-2b5feb694557" status: 202 len: 0 microversion: 2.1 time: 0.169837 Jul 14 16:22:29.628994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1473/3049] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 16:22:29 2022] DELETE /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-volume_attachments/f427da78-88fc-46cc-8abc-2b5feb694557 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:22:29.637536 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a69dbffb-80be-4347-b702-ee22cc794ca1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:29.638578 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a69dbffb-80be-4347-b702-ee22cc794ca1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:29.645723 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a69dbffb-80be-4347-b702-ee22cc794ca1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:29.646293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a69dbffb-80be-4347-b702-ee22cc794ca1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:29.647220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a69dbffb-80be-4347-b702-ee22cc794ca1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:29.647736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a69dbffb-80be-4347-b702-ee22cc794ca1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:29.681665 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a69dbffb-80be-4347-b702-ee22cc794ca1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048137 Jul 14 16:22:29.682231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1577/3050] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:22:29 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:22:30.694408 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c2e920a8-e08d-4a17-a488-121d222cfffa tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:30.695475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c2e920a8-e08d-4a17-a488-121d222cfffa tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:30.701748 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2e920a8-e08d-4a17-a488-121d222cfffa tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:30.702200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2e920a8-e08d-4a17-a488-121d222cfffa tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:30.702974 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2e920a8-e08d-4a17-a488-121d222cfffa tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:30.703413 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2e920a8-e08d-4a17-a488-121d222cfffa tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:30.734608 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c2e920a8-e08d-4a17-a488-121d222cfffa tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044939 Jul 14 16:22:30.735156 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1474/3051] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:22:30 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:22:30.794433 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-adaa5a86-ae1a-44b0-92f1-335d62cbadfd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:30.794952 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-adaa5a86-ae1a-44b0-92f1-335d62cbadfd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:30.802255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-adaa5a86-ae1a-44b0-92f1-335d62cbadfd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:30.802700 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-adaa5a86-ae1a-44b0-92f1-335d62cbadfd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:30.803447 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-adaa5a86-ae1a-44b0-92f1-335d62cbadfd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:30.803922 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-adaa5a86-ae1a-44b0-92f1-335d62cbadfd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:30.828476 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-adaa5a86-ae1a-44b0-92f1-335d62cbadfd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Going to try to terminate instance {{(pid=124503) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:22:30.903843 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-adaa5a86-ae1a-44b0-92f1-335d62cbadfd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 204 len: 0 microversion: 2.1 time: 0.112904 Jul 14 16:22:30.904658 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1578/3052] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:22:30 2022] DELETE /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:22:30.913579 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b8935066-c16c-4f18-8ac1-f9bc21b1e05b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:30.914219 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b8935066-c16c-4f18-8ac1-f9bc21b1e05b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:30.920376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8935066-c16c-4f18-8ac1-f9bc21b1e05b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:30.920814 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8935066-c16c-4f18-8ac1-f9bc21b1e05b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:30.921563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8935066-c16c-4f18-8ac1-f9bc21b1e05b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:30.921992 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b8935066-c16c-4f18-8ac1-f9bc21b1e05b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:31.057791 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b8935066-c16c-4f18-8ac1-f9bc21b1e05b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:31.065589 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b8935066-c16c-4f18-8ac1-f9bc21b1e05b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 200 len: 1681 microversion: 2.1 time: 0.156595 Jul 14 16:22:31.066149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1475/3053] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:30 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 1681 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:32.084805 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e499caab-6fa8-4aea-ae35-4956ebba031c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:32.085500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e499caab-6fa8-4aea-ae35-4956ebba031c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:32.091993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e499caab-6fa8-4aea-ae35-4956ebba031c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:32.092437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e499caab-6fa8-4aea-ae35-4956ebba031c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:32.093194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e499caab-6fa8-4aea-ae35-4956ebba031c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:32.093620 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e499caab-6fa8-4aea-ae35-4956ebba031c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:32.231586 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e499caab-6fa8-4aea-ae35-4956ebba031c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:32.239100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e499caab-6fa8-4aea-ae35-4956ebba031c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 200 len: 1681 microversion: 2.1 time: 0.159427 Jul 14 16:22:32.239696 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1579/3054] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:32 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 1681 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:33.256362 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-81cb51c7-e348-4778-97bb-8cccbedff5ea tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:33.257099 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-81cb51c7-e348-4778-97bb-8cccbedff5ea tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:33.263959 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81cb51c7-e348-4778-97bb-8cccbedff5ea tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:33.264410 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81cb51c7-e348-4778-97bb-8cccbedff5ea tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:33.265225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81cb51c7-e348-4778-97bb-8cccbedff5ea tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:33.265663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-81cb51c7-e348-4778-97bb-8cccbedff5ea tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:33.744788 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-81cb51c7-e348-4778-97bb-8cccbedff5ea tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:33.752230 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-81cb51c7-e348-4778-97bb-8cccbedff5ea tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 200 len: 1681 microversion: 2.1 time: 0.500341 Jul 14 16:22:33.752800 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1476/3055] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:33 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 1681 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:33.977312 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-890ed8d7-4e2c-41e9-b766-aa8e57a251bf req-28a95fdd-58c2-40a3-bda3-86f81fe2c6e0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3436a5aa-587e-4efa-95f5-f1acae56f896", "name": "network-vif-deleted", "tag": "5e3d32d2-30a8-4b54-b2f5-7681ff743e1c"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:22:34.005627 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-890ed8d7-4e2c-41e9-b766-aa8e57a251bf req-28a95fdd-58c2-40a3-bda3-86f81fe2c6e0 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:34.006268 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-890ed8d7-4e2c-41e9-b766-aa8e57a251bf req-28a95fdd-58c2-40a3-bda3-86f81fe2c6e0 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:34.022582 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-890ed8d7-4e2c-41e9-b766-aa8e57a251bf req-28a95fdd-58c2-40a3-bda3-86f81fe2c6e0 service nova] Creating event network-vif-deleted:5e3d32d2-30a8-4b54-b2f5-7681ff743e1c for instance 3436a5aa-587e-4efa-95f5-f1acae56f896 on hv-cinder-82651 Jul 14 16:22:34.027428 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-890ed8d7-4e2c-41e9-b766-aa8e57a251bf req-28a95fdd-58c2-40a3-bda3-86f81fe2c6e0 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054575 Jul 14 16:22:34.028525 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1580/3056] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:22:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:22:34.771237 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-20eb90e7-4214-4334-83ac-d01871a764d4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:34.771882 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-20eb90e7-4214-4334-83ac-d01871a764d4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:34.778534 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-20eb90e7-4214-4334-83ac-d01871a764d4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:34.778987 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-20eb90e7-4214-4334-83ac-d01871a764d4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:34.779798 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-20eb90e7-4214-4334-83ac-d01871a764d4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:34.780241 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-20eb90e7-4214-4334-83ac-d01871a764d4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:34.794563 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-20eb90e7-4214-4334-83ac-d01871a764d4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-20eb90e7-4214-4334-83ac-d01871a764d4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 HTTP/1.1 Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:22:34.796268 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:22:34.797464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:22:34.797464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:22:34.797464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:22:34.797464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:22:34.797464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:22:34.797464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:22:34.797464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:22:34.797464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:22:34.797464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:22:34.797464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:22:34.797464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:22:34.797464 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '3436a5aa-587e-4efa-95f5-f1acae56f896'} Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:22:34.798085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:22:34.798940 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:22:34.799740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-20eb90e7-4214-4334-83ac-d01871a764d4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 404 to user: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:22:34.799740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-20eb90e7-4214-4334-83ac-d01871a764d4 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 404 len: 111 microversion: 2.1 time: 0.031570 Jul 14 16:22:34.799740 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1477/3057] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:34 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:22:34.808146 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-eb3c0175-5cfe-4644-82ea-80ce642e3abc tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '.version_select at 0x7f3577646790>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:34.827055 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-eb3c0175-5cfe-4644-82ea-80ce642e3abc tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-329462040" status: 202 len: 0 microversion: 2.1 time: 0.023428 Jul 14 16:22:34.827660 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1581/3058] 10.222.0.99 () {58 vars in 1217 bytes} [Thu Jul 14 16:22:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-329462040 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:22:35.472220 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-83e459dd-3671-42b0-8ad4-e7456f432b5d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: .version_select at 0x7f357fdc4dc0>, body: {"keypair": {"name": "tempest-keypair-1386770674", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIr70+6JZFktCeeLd/fRZ0SI/r2a8B+nKxtt9tVKA7figNaz9MncElbv4Pp0EoWCHvY6F/nqIz/6iDqRuhRBFoo46KCUXOLXyYX8sfFfxOnAyQRi0W2kR8fFz0Cnp3mTmA=="}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:22:35.485911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-83e459dd-3671-42b0-8ad4-e7456f432b5d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for project c09479647ca24b63b744f3dd55111cb3. Resources: {'key_pairs'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:22:35.489695 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-83e459dd-3671-42b0-8ad4-e7456f432b5d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for user b5dbfe771fbe4372951006b71082391a and project c09479647ca24b63b744f3dd55111cb3. Resources: {'key_pairs'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:22:35.513428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-83e459dd-3671-42b0-8ad4-e7456f432b5d tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.045007 Jul 14 16:22:35.514017 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1478/3059] 10.222.0.99 () {60 vars in 1158 bytes} [Thu Jul 14 16:22:35 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:22:36.740323 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1093517082", "imageRef": "e6fe61a7-da90-4550-a26b-723d9a22ee0f", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "d7e903e9-24ef-4d9c-a328-ca11ef2805b4"}], "security_groups": [{"name": "tempest-securitygroup--1443370952"}], "key_name": "tempest-keypair-1386770674", "user_data": "}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:22:36.842436 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.network.neutron [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] validate_networks() for [('d7e903e9-24ef-4d9c-a328-ca11ef2805b4', None, None, None, None, None)] {{(pid=124503) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:22:37.210598 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Flavor limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:22:37.211014 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Image limits 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:22:37.211483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Flavor pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:22:37.211997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Image pref 0:0:0 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:22:37.212405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.virt.hardware [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124503) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:22:37.221182 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:37.221626 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:37.222405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:37.223439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:37.240426 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for project c09479647ca24b63b744f3dd55111cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:22:37.244341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Getting quotas for user b5dbfe771fbe4372951006b71082391a and project c09479647ca24b63b744f3dd55111cb3. Resources: {'instances', 'ram', 'cores'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:22:37.255956 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Going to run 1 instances... {{(pid=124503) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:22:37.258269 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='e6fe61a7-da90-4550-a26b-723d9a22ee0f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124503) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:22:37.304668 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7bca056e-ed7a-4869-957a-73a500167322 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.569991 Jul 14 16:22:37.305705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1582/3060] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 16:22:36 2022] POST /compute/v2.1/servers => generated 402 bytes in 571 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jul 14 16:22:37.316396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-361e2847-1c1f-4322-84c0-9e1bcf84ed5a tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:37.318168 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-361e2847-1c1f-4322-84c0-9e1bcf84ed5a tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:37.374804 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-361e2847-1c1f-4322-84c0-9e1bcf84ed5a tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:37.382312 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-361e2847-1c1f-4322-84c0-9e1bcf84ed5a tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1242 microversion: 2.1 time: 0.070504 Jul 14 16:22:37.382911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1479/3061] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:37 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:38.400883 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-c2b55305-5e1a-41dc-878c-aee26c97c95c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:38.401500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-c2b55305-5e1a-41dc-878c-aee26c97c95c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:38.455545 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-c2b55305-5e1a-41dc-878c-aee26c97c95c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:38.463435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-c2b55305-5e1a-41dc-878c-aee26c97c95c tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1242 microversion: 2.1 time: 0.067555 Jul 14 16:22:38.464034 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1583/3062] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:38 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1242 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:39.479953 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-056f5d95-c3f4-493a-a20f-8c155f633616 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:39.480571 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-056f5d95-c3f4-493a-a20f-8c155f633616 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:39.543259 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-056f5d95-c3f4-493a-a20f-8c155f633616 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:39.552428 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-056f5d95-c3f4-493a-a20f-8c155f633616 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1242 microversion: 2.1 time: 0.075557 Jul 14 16:22:39.561603 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1480/3063] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:39 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1242 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:40.571995 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-8f074932-a8c1-42a5-986f-a8e58c92d954 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:40.572898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-8f074932-a8c1-42a5-986f-a8e58c92d954 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:40.631971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-8f074932-a8c1-42a5-986f-a8e58c92d954 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:40.638610 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-8f074932-a8c1-42a5-986f-a8e58c92d954 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1242 microversion: 2.1 time: 0.071078 Jul 14 16:22:40.639381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1584/3064] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:40 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:41.656200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c2784bbc-f4bc-4fc3-9187-0c17a25d9f74 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:41.656846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c2784bbc-f4bc-4fc3-9187-0c17a25d9f74 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:41.664815 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2784bbc-f4bc-4fc3-9187-0c17a25d9f74 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:41.665266 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2784bbc-f4bc-4fc3-9187-0c17a25d9f74 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:41.666027 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2784bbc-f4bc-4fc3-9187-0c17a25d9f74 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:41.666465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c2784bbc-f4bc-4fc3-9187-0c17a25d9f74 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:41.730294 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c2784bbc-f4bc-4fc3-9187-0c17a25d9f74 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:41.737768 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c2784bbc-f4bc-4fc3-9187-0c17a25d9f74 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1246 microversion: 2.1 time: 0.085813 Jul 14 16:22:41.738387 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1481/3065] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:41 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1246 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:42.754926 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6dab724a-73aa-452a-b1be-f75aa65ddc23 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:42.755750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6dab724a-73aa-452a-b1be-f75aa65ddc23 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:42.763703 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6dab724a-73aa-452a-b1be-f75aa65ddc23 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:42.764148 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6dab724a-73aa-452a-b1be-f75aa65ddc23 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:42.764912 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6dab724a-73aa-452a-b1be-f75aa65ddc23 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:42.765344 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6dab724a-73aa-452a-b1be-f75aa65ddc23 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:42.828479 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6dab724a-73aa-452a-b1be-f75aa65ddc23 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:42.838203 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6dab724a-73aa-452a-b1be-f75aa65ddc23 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1300 microversion: 2.1 time: 0.087347 Jul 14 16:22:42.838790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1585/3066] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:42 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1300 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:43.809231 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-e64c52a9-106f-41c3-b4e6-9be9afff137c req-eaeb123a-4d51-4a68-bf20-d3a4571cf0d2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a70abd3-ffdf-4b14-a6ce-1af15babe43f", "tag": "60595072-8bfc-42f8-8e9e-af37032ae5b3"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:22:43.831970 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-e64c52a9-106f-41c3-b4e6-9be9afff137c req-eaeb123a-4d51-4a68-bf20-d3a4571cf0d2 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:43.833015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-e64c52a9-106f-41c3-b4e6-9be9afff137c req-eaeb123a-4d51-4a68-bf20-d3a4571cf0d2 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:43.846793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-e64c52a9-106f-41c3-b4e6-9be9afff137c req-eaeb123a-4d51-4a68-bf20-d3a4571cf0d2 service nova] Creating event network-changed:60595072-8bfc-42f8-8e9e-af37032ae5b3 for instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f on hv-cinder-82651 Jul 14 16:22:43.853761 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-e64c52a9-106f-41c3-b4e6-9be9afff137c req-eaeb123a-4d51-4a68-bf20-d3a4571cf0d2 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053494 Jul 14 16:22:43.854873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1482/3067] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:22:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:22:43.855775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d521a7da-509a-4b39-b5a6-756ecbf23da1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:43.856548 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d521a7da-509a-4b39-b5a6-756ecbf23da1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:43.863139 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d521a7da-509a-4b39-b5a6-756ecbf23da1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:43.864443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d521a7da-509a-4b39-b5a6-756ecbf23da1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:43.865407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d521a7da-509a-4b39-b5a6-756ecbf23da1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:43.865877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d521a7da-509a-4b39-b5a6-756ecbf23da1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:44.015325 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-d521a7da-509a-4b39-b5a6-756ecbf23da1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:44.023874 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d521a7da-509a-4b39-b5a6-756ecbf23da1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1368 microversion: 2.1 time: 0.172614 Jul 14 16:22:44.024454 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1586/3068] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:43 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1368 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:22:45.041872 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-cbaa59de-9858-440a-b700-f8e2cc05ebe7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:45.042572 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-cbaa59de-9858-440a-b700-f8e2cc05ebe7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:45.049309 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cbaa59de-9858-440a-b700-f8e2cc05ebe7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:45.049762 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cbaa59de-9858-440a-b700-f8e2cc05ebe7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:45.050511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cbaa59de-9858-440a-b700-f8e2cc05ebe7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:45.050946 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-cbaa59de-9858-440a-b700-f8e2cc05ebe7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:45.196897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-cbaa59de-9858-440a-b700-f8e2cc05ebe7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:45.204619 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-cbaa59de-9858-440a-b700-f8e2cc05ebe7 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1368 microversion: 2.1 time: 0.166950 Jul 14 16:22:45.205194 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1483/3069] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:45 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1368 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:46.222996 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-25ee0066-c0a1-4017-8d48-a2e49f055d42 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:46.224825 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-25ee0066-c0a1-4017-8d48-a2e49f055d42 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:46.234246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-25ee0066-c0a1-4017-8d48-a2e49f055d42 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:46.234693 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-25ee0066-c0a1-4017-8d48-a2e49f055d42 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:46.235457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-25ee0066-c0a1-4017-8d48-a2e49f055d42 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:46.235987 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-25ee0066-c0a1-4017-8d48-a2e49f055d42 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:46.394036 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-25ee0066-c0a1-4017-8d48-a2e49f055d42 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:46.406130 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-25ee0066-c0a1-4017-8d48-a2e49f055d42 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1368 microversion: 2.1 time: 0.188087 Jul 14 16:22:46.406927 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1587/3070] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:46 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:47.424865 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-6c270ff6-a162-408d-96bd-6602b2e76a16 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:47.425575 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-6c270ff6-a162-408d-96bd-6602b2e76a16 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:47.433862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c270ff6-a162-408d-96bd-6602b2e76a16 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:47.434315 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c270ff6-a162-408d-96bd-6602b2e76a16 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:47.435095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c270ff6-a162-408d-96bd-6602b2e76a16 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:47.436531 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-6c270ff6-a162-408d-96bd-6602b2e76a16 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:47.600472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-6c270ff6-a162-408d-96bd-6602b2e76a16 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:47.608388 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-6c270ff6-a162-408d-96bd-6602b2e76a16 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1368 microversion: 2.1 time: 0.188161 Jul 14 16:22:47.609021 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1484/3071] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:47 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1368 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:48.626257 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-cdd7bdc5-d274-4775-9c7f-2bcc17ee8ce6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:48.626872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-cdd7bdc5-d274-4775-9c7f-2bcc17ee8ce6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:48.629583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:48.635936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cdd7bdc5-d274-4775-9c7f-2bcc17ee8ce6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:48.636390 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cdd7bdc5-d274-4775-9c7f-2bcc17ee8ce6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:48.637225 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cdd7bdc5-d274-4775-9c7f-2bcc17ee8ce6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:48.638012 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-cdd7bdc5-d274-4775-9c7f-2bcc17ee8ce6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:48.773333 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-51c0b385-4727-4c09-be53-082e877c0cfb req-a5f6774d-24b7-40d3-a6f4-a5325471eca8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a70abd3-ffdf-4b14-a6ce-1af15babe43f", "name": "network-vif-plugged", "status": "completed", "tag": "60595072-8bfc-42f8-8e9e-af37032ae5b3"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:22:48.776193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-cdd7bdc5-d274-4775-9c7f-2bcc17ee8ce6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:48.783059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-51c0b385-4727-4c09-be53-082e877c0cfb req-a5f6774d-24b7-40d3-a6f4-a5325471eca8 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:48.783454 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-51c0b385-4727-4c09-be53-082e877c0cfb req-a5f6774d-24b7-40d3-a6f4-a5325471eca8 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:48.784541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-cdd7bdc5-d274-4775-9c7f-2bcc17ee8ce6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1368 microversion: 2.1 time: 0.162082 Jul 14 16:22:48.788941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1588/3072] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:48 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1368 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:48.797020 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-51c0b385-4727-4c09-be53-082e877c0cfb req-a5f6774d-24b7-40d3-a6f4-a5325471eca8 service nova] Creating event network-vif-plugged:60595072-8bfc-42f8-8e9e-af37032ae5b3 for instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f on hv-cinder-82651 Jul 14 16:22:48.803105 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-51c0b385-4727-4c09-be53-082e877c0cfb req-a5f6774d-24b7-40d3-a6f4-a5325471eca8 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036147 Jul 14 16:22:48.803738 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1485/3073] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:22:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:22:49.802365 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-27e81126-8c8d-4caa-839f-744b1fff4b67 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:49.802879 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-27e81126-8c8d-4caa-839f-744b1fff4b67 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:49.809671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27e81126-8c8d-4caa-839f-744b1fff4b67 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:49.810111 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27e81126-8c8d-4caa-839f-744b1fff4b67 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:49.810856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27e81126-8c8d-4caa-839f-744b1fff4b67 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:49.811285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27e81126-8c8d-4caa-839f-744b1fff4b67 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:49.945457 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-27e81126-8c8d-4caa-839f-744b1fff4b67 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:49.952898 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-27e81126-8c8d-4caa-839f-744b1fff4b67 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1368 microversion: 2.1 time: 0.154456 Jul 14 16:22:49.953469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1589/3074] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:49 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1368 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:50.967697 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=8 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:50.972198 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-7347837e-bb4d-4c1e-b9ac-1bcdd53ededd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:50.972902 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-7347837e-bb4d-4c1e-b9ac-1bcdd53ededd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:50.980001 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7347837e-bb4d-4c1e-b9ac-1bcdd53ededd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:50.980463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7347837e-bb4d-4c1e-b9ac-1bcdd53ededd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:50.981234 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7347837e-bb4d-4c1e-b9ac-1bcdd53ededd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:50.981674 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-7347837e-bb4d-4c1e-b9ac-1bcdd53ededd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:51.117437 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-7347837e-bb4d-4c1e-b9ac-1bcdd53ededd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:22:51.124868 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-7347837e-bb4d-4c1e-b9ac-1bcdd53ededd tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1558 microversion: 2.1 time: 0.158240 Jul 14 16:22:51.125445 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1486/3075] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:22:50 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1558 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:22:51.141459 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-5ce8b0f8-2dab-4997-b827-303b08a944b1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:22:51.141943 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-5ce8b0f8-2dab-4997-b827-303b08a944b1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:22:51.144959 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=10 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:51.146625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:51.151629 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ce8b0f8-2dab-4997-b827-303b08a944b1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:51.152140 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ce8b0f8-2dab-4997-b827-303b08a944b1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:51.153194 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ce8b0f8-2dab-4997-b827-303b08a944b1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:51.153639 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-5ce8b0f8-2dab-4997-b827-303b08a944b1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:51.156965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=71,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:51.240875 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-5ce8b0f8-2dab-4997-b827-303b08a944b1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.102879 Jul 14 16:22:51.241514 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1590/3076] 10.222.0.99 () {58 vars in 1274 bytes} [Thu Jul 14 16:22:51 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f/os-interface => generated 284 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:22:52.429112 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-206b0f60-c6df-415c-adf9-e6b695277b0a req-ae1aef82-fc87-46f1-91dc-40b921f10195 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3a70abd3-ffdf-4b14-a6ce-1af15babe43f", "tag": "60595072-8bfc-42f8-8e9e-af37032ae5b3"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:22:52.433209 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:52.439292 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-206b0f60-c6df-415c-adf9-e6b695277b0a req-ae1aef82-fc87-46f1-91dc-40b921f10195 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:22:52.439780 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-206b0f60-c6df-415c-adf9-e6b695277b0a req-ae1aef82-fc87-46f1-91dc-40b921f10195 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:22:52.444491 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=69,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:22:52.453170 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-206b0f60-c6df-415c-adf9-e6b695277b0a req-ae1aef82-fc87-46f1-91dc-40b921f10195 service nova] Creating event network-changed:60595072-8bfc-42f8-8e9e-af37032ae5b3 for instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f on hv-cinder-82651 Jul 14 16:22:52.458626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-206b0f60-c6df-415c-adf9-e6b695277b0a req-ae1aef82-fc87-46f1-91dc-40b921f10195 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033051 Jul 14 16:22:52.459775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1487/3077] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:22:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:28.563328 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:28.564095 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:28.568174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a61a4cac-0b54-465c-98fb-67d6940236a6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:28.568671 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a61a4cac-0b54-465c-98fb-67d6940236a6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:28.576192 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a61a4cac-0b54-465c-98fb-67d6940236a6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:28.576647 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a61a4cac-0b54-465c-98fb-67d6940236a6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:28.577407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a61a4cac-0b54-465c-98fb-67d6940236a6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:28.577844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a61a4cac-0b54-465c-98fb-67d6940236a6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:28.601383 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a61a4cac-0b54-465c-98fb-67d6940236a6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f/ips" status: 200 len: 150 microversion: 2.1 time: 0.039433 Jul 14 16:23:28.601955 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1591/3078] 10.222.0.99 () {58 vars in 1247 bytes} [Thu Jul 14 16:23:28 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:29.940422 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:29.945284 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c0221434-7f61-4df1-9097-952d5eee0616 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f39eecf-1881-44f9-80e3-b3e63ef57f80"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:23:29.946429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c0221434-7f61-4df1-9097-952d5eee0616 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:29.954136 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0221434-7f61-4df1-9097-952d5eee0616 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:29.954591 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0221434-7f61-4df1-9097-952d5eee0616 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:29.955358 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0221434-7f61-4df1-9097-952d5eee0616 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:29.955832 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c0221434-7f61-4df1-9097-952d5eee0616 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:30.208629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c0221434-7f61-4df1-9097-952d5eee0616 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "POST /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.269610 Jul 14 16:23:30.209346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1488/3079] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 16:23:29 2022] POST /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f/os-volume_attachments => generated 194 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:37.819043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-87df51c2-809c-47da-b4a2-693d2e9a9095 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:37.820316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-87df51c2-809c-47da-b4a2-693d2e9a9095 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:37.826852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-87df51c2-809c-47da-b4a2-693d2e9a9095 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:37.827305 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-87df51c2-809c-47da-b4a2-693d2e9a9095 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:37.828126 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-87df51c2-809c-47da-b4a2-693d2e9a9095 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:37.828560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-87df51c2-809c-47da-b4a2-693d2e9a9095 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:37.915450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-87df51c2-809c-47da-b4a2-693d2e9a9095 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lazy-loading 'services' on Instance uuid 3a70abd3-ffdf-4b14-a6ce-1af15babe43f {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:23:37.993324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-87df51c2-809c-47da-b4a2-693d2e9a9095 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f/os-volume_attachments/5f39eecf-1881-44f9-80e3-b3e63ef57f80" status: 202 len: 0 microversion: 2.1 time: 0.178114 Jul 14 16:23:37.993973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1592/3080] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 16:23:37 2022] DELETE /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f/os-volume_attachments/5f39eecf-1881-44f9-80e3-b3e63ef57f80 => generated 0 bytes in 180 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:23:38.003465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b7df3e28-530a-427a-aee7-502d6eceaf68 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:38.004568 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b7df3e28-530a-427a-aee7-502d6eceaf68 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:38.011841 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7df3e28-530a-427a-aee7-502d6eceaf68 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:38.012306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7df3e28-530a-427a-aee7-502d6eceaf68 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:38.013082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7df3e28-530a-427a-aee7-502d6eceaf68 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:38.013536 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b7df3e28-530a-427a-aee7-502d6eceaf68 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:38.047478 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b7df3e28-530a-427a-aee7-502d6eceaf68 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048833 Jul 14 16:23:38.048304 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1489/3081] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:23:37 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:23:39.061656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2f357589-4dd5-430b-be66-27723e452268 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:39.062625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2f357589-4dd5-430b-be66-27723e452268 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:39.069783 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f357589-4dd5-430b-be66-27723e452268 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:39.070324 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f357589-4dd5-430b-be66-27723e452268 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:39.071088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f357589-4dd5-430b-be66-27723e452268 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:39.071526 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f357589-4dd5-430b-be66-27723e452268 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:39.101833 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2f357589-4dd5-430b-be66-27723e452268 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045450 Jul 14 16:23:39.102407 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1593/3082] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:23:39 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:23:39.163991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d6acfd27-3659-431a-982f-299423cd583b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:39.164717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d6acfd27-3659-431a-982f-299423cd583b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:39.171211 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d6acfd27-3659-431a-982f-299423cd583b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:39.171705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d6acfd27-3659-431a-982f-299423cd583b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:39.172466 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d6acfd27-3659-431a-982f-299423cd583b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:39.172907 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d6acfd27-3659-431a-982f-299423cd583b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:39.201368 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d6acfd27-3659-431a-982f-299423cd583b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:23:39.275232 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d6acfd27-3659-431a-982f-299423cd583b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 204 len: 0 microversion: 2.1 time: 0.114829 Jul 14 16:23:39.275896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1490/3083] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:23:39 2022] DELETE /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:23:39.284543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-605378ea-afc8-4897-a2ea-ec9a90570e30 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:39.285154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-605378ea-afc8-4897-a2ea-ec9a90570e30 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:39.291239 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-605378ea-afc8-4897-a2ea-ec9a90570e30 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:39.291718 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-605378ea-afc8-4897-a2ea-ec9a90570e30 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:39.292469 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-605378ea-afc8-4897-a2ea-ec9a90570e30 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:39.292900 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-605378ea-afc8-4897-a2ea-ec9a90570e30 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:39.426921 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-605378ea-afc8-4897-a2ea-ec9a90570e30 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:23:39.435877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-605378ea-afc8-4897-a2ea-ec9a90570e30 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1683 microversion: 2.1 time: 0.155437 Jul 14 16:23:39.436450 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1594/3084] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:39 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1683 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:23:40.454204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3ad548b4-3cf9-4e84-9213-15d8a742ad09 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:40.454932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3ad548b4-3cf9-4e84-9213-15d8a742ad09 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:40.462187 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3ad548b4-3cf9-4e84-9213-15d8a742ad09 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:40.462638 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3ad548b4-3cf9-4e84-9213-15d8a742ad09 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:40.463399 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3ad548b4-3cf9-4e84-9213-15d8a742ad09 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:40.463897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3ad548b4-3cf9-4e84-9213-15d8a742ad09 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:40.595948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-3ad548b4-3cf9-4e84-9213-15d8a742ad09 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:23:40.603566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3ad548b4-3cf9-4e84-9213-15d8a742ad09 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1683 microversion: 2.1 time: 0.153571 Jul 14 16:23:40.604159 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1491/3085] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:40 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1683 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:23:41.622078 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-402530ef-7b53-4512-b9a4-403569fbda22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:41.622701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-402530ef-7b53-4512-b9a4-403569fbda22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:41.629674 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-402530ef-7b53-4512-b9a4-403569fbda22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:41.630133 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-402530ef-7b53-4512-b9a4-403569fbda22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:41.630911 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-402530ef-7b53-4512-b9a4-403569fbda22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:41.632010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-402530ef-7b53-4512-b9a4-403569fbda22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:41.776906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-402530ef-7b53-4512-b9a4-403569fbda22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:23:41.784894 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-402530ef-7b53-4512-b9a4-403569fbda22 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1683 microversion: 2.1 time: 0.167342 Jul 14 16:23:41.785491 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1595/3086] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:41 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1683 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:23:42.350191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-4fd1f232-d5ee-4d3c-81e6-315717322bc2 req-cc567d1a-ef46-49ac-81ec-ea1c33a5eb05 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3a70abd3-ffdf-4b14-a6ce-1af15babe43f", "name": "network-vif-deleted", "tag": "60595072-8bfc-42f8-8e9e-af37032ae5b3"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:23:42.374449 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-4fd1f232-d5ee-4d3c-81e6-315717322bc2 req-cc567d1a-ef46-49ac-81ec-ea1c33a5eb05 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:42.374911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-4fd1f232-d5ee-4d3c-81e6-315717322bc2 req-cc567d1a-ef46-49ac-81ec-ea1c33a5eb05 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:42.389049 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-4fd1f232-d5ee-4d3c-81e6-315717322bc2 req-cc567d1a-ef46-49ac-81ec-ea1c33a5eb05 service nova] Creating event network-vif-deleted:60595072-8bfc-42f8-8e9e-af37032ae5b3 for instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f on hv-cinder-82651 Jul 14 16:23:42.394640 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-4fd1f232-d5ee-4d3c-81e6-315717322bc2 req-cc567d1a-ef46-49ac-81ec-ea1c33a5eb05 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048307 Jul 14 16:23:42.395911 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1492/3087] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:23:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:42.802793 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-e42e7cb7-7db4-4780-b300-059bd4ff7dd8 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:42.804226 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-e42e7cb7-7db4-4780-b300-059bd4ff7dd8 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:42.811544 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e42e7cb7-7db4-4780-b300-059bd4ff7dd8 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:42.812402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e42e7cb7-7db4-4780-b300-059bd4ff7dd8 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:42.813427 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e42e7cb7-7db4-4780-b300-059bd4ff7dd8 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:42.813924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e42e7cb7-7db4-4780-b300-059bd4ff7dd8 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:42.849735 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e42e7cb7-7db4-4780-b300-059bd4ff7dd8 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:42.851230 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-e42e7cb7-7db4-4780-b300-059bd4ff7dd8 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:42.852016 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.objects.instance [None req-e42e7cb7-7db4-4780-b300-059bd4ff7dd8 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lazy-loading 'fault' on Instance uuid 3a70abd3-ffdf-4b14-a6ce-1af15babe43f {{(pid=124503) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:23:42.900792 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-e42e7cb7-7db4-4780-b300-059bd4ff7dd8 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b5dbfe771fbe4372951006b71082391a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c09479647ca24b63b744f3dd55111cb3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:23:42.911435 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-e42e7cb7-7db4-4780-b300-059bd4ff7dd8 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 200 len: 1332 microversion: 2.1 time: 0.113079 Jul 14 16:23:42.923220 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1596/3088] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:42 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 1332 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:23:43.932756 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4233d1e2-2b0e-4652-9bee-568e24a775d9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:43.933469 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4233d1e2-2b0e-4652-9bee-568e24a775d9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:43.940202 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4233d1e2-2b0e-4652-9bee-568e24a775d9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:43.940653 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4233d1e2-2b0e-4652-9bee-568e24a775d9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:43.941463 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4233d1e2-2b0e-4652-9bee-568e24a775d9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:43.941905 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4233d1e2-2b0e-4652-9bee-568e24a775d9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:43.955685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-4233d1e2-2b0e-4652-9bee-568e24a775d9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4233d1e2-2b0e-4652-9bee-568e24a775d9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f HTTP/1.1 Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:23:43.957355 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:23:43.958626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:23:43.958626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:43.958626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:43.958626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:43.958626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:43.958626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:23:43.958626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:23:43.958626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:23:43.958626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:43.958626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:23:43.958626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:43.958626 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '3a70abd3-ffdf-4b14-a6ce-1af15babe43f'} Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:23:43.959365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:43.960871 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:43.961901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4233d1e2-2b0e-4652-9bee-568e24a775d9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 404 to user: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:23:43.961901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4233d1e2-2b0e-4652-9bee-568e24a775d9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 404 len: 111 microversion: 2.1 time: 0.031862 Jul 14 16:23:43.961901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1493/3089] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:43 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:43.967848 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6c0c4134-e280-4a44-8016-5f718c0d411b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '.version_select at 0x7f357ff57310>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:43.987117 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6c0c4134-e280-4a44-8016-5f718c0d411b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386770674" status: 202 len: 0 microversion: 2.1 time: 0.023093 Jul 14 16:23:43.987896 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1597/3090] 10.222.0.99 () {58 vars in 1220 bytes} [Thu Jul 14 16:23:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1386770674 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:23:45.740258 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3cddef6d-591f-4416-bfd6-62f5532fe932 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:45.740790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-3cddef6d-591f-4416-bfd6-62f5532fe932 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:45.748411 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3cddef6d-591f-4416-bfd6-62f5532fe932 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:45.748862 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3cddef6d-591f-4416-bfd6-62f5532fe932 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:45.749617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3cddef6d-591f-4416-bfd6-62f5532fe932 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:45.750056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-3cddef6d-591f-4416-bfd6-62f5532fe932 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:45.764631 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-3cddef6d-591f-4416-bfd6-62f5532fe932 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3cddef6d-591f-4416-bfd6-62f5532fe932 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f HTTP/1.1 Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:23:45.766172 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:23:45.767434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:23:45.767434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:45.767434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:45.767434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:45.767434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:45.767434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:23:45.767434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:23:45.767434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:23:45.767434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:45.767434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:23:45.767434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:45.767434 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '3a70abd3-ffdf-4b14-a6ce-1af15babe43f'} Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:23:45.768176 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:45.769086 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:45.769980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-3cddef6d-591f-4416-bfd6-62f5532fe932 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 404 to user: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:23:45.769980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-3cddef6d-591f-4416-bfd6-62f5532fe932 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 404 len: 111 microversion: 2.1 time: 0.031151 Jul 14 16:23:45.769980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1494/3091] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:23:45 2022] DELETE /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:45.776650 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ad657792-a137-40ea-8fb4-ea85255bfae9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:45.777334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ad657792-a137-40ea-8fb4-ea85255bfae9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3a70abd3-ffdf-4b14-a6ce-1af15babe43f] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:45.784510 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad657792-a137-40ea-8fb4-ea85255bfae9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:45.784971 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad657792-a137-40ea-8fb4-ea85255bfae9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:45.785731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad657792-a137-40ea-8fb4-ea85255bfae9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:45.786164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad657792-a137-40ea-8fb4-ea85255bfae9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:45.799725 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-ad657792-a137-40ea-8fb4-ea85255bfae9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ad657792-a137-40ea-8fb4-ea85255bfae9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f HTTP/1.1 Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:23:45.801408 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:23:45.802641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:23:45.802641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:45.802641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:45.802641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:45.802641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:45.802641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:23:45.802641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:23:45.802641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:23:45.802641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:45.802641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:23:45.802641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:45.802641 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': '3a70abd3-ffdf-4b14-a6ce-1af15babe43f'} Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:23:45.803876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. Jul 14 16:23:45.805038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:45.806063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ad657792-a137-40ea-8fb4-ea85255bfae9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 404 to user: Instance 3a70abd3-ffdf-4b14-a6ce-1af15babe43f could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:23:45.806063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ad657792-a137-40ea-8fb4-ea85255bfae9 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f" status: 404 len: 111 microversion: 2.1 time: 0.030795 Jul 14 16:23:45.806063 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1598/3092] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:45 2022] GET /compute/v2.1/servers/3a70abd3-ffdf-4b14-a6ce-1af15babe43f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:46.938298 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-88a52825-d769-480b-8455-b93806661c6b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:46.938794 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-88a52825-d769-480b-8455-b93806661c6b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:46.946338 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-88a52825-d769-480b-8455-b93806661c6b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:46.946764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-88a52825-d769-480b-8455-b93806661c6b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:46.947521 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-88a52825-d769-480b-8455-b93806661c6b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:46.947994 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-88a52825-d769-480b-8455-b93806661c6b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:46.961676 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-88a52825-d769-480b-8455-b93806661c6b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-88a52825-d769-480b-8455-b93806661c6b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 HTTP/1.1 Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:23:46.963210 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:23:46.964439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:23:46.964439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:46.964439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:46.964439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:46.964439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:46.964439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:23:46.964439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:23:46.964439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:23:46.964439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:46.964439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:23:46.964439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:23:46.964439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': '3436a5aa-587e-4efa-95f5-f1acae56f896'} Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:23:46.965148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:23:46.966370 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:46.967504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-88a52825-d769-480b-8455-b93806661c6b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 404 to user: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:23:46.967504 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-88a52825-d769-480b-8455-b93806661c6b tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 404 len: 111 microversion: 2.1 time: 0.030145 Jul 14 16:23:46.967860 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1495/3093] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:23:46 2022] DELETE /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:46.972972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-23b2109a-c63a-4588-9d22-84d63e80dda1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:46.973612 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-23b2109a-c63a-4588-9d22-84d63e80dda1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: 3436a5aa-587e-4efa-95f5-f1acae56f896] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:46.982334 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-23b2109a-c63a-4588-9d22-84d63e80dda1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:46.983009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-23b2109a-c63a-4588-9d22-84d63e80dda1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:46.983815 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-23b2109a-c63a-4588-9d22-84d63e80dda1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:46.984534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-23b2109a-c63a-4588-9d22-84d63e80dda1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:46.999295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-23b2109a-c63a-4588-9d22-84d63e80dda1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-23b2109a-c63a-4588-9d22-84d63e80dda1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 HTTP/1.1 Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:23:47.000852 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:23:47.002099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:23:47.002099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:47.002099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:47.002099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:47.002099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:47.002099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:23:47.002099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:23:47.002099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:23:47.002099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:47.002099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:23:47.002099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:23:47.002099 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': '3436a5aa-587e-4efa-95f5-f1acae56f896'} Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:23:47.002803 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. Jul 14 16:23:47.003915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.004713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-23b2109a-c63a-4588-9d22-84d63e80dda1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 404 to user: Instance 3436a5aa-587e-4efa-95f5-f1acae56f896 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:23:47.004713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-23b2109a-c63a-4588-9d22-84d63e80dda1 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896" status: 404 len: 111 microversion: 2.1 time: 0.033120 Jul 14 16:23:47.004713 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1599/3094] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:46 2022] GET /compute/v2.1/servers/3436a5aa-587e-4efa-95f5-f1acae56f896 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:47.010846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2b06ad1d-871e-41ec-b743-7dd2ec7c86b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:47.011374 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2b06ad1d-871e-41ec-b743-7dd2ec7c86b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:47.018308 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2b06ad1d-871e-41ec-b743-7dd2ec7c86b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:47.018840 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2b06ad1d-871e-41ec-b743-7dd2ec7c86b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:47.019888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2b06ad1d-871e-41ec-b743-7dd2ec7c86b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:47.020418 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2b06ad1d-871e-41ec-b743-7dd2ec7c86b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:47.033888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-2b06ad1d-871e-41ec-b743-7dd2ec7c86b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2b06ad1d-871e-41ec-b743-7dd2ec7c86b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 HTTP/1.1 Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:23:47.035419 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:23:47.036686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:23:47.036686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:47.036686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:47.036686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:47.036686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:47.036686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:23:47.036686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:23:47.036686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:23:47.036686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:47.036686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:23:47.036686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:23:47.036686 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'a340d149-aa6e-4ab7-9d2e-a77a44d408a5'} Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:23:47.037909 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:23:47.039873 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.041251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2b06ad1d-871e-41ec-b743-7dd2ec7c86b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 404 to user: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:23:47.041251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2b06ad1d-871e-41ec-b743-7dd2ec7c86b6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 404 len: 111 microversion: 2.1 time: 0.029855 Jul 14 16:23:47.041251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1496/3095] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:23:47 2022] DELETE /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:47.045779 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-db4dfdd2-4621-4f5e-9003-aacebaab401f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:47.046379 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-db4dfdd2-4621-4f5e-9003-aacebaab401f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: a340d149-aa6e-4ab7-9d2e-a77a44d408a5] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:47.052357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db4dfdd2-4621-4f5e-9003-aacebaab401f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:47.052797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db4dfdd2-4621-4f5e-9003-aacebaab401f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:47.054736 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db4dfdd2-4621-4f5e-9003-aacebaab401f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:47.055167 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-db4dfdd2-4621-4f5e-9003-aacebaab401f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:47.068453 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-db4dfdd2-4621-4f5e-9003-aacebaab401f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-db4dfdd2-4621-4f5e-9003-aacebaab401f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 HTTP/1.1 Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:23:47.070119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:23:47.071455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:23:47.071455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:47.071455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:47.071455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:47.071455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:47.071455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:23:47.071455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:23:47.071455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:23:47.071455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:47.071455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:23:47.071455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:23:47.071455 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': 'a340d149-aa6e-4ab7-9d2e-a77a44d408a5'} Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:23:47.072316 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. Jul 14 16:23:47.073296 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:47.074100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-db4dfdd2-4621-4f5e-9003-aacebaab401f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 404 to user: Instance a340d149-aa6e-4ab7-9d2e-a77a44d408a5 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:23:47.074100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-db4dfdd2-4621-4f5e-9003-aacebaab401f tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5" status: 404 len: 111 microversion: 2.1 time: 0.029432 Jul 14 16:23:47.074100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1600/3096] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:47 2022] GET /compute/v2.1/servers/a340d149-aa6e-4ab7-9d2e-a77a44d408a5 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jul 14 16:23:48.213673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9caadcce-cb01-45bc-894f-284dd1c2f8d6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:48.214160 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-9caadcce-cb01-45bc-894f-284dd1c2f8d6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:48.220624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9caadcce-cb01-45bc-894f-284dd1c2f8d6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:48.221066 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9caadcce-cb01-45bc-894f-284dd1c2f8d6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:48.221817 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9caadcce-cb01-45bc-894f-284dd1c2f8d6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:48.222269 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-9caadcce-cb01-45bc-894f-284dd1c2f8d6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:48.236015 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-9caadcce-cb01-45bc-894f-284dd1c2f8d6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9caadcce-cb01-45bc-894f-284dd1c2f8d6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: DELETE /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 HTTP/1.1 Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:23:48.237566 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:23:48.238831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:23:48.238831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:48.238831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:48.238831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:48.238831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:48.238831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:23:48.238831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:23:48.238831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:23:48.238831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:48.238831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: > Jul 14 16:23:48.238831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:23:48.238831 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'c1790591-bc73-4e04-ba8d-a52aadac6194'} Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:23:48.239588 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:23:48.240649 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:23:48.242093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9caadcce-cb01-45bc-894f-284dd1c2f8d6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 404 to user: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:23:48.242093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9caadcce-cb01-45bc-894f-284dd1c2f8d6 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "DELETE /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 404 len: 111 microversion: 2.1 time: 0.030283 Jul 14 16:23:48.242093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1497/3097] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:23:48 2022] DELETE /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:48.248110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a477be0e-a3d0-42b6-922e-fdc5e0e51489 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:48.248657 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a477be0e-a3d0-42b6-922e-fdc5e0e51489 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] [instance: c1790591-bc73-4e04-ba8d-a52aadac6194] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:23:48.255096 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a477be0e-a3d0-42b6-922e-fdc5e0e51489 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:48.255538 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a477be0e-a3d0-42b6-922e-fdc5e0e51489 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:48.256319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a477be0e-a3d0-42b6-922e-fdc5e0e51489 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:23:48.256750 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-a477be0e-a3d0-42b6-922e-fdc5e0e51489 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:23:48.270731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-a477be0e-a3d0-42b6-922e-fdc5e0e51489 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] HTTP exception thrown: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a477be0e-a3d0-42b6-922e-fdc5e0e51489 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Request method failure captured: Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 HTTP/1.1 Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0EH7g_AU4MngIYe_JbpS4I7W9FkxyeHw6qETXq4KV-85wpuKJUh2GF1vGojSRcMz4r3kGivRbHZ-MB7GBLnjgePtZXeh798M3qtPI-amwii04bJ5r-uVcqqlnqgL1vv0GMTIEKnDPhCbKkkrTSwybp082GbVEyK23zY6Un-rSB8tXEc Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:23:48.272327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:23:48.274288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/c09479647ca24b63b744f3dd55111cb3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:23:48.274288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:48.274288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: c09479647ca24b63b744f3dd55111cb3 Jul 14 16:23:48.274288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1301100436 Jul 14 16:23:48.274288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:48.274288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:23:48.274288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:23:48.274288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: b5dbfe771fbe4372951006b71082391a Jul 14 16:23:48.274288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-AttachVolumeNegativeTest-1301100436-project Jul 14 16:23:48.274288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:23:48.274288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:23:48.274288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': 'c1790591-bc73-4e04-ba8d-a52aadac6194'} Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:23:48.274998 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. Jul 14 16:23:48.276166 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:48.277191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a477be0e-a3d0-42b6-922e-fdc5e0e51489 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] Returning 404 to user: Instance c1790591-bc73-4e04-ba8d-a52aadac6194 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:23:48.277191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a477be0e-a3d0-42b6-922e-fdc5e0e51489 tempest-AttachVolumeNegativeTest-1301100436 tempest-AttachVolumeNegativeTest-1301100436-project] 10.222.0.99 "GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194" status: 404 len: 111 microversion: 2.1 time: 0.029504 Jul 14 16:23:48.277191 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1601/3098] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:23:48 2022] GET /compute/v2.1/servers/c1790591-bc73-4e04-ba8d-a52aadac6194 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:52.380612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-89f1ef6a-8962-4040-81bb-855acba3c84e tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Action: 'create', calling method: .version_select at 0x7f357feadd30>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1679390335"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:23:52.845540 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-89f1ef6a-8962-4040-81bb-855acba3c84e tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.583707 Jul 14 16:23:52.846380 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1498/3099] 10.222.0.99 () {60 vars in 1154 bytes} [Thu Jul 14 16:23:52 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 585 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jul 14 16:23:52.857590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-dfec8f71-b475-4fea-828a-771defb8ee74 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f3577646c10>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:52.910742 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-dfec8f71-b475-4fea-828a-771defb8ee74 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403" status: 200 len: 345 microversion: 2.1 time: 0.056886 Jul 14 16:23:52.911309 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1602/3100] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 16:23:52 2022] GET /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:53.924600 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-9b9f3348-9c02-498d-b999-09ad7436a659 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357fd8d670>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:53.975547 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-9b9f3348-9c02-498d-b999-09ad7436a659 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403" status: 200 len: 346 microversion: 2.1 time: 0.055176 Jul 14 16:23:53.976751 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1499/3101] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 16:23:53 2022] GET /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403 => generated 346 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:53.988267 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-657ee05a-2fa7-45c1-b207-b12416808e12 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Action: 'create', calling method: .version_select at 0x7f357ffc1820>, body: {"snapshot": {"volume_id": "c876bd0b-c1fe-46af-8ed4-00df85da2403", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1797920776"}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:23:54.138008 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-657ee05a-2fa7-45c1-b207-b12416808e12 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.153954 Jul 14 16:23:54.138738 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1603/3102] 10.222.0.99 () {60 vars in 1161 bytes} [Thu Jul 14 16:23:53 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:54.149306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-f9bd8513-35dd-4bf9-96da-9d855fc4dff2 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357fd4a4c0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:54.180616 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-f9bd8513-35dd-4bf9-96da-9d855fc4dff2 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434" status: 200 len: 287 microversion: 2.1 time: 0.035724 Jul 14 16:23:54.181402 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1500/3103] 10.222.0.99 () {58 vars in 1250 bytes} [Thu Jul 14 16:23:54 2022] GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434 => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:54.192009 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-9b653a17-1df7-49a1-ab45-44e64aed2500 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357ff57310>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:54.223701 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-9b653a17-1df7-49a1-ab45-44e64aed2500 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.035533 Jul 14 16:23:54.224330 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1604/3104] 10.222.0.99 () {58 vars in 1139 bytes} [Thu Jul 14 16:23:54 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:54.235133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c2d03f54-bd39-4c99-881d-5f6f6a96f245 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357c0c8e50>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:54.268632 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c2d03f54-bd39-4c99-881d-5f6f6a96f245 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434" status: 200 len: 287 microversion: 2.1 time: 0.037028 Jul 14 16:23:54.269396 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1501/3105] 10.222.0.99 () {58 vars in 1250 bytes} [Thu Jul 14 16:23:54 2022] GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434 => generated 287 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:55.281734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a29198ef-9c7e-4465-8ef1-9e7cc1819e92 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357d5a05e0>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:55.312057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a29198ef-9c7e-4465-8ef1-9e7cc1819e92 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434" status: 200 len: 287 microversion: 2.1 time: 0.034539 Jul 14 16:23:55.313467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1605/3106] 10.222.0.99 () {58 vars in 1250 bytes} [Thu Jul 14 16:23:55 2022] GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:56.323912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-53a0b0ef-78c8-4877-91ec-fedd44344982 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357fd8d9d0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:56.353781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-53a0b0ef-78c8-4877-91ec-fedd44344982 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434" status: 200 len: 287 microversion: 2.1 time: 0.034318 Jul 14 16:23:56.354340 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1502/3107] 10.222.0.99 () {58 vars in 1250 bytes} [Thu Jul 14 16:23:56 2022] GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:57.366024 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-db7bd11e-393f-4235-94f0-57b8ab9c2e35 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357ffa7700>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:57.396637 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-db7bd11e-393f-4235-94f0-57b8ab9c2e35 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434" status: 200 len: 287 microversion: 2.1 time: 0.034916 Jul 14 16:23:57.397229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1606/3108] 10.222.0.99 () {58 vars in 1250 bytes} [Thu Jul 14 16:23:57 2022] GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:58.405875 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:58.406746 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:58.411003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b85dcb62-64e9-4998-8cf3-bcd1c613191e tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357fd4aee0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:58.447750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b85dcb62-64e9-4998-8cf3-bcd1c613191e tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434" status: 200 len: 288 microversion: 2.1 time: 0.043107 Jul 14 16:23:58.448325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1503/3109] 10.222.0.99 () {58 vars in 1250 bytes} [Thu Jul 14 16:23:58 2022] GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434 => generated 288 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:58.455951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=25,nova_api:DELETE=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:58.457449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=47,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:23:58.462721 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f48d804d-a215-4302-94c2-6497779b8da1 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357fede8b0>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:58.519877 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f48d804d-a215-4302-94c2-6497779b8da1 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "DELETE /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434" status: 202 len: 0 microversion: 2.1 time: 0.064680 Jul 14 16:23:58.520448 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1607/3110] 10.222.0.99 () {58 vars in 1253 bytes} [Thu Jul 14 16:23:58 2022] DELETE /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434 => generated 0 bytes in 67 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:23:58.528980 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-734194c0-2d6e-4ced-9eeb-103c02cfdf51 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357fd8d940>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:58.559581 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-734194c0-2d6e-4ced-9eeb-103c02cfdf51 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434" status: 200 len: 287 microversion: 2.1 time: 0.034367 Jul 14 16:23:58.560180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1504/3111] 10.222.0.99 () {58 vars in 1250 bytes} [Thu Jul 14 16:23:58 2022] GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434 => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:23:59.572749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-05de62f9-a1ce-4a07-b3bb-7c5ef59b2abd tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357ff57310>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:59.597686 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-05de62f9-a1ce-4a07-b3bb-7c5ef59b2abd tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] HTTP exception thrown: Snapshot bd7761dd-a8bf-4cc7-8c59-49cc98d73434 could not be found. Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-05de62f9-a1ce-4a07-b3bb-7c5ef59b2abd tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Request method failure captured: Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434 HTTP/1.1 Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0EMYax9ahq_dzuDzL2PveB7Rl5wl54yGl_ma8yZeYBx1I8arag8d0d62k9KGWUZnuUXyl6FaCxcawKYcX7hkRAgRuzvtz_FiOWTKNPaArOzOW98oUzte-KnqbfQwKtR6tqTdVnHHAdZhJugbLtiV53klvfrOYRzID6epZimUyGn8SsA Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: e03b6e4c45f640b79b15d2064012c5f9 Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1487522609 Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:23:59.600177 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1487522609 Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: e03b6e4c45f640b79b15d2064012c5f9 Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1487522609 Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-VolumesSnapshotsTestJSON-1487522609-project Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 85527d6a8d1e422cac5c907dc699a6ee Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1487522609-project Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Snapshot bd7761dd-a8bf-4cc7-8c59-49cc98d73434 could not be found. Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': 'bd7761dd-a8bf-4cc7-8c59-49cc98d73434'} Jul 14 16:23:59.601440 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot bd7761dd-a8bf-4cc7-8c59-49cc98d73434 could not be found. (HTTP 404) (Request-ID: req-dce50cda-4fc8-4d3d-82da-babb178ab69b) Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:59.602103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:23:59.603077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot bd7761dd-a8bf-4cc7-8c59-49cc98d73434 could not be found. Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jul 14 16:23:59.604237 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot bd7761dd-a8bf-4cc7-8c59-49cc98d73434 could not be found. Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot bd7761dd-a8bf-4cc7-8c59-49cc98d73434 could not be found. Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-05de62f9-a1ce-4a07-b3bb-7c5ef59b2abd tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Returning 404 to user: Snapshot bd7761dd-a8bf-4cc7-8c59-49cc98d73434 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:23:59.605434 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-05de62f9-a1ce-4a07-b3bb-7c5ef59b2abd tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434" status: 404 len: 111 microversion: 2.1 time: 0.034275 Jul 14 16:23:59.606229 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1608/3112] 10.222.0.99 () {58 vars in 1250 bytes} [Thu Jul 14 16:23:59 2022] GET /compute/v2.1/os-snapshots/bd7761dd-a8bf-4cc7-8c59-49cc98d73434 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:23:59.611056 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-958751bd-0ae3-4813-871a-4573e96e8a3c tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357fd8c9d0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:59.673494 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-958751bd-0ae3-4813-871a-4573e96e8a3c tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403" status: 202 len: 0 microversion: 2.1 time: 0.066615 Jul 14 16:23:59.674142 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1505/3113] 10.222.0.99 () {58 vars in 1247 bytes} [Thu Jul 14 16:23:59 2022] DELETE /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403 => generated 0 bytes in 68 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:23:59.685727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-36afd399-5243-475e-8272-3d0c5ff7d65f tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357fede430>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:23:59.735341 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-36afd399-5243-475e-8272-3d0c5ff7d65f tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403" status: 200 len: 345 microversion: 2.1 time: 0.053669 Jul 14 16:23:59.735965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1609/3114] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 16:23:59 2022] GET /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403 => generated 345 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:24:00.747728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-29f5b7aa-9692-4464-a415-e40ed867f236 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357fd4a4c0>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:24:00.776667 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-29f5b7aa-9692-4464-a415-e40ed867f236 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] HTTP exception thrown: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-29f5b7aa-9692-4464-a415-e40ed867f236 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Request method failure captured: Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403 HTTP/1.1 Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0EMYax9ahq_dzuDzL2PveB7Rl5wl54yGl_ma8yZeYBx1I8arag8d0d62k9KGWUZnuUXyl6FaCxcawKYcX7hkRAgRuzvtz_FiOWTKNPaArOzOW98oUzte-KnqbfQwKtR6tqTdVnHHAdZhJugbLtiV53klvfrOYRzID6epZimUyGn8SsA Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: e03b6e4c45f640b79b15d2064012c5f9 Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1487522609 Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:24:00.778612 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1487522609 Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: e03b6e4c45f640b79b15d2064012c5f9 Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1487522609 Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-VolumesSnapshotsTestJSON-1487522609-project Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 85527d6a8d1e422cac5c907dc699a6ee Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1487522609-project Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'c876bd0b-c1fe-46af-8ed4-00df85da2403'} Jul 14 16:24:00.780291 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. (HTTP 404) (Request-ID: req-f4a7c53c-eb79-4745-ac51-aeb7c0df8d46) Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:24:00.780948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:24:00.781866 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 16:24:00.782764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-29f5b7aa-9692-4464-a415-e40ed867f236 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Returning 404 to user: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-29f5b7aa-9692-4464-a415-e40ed867f236 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403" status: 404 len: 109 microversion: 2.1 time: 0.036715 Jul 14 16:24:00.783696 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1506/3115] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 16:24:00 2022] GET /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403 => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:24:00.796228 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0f2b7a42-6d7f-464d-a577-315428c5ac2b tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357ff92310>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:24:00.828193 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-0f2b7a42-6d7f-464d-a577-315428c5ac2b tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] HTTP exception thrown: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0f2b7a42-6d7f-464d-a577-315428c5ac2b tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Request method failure captured: Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403 HTTP/1.1 Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0EMYax9ahq_dzuDzL2PveB7Rl5wl54yGl_ma8yZeYBx1I8arag8d0d62k9KGWUZnuUXyl6FaCxcawKYcX7hkRAgRuzvtz_FiOWTKNPaArOzOW98oUzte-KnqbfQwKtR6tqTdVnHHAdZhJugbLtiV53klvfrOYRzID6epZimUyGn8SsA Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: e03b6e4c45f640b79b15d2064012c5f9 Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1487522609 Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:24:00.830171 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1487522609 Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: e03b6e4c45f640b79b15d2064012c5f9 Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1487522609 Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-VolumesSnapshotsTestJSON-1487522609-project Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 85527d6a8d1e422cac5c907dc699a6ee Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1487522609-project Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': 'c876bd0b-c1fe-46af-8ed4-00df85da2403'} Jul 14 16:24:00.831437 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. (HTTP 404) (Request-ID: req-ac7411b9-a60e-4394-b261-6c430468a1e4) Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:24:00.832180 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jul 14 16:24:00.833503 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jul 14 16:24:00.834614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0f2b7a42-6d7f-464d-a577-315428c5ac2b tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Returning 404 to user: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:24:00.836337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0f2b7a42-6d7f-464d-a577-315428c5ac2b tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "DELETE /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403" status: 404 len: 109 microversion: 2.1 time: 0.039778 Jul 14 16:24:00.838119 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1610/3116] 10.222.0.99 () {58 vars in 1247 bytes} [Thu Jul 14 16:24:00 2022] DELETE /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403 => generated 109 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:24:00.841240 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-77fdd79b-bc7c-4d0c-b720-77bfe3f42dc4 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Calling method '.version_select at 0x7f357fd8cb80>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:24:00.868705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.wsgi [None req-77fdd79b-bc7c-4d0c-b720-77bfe3f42dc4 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] HTTP exception thrown: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-77fdd79b-bc7c-4d0c-b720-77bfe3f42dc4 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Request method failure captured: Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: request: GET /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403 HTTP/1.1 Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept: application/json Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Accept-Encoding: identity Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Connection: close Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Length: 0 Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Content-Type: application/json Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Host: 10.222.0.99 Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Openstack-System-Scope: None Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: User-Agent: python-urllib3/1.26.9 Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Auth-Token: gAAAAABi0EMYax9ahq_dzuDzL2PveB7Rl5wl54yGl_ma8yZeYBx1I8arag8d0d62k9KGWUZnuUXyl6FaCxcawKYcX7hkRAgRuzvtz_FiOWTKNPaArOzOW98oUzte-KnqbfQwKtR6tqTdVnHHAdZhJugbLtiV53klvfrOYRzID6epZimUyGn8SsA Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Id: None Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Domain-Name: None Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Identity-Status: Confirmed Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Is-Admin-Project: True Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Id: default Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Domain-Name: Default Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Id: e03b6e4c45f640b79b15d2064012c5f9 Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1487522609 Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Role: reader,member Jul 14 16:24:00.870677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Roles: reader,member Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/e03b6e4c45f640b79b15d2064012c5f9"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1487522609 Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Id: e03b6e4c45f640b79b15d2064012c5f9 Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1487522609 Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User: tempest-VolumesSnapshotsTestJSON-1487522609-project Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Id: default Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Domain-Name: Default Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Id: 85527d6a8d1e422cac5c907dc699a6ee Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1487522609-project Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: method: Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: exception: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: action_args: {'id': 'c876bd0b-c1fe-46af-8ed4-00df85da2403'} Jul 14 16:24:00.871904 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. (HTTP 404) (Request-ID: req-c2558f8b-08c6-43f8-9423-7337d7824c17) Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:24:00.872673 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi item = cinderclient( Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jul 14 16:24:00.873730 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jul 14 16:24:00.874932 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR nova.api.openstack.wsgi Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-77fdd79b-bc7c-4d0c-b720-77bfe3f42dc4 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] Returning 404 to user: Volume c876bd0b-c1fe-46af-8ed4-00df85da2403 could not be found. {{(pid=124502) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-77fdd79b-bc7c-4d0c-b720-77bfe3f42dc4 tempest-VolumesSnapshotsTestJSON-1487522609 tempest-VolumesSnapshotsTestJSON-1487522609-project] 10.222.0.99 "GET /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403" status: 404 len: 109 microversion: 2.1 time: 0.034722 Jul 14 16:24:00.876003 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1507/3117] 10.222.0.99 () {58 vars in 1244 bytes} [Thu Jul 14 16:24:00 2022] GET /compute/v2.1/os-volumes/c876bd0b-c1fe-46af-8ed4-00df85da2403 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:25:03.882029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:25:03.882781 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:25:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:25:08.922361 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:25:08.923035 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:25:08 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:25:42.641425 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR oslo.messaging._drivers.impl_rabbit [-] [a3bff24c-ccf9-4f5c-9e49-e1d6533bf9fd] AMQP server on 10.222.0.99:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 16:25:42.646547 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-1d6ab705-0e14-43b7-8d32-e23c96607c60 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Action: 'create', calling method: .version_select at 0x7f357ff92310>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1709355247", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFIIBtND9YKBnTtQF5LO1vhf3nJVthYJncywPwEO1f483HfDlwLRrrNhjzd9MasyFW6Kxh7t7ArrYhJeyGcC09KC+OZd/6uiYE9p3Eg5gWoFuorPfSAsZ3QIRDfIlx7LFQ=="}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:25:42.660357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-1d6ab705-0e14-43b7-8d32-e23c96607c60 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Getting quotas for project a4f95de73a8f4a0ba3d4fdaab174a1c2. Resources: {'key_pairs'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:25:42.664895 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.quota [None req-1d6ab705-0e14-43b7-8d32-e23c96607c60 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Getting quotas for user 755f5db986a24ac9a7bd5c77a257df60 and project a4f95de73a8f4a0ba3d4fdaab174a1c2. Resources: {'key_pairs'} {{(pid=124503) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:25:42.687513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-1d6ab705-0e14-43b7-8d32-e23c96607c60 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "POST /compute/v2.1/os-keypairs" status: 200 len: 403 microversion: 2.1 time: 0.047916 Jul 14 16:25:42.688137 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1611/3118] 10.222.0.99 () {60 vars in 1158 bytes} [Thu Jul 14 16:25:42 2022] POST /compute/v2.1/os-keypairs => generated 403 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:25:42.735188 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: ERROR oslo.messaging._drivers.impl_rabbit [-] [05b4667f-f95a-4031-8d09-b4e638561548] AMQP server on 10.222.0.99:5672 is unreachable: Too many heartbeats missed. Trying again in 1 seconds.: amqp.exceptions.ConnectionForced: Too many heartbeats missed Jul 14 16:25:42.739389 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-193843528", "imageRef": "dd83fb41-13b9-4a0d-8492-82b8b5365f8f", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1709355247", "networks": [{"uuid": "6ceb5884-5232-4a5d-be31-ac8f1125134a"}]}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:25:42.899488 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.network.neutron [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] validate_networks() for [('6ceb5884-5232-4a5d-be31-ac8f1125134a', None, None, None, None, None)] {{(pid=124502) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jul 14 16:25:43.430109 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Flavor limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jul 14 16:25:43.430562 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Image limits 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jul 14 16:25:43.431032 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Flavor pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jul 14 16:25:43.431441 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Image pref 0:0:0 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jul 14 16:25:43.431897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.virt.hardware [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124502) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jul 14 16:25:43.440782 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:43.441225 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:43.442006 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:43.442433 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:43.460793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Getting quotas for project a4f95de73a8f4a0ba3d4fdaab174a1c2. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jul 14 16:25:43.464898 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.quota [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Getting quotas for user 755f5db986a24ac9a7bd5c77a257df60 and project a4f95de73a8f4a0ba3d4fdaab174a1c2. Resources: {'instances', 'ram', 'cores'} {{(pid=124502) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jul 14 16:25:43.477800 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Going to run 1 instances... {{(pid=124502) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jul 14 16:25:43.480029 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='dd83fb41-13b9-4a0d-8492-82b8b5365f8f',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124502) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jul 14 16:25:43.531557 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4f97de4b-2972-4d82-8fbb-8e406038e07f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.799041 Jul 14 16:25:43.532242 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1508/3119] 10.222.0.99 () {60 vars in 1146 bytes} [Thu Jul 14 16:25:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 800 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jul 14 16:25:43.542080 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-a863a5b9-92a5-45cf-b402-244ef12c0a54 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:43.542689 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-a863a5b9-92a5-45cf-b402-244ef12c0a54 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:43.649131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] [a3bff24c-ccf9-4f5c-9e49-e1d6533bf9fd] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 51020. Jul 14 16:25:43.659568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-a863a5b9-92a5-45cf-b402-244ef12c0a54 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:43.666498 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-a863a5b9-92a5-45cf-b402-244ef12c0a54 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1258 microversion: 2.1 time: 0.128265 Jul 14 16:25:43.667057 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1612/3120] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:43 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1258 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:25:44.684996 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-89bcba20-c995-4f6f-b198-e8551b3d5cf4 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:44.685615 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-89bcba20-c995-4f6f-b198-e8551b3d5cf4 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:44.698736 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] [05b4667f-f95a-4031-8d09-b4e638561548] Reconnected to AMQP server on 10.222.0.99:5672 via [amqp] client with port 51032. Jul 14 16:25:44.748948 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-89bcba20-c995-4f6f-b198-e8551b3d5cf4 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:44.756325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-89bcba20-c995-4f6f-b198-e8551b3d5cf4 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1258 microversion: 2.1 time: 0.076382 Jul 14 16:25:44.757008 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1509/3121] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:44 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1258 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:25:45.773076 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ecdec5e9-d3bd-4c63-828d-c7e21347be08 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:45.773717 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ecdec5e9-d3bd-4c63-828d-c7e21347be08 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:45.828644 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ecdec5e9-d3bd-4c63-828d-c7e21347be08 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:45.835851 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ecdec5e9-d3bd-4c63-828d-c7e21347be08 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1258 microversion: 2.1 time: 0.066643 Jul 14 16:25:45.836500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1613/3122] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:45 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1258 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:25:46.853390 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d2327649-a9ac-4408-89c1-20ce8de3859e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:46.853917 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d2327649-a9ac-4408-89c1-20ce8de3859e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:46.906149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d2327649-a9ac-4408-89c1-20ce8de3859e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:46.913721 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d2327649-a9ac-4408-89c1-20ce8de3859e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1258 microversion: 2.1 time: 0.064937 Jul 14 16:25:46.914276 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1510/3123] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:46 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1258 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:25:47.930632 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-7e2263b9-14f8-465f-aea7-aa4b70c02d9e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:47.931246 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-7e2263b9-14f8-465f-aea7-aa4b70c02d9e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:47.938165 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e2263b9-14f8-465f-aea7-aa4b70c02d9e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:47.938965 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e2263b9-14f8-465f-aea7-aa4b70c02d9e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:47.940387 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e2263b9-14f8-465f-aea7-aa4b70c02d9e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:47.941028 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-7e2263b9-14f8-465f-aea7-aa4b70c02d9e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:48.009458 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-7e2263b9-14f8-465f-aea7-aa4b70c02d9e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:48.016951 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-7e2263b9-14f8-465f-aea7-aa4b70c02d9e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1262 microversion: 2.1 time: 0.090510 Jul 14 16:25:48.017513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1614/3124] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:47 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1262 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:25:49.033593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bb12d3d9-1e44-4cac-999a-d1dd82e91089 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:49.035341 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bb12d3d9-1e44-4cac-999a-d1dd82e91089 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:49.047483 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb12d3d9-1e44-4cac-999a-d1dd82e91089 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:49.047957 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb12d3d9-1e44-4cac-999a-d1dd82e91089 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:49.050771 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb12d3d9-1e44-4cac-999a-d1dd82e91089 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:49.051217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bb12d3d9-1e44-4cac-999a-d1dd82e91089 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:49.139130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bb12d3d9-1e44-4cac-999a-d1dd82e91089 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:49.148045 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bb12d3d9-1e44-4cac-999a-d1dd82e91089 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1316 microversion: 2.1 time: 0.119003 Jul 14 16:25:49.148629 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1511/3125] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:49 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1316 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:25:50.166573 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ce924888-e8f1-4317-9c70-ea0b6526b6f1 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:50.167185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ce924888-e8f1-4317-9c70-ea0b6526b6f1 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:50.173797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce924888-e8f1-4317-9c70-ea0b6526b6f1 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:50.174245 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce924888-e8f1-4317-9c70-ea0b6526b6f1 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:50.175010 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce924888-e8f1-4317-9c70-ea0b6526b6f1 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:50.175444 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ce924888-e8f1-4317-9c70-ea0b6526b6f1 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:50.329322 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ce924888-e8f1-4317-9c70-ea0b6526b6f1 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:50.338314 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ce924888-e8f1-4317-9c70-ea0b6526b6f1 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.176241 Jul 14 16:25:50.338893 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1615/3126] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:50 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:25:51.358533 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-70d1e955-1042-4240-ae9e-6da33e42bf38 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:51.359130 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-70d1e955-1042-4240-ae9e-6da33e42bf38 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:51.368452 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70d1e955-1042-4240-ae9e-6da33e42bf38 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:51.369272 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70d1e955-1042-4240-ae9e-6da33e42bf38 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:51.370685 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70d1e955-1042-4240-ae9e-6da33e42bf38 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:51.371439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-70d1e955-1042-4240-ae9e-6da33e42bf38 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:51.522217 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-70d1e955-1042-4240-ae9e-6da33e42bf38 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:51.532254 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-70d1e955-1042-4240-ae9e-6da33e42bf38 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.179320 Jul 14 16:25:51.543929 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1512/3127] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:51 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:25:52.553973 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-6236c0e0-1695-44a6-8d10-d0744a33b910 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:52.555775 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-6236c0e0-1695-44a6-8d10-d0744a33b910 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:52.563443 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6236c0e0-1695-44a6-8d10-d0744a33b910 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:52.564003 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6236c0e0-1695-44a6-8d10-d0744a33b910 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:52.564889 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6236c0e0-1695-44a6-8d10-d0744a33b910 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:52.565329 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-6236c0e0-1695-44a6-8d10-d0744a33b910 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:52.708806 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-6236c0e0-1695-44a6-8d10-d0744a33b910 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:52.716842 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-6236c0e0-1695-44a6-8d10-d0744a33b910 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.168548 Jul 14 16:25:52.725473 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1616/3128] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:52 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:25:53.734802 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-009eaca3-da1f-4293-a253-ab1c8528f38a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:53.735442 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-009eaca3-da1f-4293-a253-ab1c8528f38a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:53.737719 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=2 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:25:53.743879 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-009eaca3-da1f-4293-a253-ab1c8528f38a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:53.744325 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-009eaca3-da1f-4293-a253-ab1c8528f38a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:53.745089 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-009eaca3-da1f-4293-a253-ab1c8528f38a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:53.745524 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-009eaca3-da1f-4293-a253-ab1c8528f38a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:53.885545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-009eaca3-da1f-4293-a253-ab1c8528f38a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:53.893806 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-009eaca3-da1f-4293-a253-ab1c8528f38a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.162802 Jul 14 16:25:53.894406 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1513/3129] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:53 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:25:54.912336 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2698379e-812d-46e8-802a-edfd08e2eb8c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:54.913060 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2698379e-812d-46e8-802a-edfd08e2eb8c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:54.919500 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2698379e-812d-46e8-802a-edfd08e2eb8c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:54.920540 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2698379e-812d-46e8-802a-edfd08e2eb8c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:54.920941 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2698379e-812d-46e8-802a-edfd08e2eb8c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:54.921534 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2698379e-812d-46e8-802a-edfd08e2eb8c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:55.068535 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2698379e-812d-46e8-802a-edfd08e2eb8c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:55.076581 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2698379e-812d-46e8-802a-edfd08e2eb8c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.168850 Jul 14 16:25:55.077518 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1617/3130] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:54 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:25:56.095054 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ec71d3f0-fb6f-4be2-867b-6f9b8c40963c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:56.096095 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ec71d3f0-fb6f-4be2-867b-6f9b8c40963c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:56.103476 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec71d3f0-fb6f-4be2-867b-6f9b8c40963c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:56.104097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec71d3f0-fb6f-4be2-867b-6f9b8c40963c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:56.104986 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec71d3f0-fb6f-4be2-867b-6f9b8c40963c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:56.105516 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ec71d3f0-fb6f-4be2-867b-6f9b8c40963c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:56.256728 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-ec71d3f0-fb6f-4be2-867b-6f9b8c40963c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:56.264475 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ec71d3f0-fb6f-4be2-867b-6f9b8c40963c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.173796 Jul 14 16:25:56.265393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1514/3131] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:56 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:25:57.282890 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-16ba2661-086f-43eb-9628-b6056570490a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:57.283487 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-16ba2661-086f-43eb-9628-b6056570490a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:57.286354 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=8 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:25:57.292654 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16ba2661-086f-43eb-9628-b6056570490a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:57.293101 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16ba2661-086f-43eb-9628-b6056570490a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:57.293856 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16ba2661-086f-43eb-9628-b6056570490a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:57.294286 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-16ba2661-086f-43eb-9628-b6056570490a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:57.427625 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-16ba2661-086f-43eb-9628-b6056570490a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:57.434993 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-16ba2661-086f-43eb-9628-b6056570490a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.156040 Jul 14 16:25:57.435553 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1618/3132] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:57 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:25:58.452927 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c4ecbeb9-6148-4376-bba0-d24fa0987cdc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:58.453537 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c4ecbeb9-6148-4376-bba0-d24fa0987cdc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:58.455376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell0:SELECT=10 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:25:58.462283 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c4ecbeb9-6148-4376-bba0-d24fa0987cdc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:58.462735 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c4ecbeb9-6148-4376-bba0-d24fa0987cdc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:58.463502 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c4ecbeb9-6148-4376-bba0-d24fa0987cdc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:58.463973 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c4ecbeb9-6148-4376-bba0-d24fa0987cdc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:58.667937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c4ecbeb9-6148-4376-bba0-d24fa0987cdc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:58.675760 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c4ecbeb9-6148-4376-bba0-d24fa0987cdc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.226607 Jul 14 16:25:58.677260 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1515/3133] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:58 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:25:59.072073 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-a60e7a8e-a7a5-4237-aea1-94ccd3d0266b req-5ebd1109-a9d8-4b1a-b7f3-b9b9f6952ddb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3d6e63-c73a-43cf-bf88-455cb47417e3", "tag": "b58a75ff-78a7-42c1-8631-f5ff2c068246"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:25:59.080868 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-a60e7a8e-a7a5-4237-aea1-94ccd3d0266b req-5ebd1109-a9d8-4b1a-b7f3-b9b9f6952ddb service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:59.081419 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-a60e7a8e-a7a5-4237-aea1-94ccd3d0266b req-5ebd1109-a9d8-4b1a-b7f3-b9b9f6952ddb service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:59.094231 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-a60e7a8e-a7a5-4237-aea1-94ccd3d0266b req-5ebd1109-a9d8-4b1a-b7f3-b9b9f6952ddb service nova] Creating event network-changed:b58a75ff-78a7-42c1-8631-f5ff2c068246 for instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 on hv-cinder-82651 Jul 14 16:25:59.100038 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-a60e7a8e-a7a5-4237-aea1-94ccd3d0266b req-5ebd1109-a9d8-4b1a-b7f3-b9b9f6952ddb service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.112455 Jul 14 16:25:59.100997 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1619/3134] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:25:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:25:59.694245 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-c64bca8b-fdd2-457b-9043-199857e2226a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:25:59.695316 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-c64bca8b-fdd2-457b-9043-199857e2226a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:25:59.702651 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c64bca8b-fdd2-457b-9043-199857e2226a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:59.703108 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c64bca8b-fdd2-457b-9043-199857e2226a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:59.703926 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c64bca8b-fdd2-457b-9043-199857e2226a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:25:59.704371 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-c64bca8b-fdd2-457b-9043-199857e2226a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:25:59.841773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-c64bca8b-fdd2-457b-9043-199857e2226a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:25:59.849880 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-c64bca8b-fdd2-457b-9043-199857e2226a tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.161065 Jul 14 16:25:59.850439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1516/3135] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:25:59 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:26:00.867563 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2400cf39-0377-46b4-b4b1-3bbd3e7ee9d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:00.868293 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2400cf39-0377-46b4-b4b1-3bbd3e7ee9d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:00.874799 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2400cf39-0377-46b4-b4b1-3bbd3e7ee9d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:00.875249 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2400cf39-0377-46b4-b4b1-3bbd3e7ee9d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:00.876050 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2400cf39-0377-46b4-b4b1-3bbd3e7ee9d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:00.876541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2400cf39-0377-46b4-b4b1-3bbd3e7ee9d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:01.012812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2400cf39-0377-46b4-b4b1-3bbd3e7ee9d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:01.021066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2400cf39-0377-46b4-b4b1-3bbd3e7ee9d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.158482 Jul 14 16:26:01.021643 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1620/3136] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:00 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:02.038455 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-d50e89e9-a813-413a-83a3-e0d7e7d6907e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:02.039061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-d50e89e9-a813-413a-83a3-e0d7e7d6907e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:02.045647 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d50e89e9-a813-413a-83a3-e0d7e7d6907e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:02.046091 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d50e89e9-a813-413a-83a3-e0d7e7d6907e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:02.046842 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d50e89e9-a813-413a-83a3-e0d7e7d6907e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:02.047275 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-d50e89e9-a813-413a-83a3-e0d7e7d6907e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:02.197246 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-d50e89e9-a813-413a-83a3-e0d7e7d6907e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:02.204672 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-d50e89e9-a813-413a-83a3-e0d7e7d6907e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.170070 Jul 14 16:26:02.205247 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1517/3137] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:02 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:03.221691 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ad385f14-9b36-47d4-8bbb-0ecf970ce0fe tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:03.222302 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ad385f14-9b36-47d4-8bbb-0ecf970ce0fe tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:03.229616 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad385f14-9b36-47d4-8bbb-0ecf970ce0fe tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:03.230066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad385f14-9b36-47d4-8bbb-0ecf970ce0fe tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:03.230834 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad385f14-9b36-47d4-8bbb-0ecf970ce0fe tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:03.231272 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ad385f14-9b36-47d4-8bbb-0ecf970ce0fe tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:03.369813 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ad385f14-9b36-47d4-8bbb-0ecf970ce0fe tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:03.377178 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ad385f14-9b36-47d4-8bbb-0ecf970ce0fe tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.159458 Jul 14 16:26:03.377765 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1621/3138] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:03 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:03.840810 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-7433af02-68f1-460a-9172-d57d44f2b297 req-3cd550e4-054e-4b44-b98f-95620e664200 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3d6e63-c73a-43cf-bf88-455cb47417e3", "name": "network-vif-plugged", "status": "completed", "tag": "b58a75ff-78a7-42c1-8631-f5ff2c068246"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:26:03.849319 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-7433af02-68f1-460a-9172-d57d44f2b297 req-3cd550e4-054e-4b44-b98f-95620e664200 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:03.849763 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-7433af02-68f1-460a-9172-d57d44f2b297 req-3cd550e4-054e-4b44-b98f-95620e664200 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:03.861148 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-7433af02-68f1-460a-9172-d57d44f2b297 req-3cd550e4-054e-4b44-b98f-95620e664200 service nova] Creating event network-vif-plugged:b58a75ff-78a7-42c1-8631-f5ff2c068246 for instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 on hv-cinder-82651 Jul 14 16:26:03.867128 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-7433af02-68f1-460a-9172-d57d44f2b297 req-3cd550e4-054e-4b44-b98f-95620e664200 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098149 Jul 14 16:26:03.867734 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1518/3139] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:26:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:26:04.394944 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2f4c0e21-8332-46f8-a654-693560ee9e6b tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:04.395735 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2f4c0e21-8332-46f8-a654-693560ee9e6b tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:04.402299 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f4c0e21-8332-46f8-a654-693560ee9e6b tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:04.402752 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f4c0e21-8332-46f8-a654-693560ee9e6b tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:04.403513 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f4c0e21-8332-46f8-a654-693560ee9e6b tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:04.403983 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2f4c0e21-8332-46f8-a654-693560ee9e6b tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:04.533923 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2f4c0e21-8332-46f8-a654-693560ee9e6b tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:04.541623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2f4c0e21-8332-46f8-a654-693560ee9e6b tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.151211 Jul 14 16:26:04.542196 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1622/3140] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:04 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:05.559912 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4c5b566e-a765-4a50-9256-49173338dd80 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:05.560617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4c5b566e-a765-4a50-9256-49173338dd80 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:05.568053 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4c5b566e-a765-4a50-9256-49173338dd80 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:05.568511 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4c5b566e-a765-4a50-9256-49173338dd80 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:05.569279 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4c5b566e-a765-4a50-9256-49173338dd80 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:05.569717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4c5b566e-a765-4a50-9256-49173338dd80 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:05.700582 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-4c5b566e-a765-4a50-9256-49173338dd80 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:05.708180 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4c5b566e-a765-4a50-9256-49173338dd80 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1358 microversion: 2.1 time: 0.152886 Jul 14 16:26:05.708764 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1519/3141] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:05 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:06.724915 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-f4cf7e39-8c5f-4135-84de-2842b9beec6e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:06.725618 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-f4cf7e39-8c5f-4135-84de-2842b9beec6e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:06.732145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4cf7e39-8c5f-4135-84de-2842b9beec6e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:06.732590 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4cf7e39-8c5f-4135-84de-2842b9beec6e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:06.733349 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4cf7e39-8c5f-4135-84de-2842b9beec6e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:06.733780 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-f4cf7e39-8c5f-4135-84de-2842b9beec6e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:06.869022 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-f4cf7e39-8c5f-4135-84de-2842b9beec6e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:06.876530 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-f4cf7e39-8c5f-4135-84de-2842b9beec6e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1547 microversion: 2.1 time: 0.155502 Jul 14 16:26:06.877107 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1623/3142] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:06 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:06.894846 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-363c9afd-f482-4213-b28f-18c0c5b8f701 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:06.895874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-363c9afd-f482-4213-b28f-18c0c5b8f701 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:06.902493 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-363c9afd-f482-4213-b28f-18c0c5b8f701 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:06.902999 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-363c9afd-f482-4213-b28f-18c0c5b8f701 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:06.903750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-363c9afd-f482-4213-b28f-18c0c5b8f701 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:06.904196 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-363c9afd-f482-4213-b28f-18c0c5b8f701 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:07.066367 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-363c9afd-f482-4213-b28f-18c0c5b8f701 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:07.073895 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-363c9afd-f482-4213-b28f-18c0c5b8f701 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1547 microversion: 2.1 time: 0.183631 Jul 14 16:26:07.074465 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1520/3143] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:06 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1547 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:07.090169 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0cd03e30-023b-4288-b663-49ab77d34e01 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:07.093656 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-0cd03e30-023b-4288-b663-49ab77d34e01 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:07.094449 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0cd03e30-023b-4288-b663-49ab77d34e01 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Searching by: {'deleted': False, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2'} {{(pid=124503) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jul 14 16:26:07.101659 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0cd03e30-023b-4288-b663-49ab77d34e01 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:07.102100 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0cd03e30-023b-4288-b663-49ab77d34e01 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:07.102872 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0cd03e30-023b-4288-b663-49ab77d34e01 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:07.103303 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0cd03e30-023b-4288-b663-49ab77d34e01 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:07.194198 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.multi_cell_list [None req-0cd03e30-023b-4288-b663-49ab77d34e01 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124503) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jul 14 16:26:07.286156 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0cd03e30-023b-4288-b663-49ab77d34e01 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.199682 Jul 14 16:26:07.286741 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1624/3144] 10.222.0.99 () {58 vars in 1124 bytes} [Thu Jul 14 16:26:07 2022] GET /compute/v2.1/servers => generated 342 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:26:07.296792 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fd2f660d-e212-4088-8801-e1b4bbb73440 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:07.297393 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fd2f660d-e212-4088-8801-e1b4bbb73440 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:07.304193 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd2f660d-e212-4088-8801-e1b4bbb73440 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:07.304639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd2f660d-e212-4088-8801-e1b4bbb73440 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:07.305395 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd2f660d-e212-4088-8801-e1b4bbb73440 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:07.305834 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd2f660d-e212-4088-8801-e1b4bbb73440 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:07.434380 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-fd2f660d-e212-4088-8801-e1b4bbb73440 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:07.442682 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fd2f660d-e212-4088-8801-e1b4bbb73440 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1547 microversion: 2.1 time: 0.149684 Jul 14 16:26:07.443244 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1521/3145] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:07 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1547 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:08.960351 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-0d4ee029-ff6e-4b7c-a127-a5273393f59e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2afca312-f3b9-45d5-aaaf-d8b383607dd9"}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:26:08.961483 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-0d4ee029-ff6e-4b7c-a127-a5273393f59e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:08.968087 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d4ee029-ff6e-4b7c-a127-a5273393f59e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:08.968541 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d4ee029-ff6e-4b7c-a127-a5273393f59e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:08.969337 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d4ee029-ff6e-4b7c-a127-a5273393f59e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:08.969771 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-0d4ee029-ff6e-4b7c-a127-a5273393f59e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:09.214523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-0d4ee029-ff6e-4b7c-a127-a5273393f59e tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "POST /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.258114 Jul 14 16:26:09.215134 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1625/3146] 10.222.0.99 () {60 vars in 1322 bytes} [Thu Jul 14 16:26:08 2022] POST /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/os-volume_attachments => generated 194 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:26:16.769955 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e0a1822e-fea2-4398-a4f9-a076657865b7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:16.770599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e0a1822e-fea2-4398-a4f9-a076657865b7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:16.772937 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:26:16.778133 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0a1822e-fea2-4398-a4f9-a076657865b7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:16.778578 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0a1822e-fea2-4398-a4f9-a076657865b7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:16.779336 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0a1822e-fea2-4398-a4f9-a076657865b7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:16.779801 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e0a1822e-fea2-4398-a4f9-a076657865b7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:16.785100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=65 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:26:16.915773 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e0a1822e-fea2-4398-a4f9-a076657865b7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:16.924061 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e0a1822e-fea2-4398-a4f9-a076657865b7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1593 microversion: 2.1 time: 0.158830 Jul 14 16:26:16.925149 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1522/3147] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:16 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1593 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:18.703916 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell0:SELECT=2 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:26:18.708942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-5cfe6d62-2d9c-4d22-af92-e207771b49f8 req-0d8c82c9-4917-460a-a957-4a2e1dca25ed service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3d6e63-c73a-43cf-bf88-455cb47417e3", "tag": "b58a75ff-78a7-42c1-8631-f5ff2c068246"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:26:18.712550 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=44,nova_api:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:26:18.725836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-5cfe6d62-2d9c-4d22-af92-e207771b49f8 req-0d8c82c9-4917-460a-a957-4a2e1dca25ed service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:18.726284 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-5cfe6d62-2d9c-4d22-af92-e207771b49f8 req-0d8c82c9-4917-460a-a957-4a2e1dca25ed service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:18.731207 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=76,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:26:18.741840 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-5cfe6d62-2d9c-4d22-af92-e207771b49f8 req-0d8c82c9-4917-460a-a957-4a2e1dca25ed service nova] Creating event network-changed:b58a75ff-78a7-42c1-8631-f5ff2c068246 for instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 on hv-cinder-82651 Jul 14 16:26:18.748980 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-5cfe6d62-2d9c-4d22-af92-e207771b49f8 req-0d8c82c9-4917-460a-a957-4a2e1dca25ed service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045942 Jul 14 16:26:18.750083 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1626/3148] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:26:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:26:19.773000 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-36e30b4f-1bbd-4fa2-bfc5-b0ca8340b4be tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-64682606"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:26:19.773627 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-36e30b4f-1bbd-4fa2-bfc5-b0ca8340b4be tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:19.779705 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-36e30b4f-1bbd-4fa2-bfc5-b0ca8340b4be tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:19.780162 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-36e30b4f-1bbd-4fa2-bfc5-b0ca8340b4be tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:19.780923 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-36e30b4f-1bbd-4fa2-bfc5-b0ca8340b4be tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:19.781624 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-36e30b4f-1bbd-4fa2-bfc5-b0ca8340b4be tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:19.919110 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.network.security_group_api [None req-36e30b4f-1bbd-4fa2-bfc5-b0ca8340b4be tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Adding security group 580a4ead-fddd-4eda-a6e4-b2dd8452127b to port b58a75ff-78a7-42c1-8631-f5ff2c068246 Jul 14 16:26:20.277910 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-36e30b4f-1bbd-4fa2-bfc5-b0ca8340b4be tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "POST /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/action" status: 202 len: 0 microversion: 2.1 time: 0.509865 Jul 14 16:26:20.278818 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1523/3149] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 16:26:19 2022] POST /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/action => generated 0 bytes in 511 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:26:20.289030 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ccc2ed22-8930-4f5e-a538-000dc0e40f5c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:20.289857 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ccc2ed22-8930-4f5e-a538-000dc0e40f5c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:20.297568 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ccc2ed22-8930-4f5e-a538-000dc0e40f5c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:20.298174 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ccc2ed22-8930-4f5e-a538-000dc0e40f5c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:20.299041 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ccc2ed22-8930-4f5e-a538-000dc0e40f5c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:20.300319 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ccc2ed22-8930-4f5e-a538-000dc0e40f5c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:20.478151 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ccc2ed22-8930-4f5e-a538-000dc0e40f5c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:20.486131 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ccc2ed22-8930-4f5e-a538-000dc0e40f5c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1756 microversion: 2.1 time: 0.202684 Jul 14 16:26:20.486705 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1627/3150] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:20 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1756 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:20.764050 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-350b7e58-5b9e-4c8a-8ba5-f4da6dd7166e req-da328520-7788-40d9-a258-548cacf90862 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3d6e63-c73a-43cf-bf88-455cb47417e3", "tag": "b58a75ff-78a7-42c1-8631-f5ff2c068246"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:26:20.773472 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-350b7e58-5b9e-4c8a-8ba5-f4da6dd7166e req-da328520-7788-40d9-a258-548cacf90862 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:20.774085 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-350b7e58-5b9e-4c8a-8ba5-f4da6dd7166e req-da328520-7788-40d9-a258-548cacf90862 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:20.784807 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-350b7e58-5b9e-4c8a-8ba5-f4da6dd7166e req-da328520-7788-40d9-a258-548cacf90862 service nova] Creating event network-changed:b58a75ff-78a7-42c1-8631-f5ff2c068246 for instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 on hv-cinder-82651 Jul 14 16:26:20.789790 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-350b7e58-5b9e-4c8a-8ba5-f4da6dd7166e req-da328520-7788-40d9-a258-548cacf90862 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029343 Jul 14 16:26:20.790457 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1524/3151] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:26:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:26:44.165382 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-d631ca3b-a40a-4ca9-b168-a8ed2442ca6f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:26:44.166318 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-d631ca3b-a40a-4ca9-b168-a8ed2442ca6f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:44.168583 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=3 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:26:44.169223 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=7 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:26:44.175342 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d631ca3b-a40a-4ca9-b168-a8ed2442ca6f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:44.176066 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d631ca3b-a40a-4ca9-b168-a8ed2442ca6f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:44.176837 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d631ca3b-a40a-4ca9-b168-a8ed2442ca6f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:44.177254 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-d631ca3b-a40a-4ca9-b168-a8ed2442ca6f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:44.404767 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-d631ca3b-a40a-4ca9-b168-a8ed2442ca6f tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "POST /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/action" status: 202 len: 0 microversion: 2.1 time: 0.243115 Jul 14 16:26:44.406405 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1628/3152] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 16:26:44 2022] POST /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/action => generated 0 bytes in 245 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:26:44.413097 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=5 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:26:44.413838 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=11 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:26:44.418520 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-5b83390c-1709-4dac-9e70-0e7ea68ccfba tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:44.419290 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-5b83390c-1709-4dac-9e70-0e7ea68ccfba tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:44.428990 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b83390c-1709-4dac-9e70-0e7ea68ccfba tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:44.429439 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b83390c-1709-4dac-9e70-0e7ea68ccfba tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:44.430204 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b83390c-1709-4dac-9e70-0e7ea68ccfba tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:44.430639 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-5b83390c-1709-4dac-9e70-0e7ea68ccfba tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:44.933158 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-5b83390c-1709-4dac-9e70-0e7ea68ccfba tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:44.941800 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-5b83390c-1709-4dac-9e70-0e7ea68ccfba tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1748 microversion: 2.1 time: 0.530205 Jul 14 16:26:44.942376 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1525/3153] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:44 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1748 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:45.960614 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-023c3d5d-cc2c-466c-87ea-9ebafd6e1403 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:45.961307 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-023c3d5d-cc2c-466c-87ea-9ebafd6e1403 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:45.968077 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-023c3d5d-cc2c-466c-87ea-9ebafd6e1403 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:45.968523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-023c3d5d-cc2c-466c-87ea-9ebafd6e1403 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:45.969277 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-023c3d5d-cc2c-466c-87ea-9ebafd6e1403 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:45.970962 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-023c3d5d-cc2c-466c-87ea-9ebafd6e1403 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:46.119910 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-023c3d5d-cc2c-466c-87ea-9ebafd6e1403 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:46.129283 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-023c3d5d-cc2c-466c-87ea-9ebafd6e1403 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1753 microversion: 2.1 time: 0.172863 Jul 14 16:26:46.129858 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1629/3154] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:45 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:47.148178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-1628f6b6-fb2a-4fe0-a750-306cc9431066 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:47.148812 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-1628f6b6-fb2a-4fe0-a750-306cc9431066 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:47.155414 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1628f6b6-fb2a-4fe0-a750-306cc9431066 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:47.155899 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1628f6b6-fb2a-4fe0-a750-306cc9431066 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:47.156661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1628f6b6-fb2a-4fe0-a750-306cc9431066 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:47.157606 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-1628f6b6-fb2a-4fe0-a750-306cc9431066 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:47.301889 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-1628f6b6-fb2a-4fe0-a750-306cc9431066 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:47.314655 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-1628f6b6-fb2a-4fe0-a750-306cc9431066 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1753 microversion: 2.1 time: 0.170218 Jul 14 16:26:47.315251 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1526/3155] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:47 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:48.331727 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-ff01a423-04d8-4828-a648-d4897b62378d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:48.332253 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-ff01a423-04d8-4828-a648-d4897b62378d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:48.338881 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ff01a423-04d8-4828-a648-d4897b62378d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:48.339327 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ff01a423-04d8-4828-a648-d4897b62378d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:48.340110 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ff01a423-04d8-4828-a648-d4897b62378d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:48.340542 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-ff01a423-04d8-4828-a648-d4897b62378d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:48.485623 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-ff01a423-04d8-4828-a648-d4897b62378d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:48.493560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-ff01a423-04d8-4828-a648-d4897b62378d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1753 microversion: 2.1 time: 0.165885 Jul 14 16:26:48.494145 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1630/3156] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:48 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1753 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:49.510478 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-2bbae442-f24b-4ca8-ba1f-44279d6fa4b2 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:49.511076 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-2bbae442-f24b-4ca8-ba1f-44279d6fa4b2 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:49.518305 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2bbae442-f24b-4ca8-ba1f-44279d6fa4b2 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:49.518750 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2bbae442-f24b-4ca8-ba1f-44279d6fa4b2 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:49.519503 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2bbae442-f24b-4ca8-ba1f-44279d6fa4b2 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:49.519965 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-2bbae442-f24b-4ca8-ba1f-44279d6fa4b2 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:49.666847 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-2bbae442-f24b-4ca8-ba1f-44279d6fa4b2 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:49.675124 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-2bbae442-f24b-4ca8-ba1f-44279d6fa4b2 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1753 microversion: 2.1 time: 0.168428 Jul 14 16:26:49.675991 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1527/3157] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:49 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:50.694565 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-27dd7be6-d9d9-4c31-a9d9-328c9717c3e4 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:50.695161 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-27dd7be6-d9d9-4c31-a9d9-328c9717c3e4 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:50.702844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27dd7be6-d9d9-4c31-a9d9-328c9717c3e4 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:50.703295 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27dd7be6-d9d9-4c31-a9d9-328c9717c3e4 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:50.705655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27dd7be6-d9d9-4c31-a9d9-328c9717c3e4 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:50.706850 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-27dd7be6-d9d9-4c31-a9d9-328c9717c3e4 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:50.852109 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-27dd7be6-d9d9-4c31-a9d9-328c9717c3e4 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:50.861294 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-27dd7be6-d9d9-4c31-a9d9-328c9717c3e4 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1753 microversion: 2.1 time: 0.172056 Jul 14 16:26:50.861876 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1631/3158] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:50 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1753 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:51.877897 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-b1c9136a-869b-495b-a849-d74ea6d07333 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:51.878451 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-b1c9136a-869b-495b-a849-d74ea6d07333 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:51.884901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b1c9136a-869b-495b-a849-d74ea6d07333 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:51.885365 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b1c9136a-869b-495b-a849-d74ea6d07333 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:51.886132 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b1c9136a-869b-495b-a849-d74ea6d07333 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:51.886598 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-b1c9136a-869b-495b-a849-d74ea6d07333 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:52.032663 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-b1c9136a-869b-495b-a849-d74ea6d07333 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:52.041425 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-b1c9136a-869b-495b-a849-d74ea6d07333 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1753 microversion: 2.1 time: 0.167434 Jul 14 16:26:52.041989 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1528/3159] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:51 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1753 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:53.059560 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-66b7b554-789d-4ad8-acd8-0bfa0ed02915 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:53.060201 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-66b7b554-789d-4ad8-acd8-0bfa0ed02915 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:53.067575 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66b7b554-789d-4ad8-acd8-0bfa0ed02915 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:53.068056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66b7b554-789d-4ad8-acd8-0bfa0ed02915 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:53.068816 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66b7b554-789d-4ad8-acd8-0bfa0ed02915 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:53.069255 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-66b7b554-789d-4ad8-acd8-0bfa0ed02915 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:53.213930 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-66b7b554-789d-4ad8-acd8-0bfa0ed02915 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:53.222362 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-66b7b554-789d-4ad8-acd8-0bfa0ed02915 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1753 microversion: 2.1 time: 0.166673 Jul 14 16:26:53.222924 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1632/3160] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:53 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1753 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:54.239888 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bbf3157b-3588-4958-83ad-bce454925565 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:54.240534 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bbf3157b-3588-4958-83ad-bce454925565 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:54.246951 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbf3157b-3588-4958-83ad-bce454925565 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:54.247397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbf3157b-3588-4958-83ad-bce454925565 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:54.248182 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbf3157b-3588-4958-83ad-bce454925565 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:54.248617 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bbf3157b-3588-4958-83ad-bce454925565 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:54.395915 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bbf3157b-3588-4958-83ad-bce454925565 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:54.403958 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bbf3157b-3588-4958-83ad-bce454925565 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1753 microversion: 2.1 time: 0.167942 Jul 14 16:26:54.404661 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1529/3161] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:54 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1753 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:55.421797 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3b679e3d-8ba4-4516-aa51-8e02e02f8cd5 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:55.422532 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3b679e3d-8ba4-4516-aa51-8e02e02f8cd5 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:55.429402 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3b679e3d-8ba4-4516-aa51-8e02e02f8cd5 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:55.429854 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3b679e3d-8ba4-4516-aa51-8e02e02f8cd5 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:55.430607 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3b679e3d-8ba4-4516-aa51-8e02e02f8cd5 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:55.431042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3b679e3d-8ba4-4516-aa51-8e02e02f8cd5 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:55.584495 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3b679e3d-8ba4-4516-aa51-8e02e02f8cd5 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:55.592543 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3b679e3d-8ba4-4516-aa51-8e02e02f8cd5 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1753 microversion: 2.1 time: 0.174635 Jul 14 16:26:55.593105 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1633/3162] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:55 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1753 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:56.610593 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-bc53e72e-bb8c-4f2d-83c0-5ca5908769ee tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:56.611208 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-bc53e72e-bb8c-4f2d-83c0-5ca5908769ee tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:56.617881 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bc53e72e-bb8c-4f2d-83c0-5ca5908769ee tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:56.618337 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bc53e72e-bb8c-4f2d-83c0-5ca5908769ee tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:56.619100 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bc53e72e-bb8c-4f2d-83c0-5ca5908769ee tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:56.619545 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-bc53e72e-bb8c-4f2d-83c0-5ca5908769ee tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:56.768743 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-bc53e72e-bb8c-4f2d-83c0-5ca5908769ee tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:56.776819 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-bc53e72e-bb8c-4f2d-83c0-5ca5908769ee tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1753 microversion: 2.1 time: 0.170486 Jul 14 16:26:56.777384 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1530/3163] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:56 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1753 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:26:57.793844 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-3ce7794d-39e0-4fea-ba02-8cb63b2888e7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:26:57.794451 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-3ce7794d-39e0-4fea-ba02-8cb63b2888e7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:26:57.801439 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ce7794d-39e0-4fea-ba02-8cb63b2888e7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:57.801887 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ce7794d-39e0-4fea-ba02-8cb63b2888e7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:57.802642 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ce7794d-39e0-4fea-ba02-8cb63b2888e7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:26:57.803088 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-3ce7794d-39e0-4fea-ba02-8cb63b2888e7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:26:57.945579 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-3ce7794d-39e0-4fea-ba02-8cb63b2888e7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:26:57.953988 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-3ce7794d-39e0-4fea-ba02-8cb63b2888e7 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1756 microversion: 2.1 time: 0.164034 Jul 14 16:26:57.954556 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1634/3164] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:26:57 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1756 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:27:31.530306 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-fd1b0341-5d32-49a0-995f-05eeba2772d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-64682606"}} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:27:31.530975 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-fd1b0341-5d32-49a0-995f-05eeba2772d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:27:31.533134 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_api:SELECT=12 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:27:31.533797 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG dbcounter [-] [124502] Writing DB stats nova_cell1:SELECT=36 {{(pid=124502) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:27:31.539741 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd1b0341-5d32-49a0-995f-05eeba2772d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:31.540200 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd1b0341-5d32-49a0-995f-05eeba2772d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:31.540972 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd1b0341-5d32-49a0-995f-05eeba2772d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:31.541416 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-fd1b0341-5d32-49a0-995f-05eeba2772d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:31.676093 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.network.security_group_api [None req-fd1b0341-5d32-49a0-995f-05eeba2772d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Removing security group 580a4ead-fddd-4eda-a6e4-b2dd8452127b from port b58a75ff-78a7-42c1-8631-f5ff2c068246 Jul 14 16:27:32.014423 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-fd1b0341-5d32-49a0-995f-05eeba2772d6 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "POST /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/action" status: 202 len: 0 microversion: 2.1 time: 0.488130 Jul 14 16:27:32.021919 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1531/3165] 10.222.0.99 () {60 vars in 1277 bytes} [Thu Jul 14 16:27:31 2022] POST /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/action => generated 0 bytes in 497 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:27:32.028972 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-a709716b-2243-4cba-a3b8-d546b4c3dc1b req-c39b0e44-10de-491a-9c19-61e9e4cdf084 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3d6e63-c73a-43cf-bf88-455cb47417e3", "tag": "b58a75ff-78a7-42c1-8631-f5ff2c068246"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:27:32.039043 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_api:SELECT=14 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:27:32.040062 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG dbcounter [-] [124503] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124503) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 14 16:27:32.046477 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-a709716b-2243-4cba-a3b8-d546b4c3dc1b req-c39b0e44-10de-491a-9c19-61e9e4cdf084 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:32.047067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-a709716b-2243-4cba-a3b8-d546b4c3dc1b req-c39b0e44-10de-491a-9c19-61e9e4cdf084 service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:32.070509 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-a709716b-2243-4cba-a3b8-d546b4c3dc1b req-c39b0e44-10de-491a-9c19-61e9e4cdf084 service nova] Creating event network-changed:b58a75ff-78a7-42c1-8631-f5ff2c068246 for instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 on hv-cinder-82651 Jul 14 16:27:32.082633 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-a709716b-2243-4cba-a3b8-d546b4c3dc1b req-c39b0e44-10de-491a-9c19-61e9e4cdf084 service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058388 Jul 14 16:27:32.083790 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1635/3166] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:27:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:27:33.384594 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-ffa82067-1758-418f-82a2-c2a07638324d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:27:33.385191 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-ffa82067-1758-418f-82a2-c2a07638324d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:27:33.392490 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ffa82067-1758-418f-82a2-c2a07638324d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:33.393030 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ffa82067-1758-418f-82a2-c2a07638324d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:33.393878 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ffa82067-1758-418f-82a2-c2a07638324d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:33.394397 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-ffa82067-1758-418f-82a2-c2a07638324d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:33.480607 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.objects.instance [None req-ffa82067-1758-418f-82a2-c2a07638324d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lazy-loading 'services' on Instance uuid bc3d6e63-c73a-43cf-bf88-455cb47417e3 {{(pid=124502) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jul 14 16:27:33.483185 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [req-efeaf354-c7b2-4728-87d6-16574e3541ea req-563303a3-c7db-434d-9036-52cf4bf78a2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bc3d6e63-c73a-43cf-bf88-455cb47417e3", "tag": "b58a75ff-78a7-42c1-8631-f5ff2c068246"}]} {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:27:33.491744 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-efeaf354-c7b2-4728-87d6-16574e3541ea req-563303a3-c7db-434d-9036-52cf4bf78a2e service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:33.492734 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [req-efeaf354-c7b2-4728-87d6-16574e3541ea req-563303a3-c7db-434d-9036-52cf4bf78a2e service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:33.505261 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.compute.server_external_events [req-efeaf354-c7b2-4728-87d6-16574e3541ea req-563303a3-c7db-434d-9036-52cf4bf78a2e service nova] Creating event network-changed:b58a75ff-78a7-42c1-8631-f5ff2c068246 for instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 on hv-cinder-82651 Jul 14 16:27:33.509829 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [req-efeaf354-c7b2-4728-87d6-16574e3541ea req-563303a3-c7db-434d-9036-52cf4bf78a2e service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.127268 Jul 14 16:27:33.510401 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1636/3167] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:27:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jul 14 16:27:33.580724 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-ffa82067-1758-418f-82a2-c2a07638324d tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "DELETE /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/os-volume_attachments/2afca312-f3b9-45d5-aaaf-d8b383607dd9" status: 202 len: 0 microversion: 2.1 time: 0.200942 Jul 14 16:27:33.581530 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1532/3168] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 16:27:33 2022] DELETE /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/os-volume_attachments/2afca312-f3b9-45d5-aaaf-d8b383607dd9 => generated 0 bytes in 203 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:27:33.593004 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2be3b5f5-e723-49b7-8ab5-b6dddb239388 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:27:33.594153 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2be3b5f5-e723-49b7-8ab5-b6dddb239388 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:27:33.603106 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2be3b5f5-e723-49b7-8ab5-b6dddb239388 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:33.603968 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2be3b5f5-e723-49b7-8ab5-b6dddb239388 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:33.605042 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2be3b5f5-e723-49b7-8ab5-b6dddb239388 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:33.605557 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2be3b5f5-e723-49b7-8ab5-b6dddb239388 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:33.643388 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2be3b5f5-e723-49b7-8ab5-b6dddb239388 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056484 Jul 14 16:27:33.644154 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1637/3169] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:27:33 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:27:34.658799 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-4d9acda3-d872-410a-8b12-a3ef4c1854f9 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:27:34.659935 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-4d9acda3-d872-410a-8b12-a3ef4c1854f9 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:27:34.668648 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4d9acda3-d872-410a-8b12-a3ef4c1854f9 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:34.669171 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4d9acda3-d872-410a-8b12-a3ef4c1854f9 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:34.670717 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4d9acda3-d872-410a-8b12-a3ef4c1854f9 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:34.671175 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-4d9acda3-d872-410a-8b12-a3ef4c1854f9 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:34.703082 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-4d9acda3-d872-410a-8b12-a3ef4c1854f9 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.051342 Jul 14 16:27:34.703560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1533/3170] 10.222.0.99 () {58 vars in 1301 bytes} [Thu Jul 14 16:27:34 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jul 14 16:27:34.713411 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-652e6180-c917-473f-8103-ebe5c86de0dc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:27:34.713906 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-652e6180-c917-473f-8103-ebe5c86de0dc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:27:34.720493 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-652e6180-c917-473f-8103-ebe5c86de0dc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:34.720947 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-652e6180-c917-473f-8103-ebe5c86de0dc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:34.721729 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-652e6180-c917-473f-8103-ebe5c86de0dc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:34.722200 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-652e6180-c917-473f-8103-ebe5c86de0dc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:34.797502 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-652e6180-c917-473f-8103-ebe5c86de0dc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] HTTP exception thrown: Instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 is not attached to volume 2afca312-f3b9-45d5-aaaf-d8b383607dd9 Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-652e6180-c917-473f-8103-ebe5c86de0dc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Request method failure captured: Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: DELETE /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/os-volume_attachments/2afca312-f3b9-45d5-aaaf-d8b383607dd9 HTTP/1.1 Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0EN4hATdcyU8ZRDZogty5PN077K435BbOK0E-8hcBoo4ym7Bduv0km7Wj0L6RDFqo92Wf11YF9p2ITxOyrbfqxOBcU6GTseAYn4jBzuYUho78iRMLs_-lW5BcUd0WvTrdSHktxFe3KJRJkTpmFPRjBH7RDF5tNvkjkujiaqOIV8ZL2k Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: a4f95de73a8f4a0ba3d4fdaab174a1c2 Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-TestMinimumBasicScenario-1041156684 Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:27:34.800164 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:27:34.801608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a4f95de73a8f4a0ba3d4fdaab174a1c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a4f95de73a8f4a0ba3d4fdaab174a1c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a4f95de73a8f4a0ba3d4fdaab174a1c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a4f95de73a8f4a0ba3d4fdaab174a1c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:27:34.801608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-TestMinimumBasicScenario-1041156684 Jul 14 16:27:34.801608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: a4f95de73a8f4a0ba3d4fdaab174a1c2 Jul 14 16:27:34.801608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1041156684 Jul 14 16:27:34.801608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-TestMinimumBasicScenario-1041156684-project Jul 14 16:27:34.801608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:27:34.801608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:27:34.801608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 755f5db986a24ac9a7bd5c77a257df60 Jul 14 16:27:34.801608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-TestMinimumBasicScenario-1041156684-project Jul 14 16:27:34.801608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:27:34.801608 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 is not attached to volume 2afca312-f3b9-45d5-aaaf-d8b383607dd9 Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'server_id': 'bc3d6e63-c73a-43cf-bf88-455cb47417e3', 'id': '2afca312-f3b9-45d5-aaaf-d8b383607dd9'} Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 2afca312-f3b9-45d5-aaaf-d8b383607dd9. Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:27:34.802423 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 is not attached to volume 2afca312-f3b9-45d5-aaaf-d8b383607dd9 Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 is not attached to volume 2afca312-f3b9-45d5-aaaf-d8b383607dd9 Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:27:34.803731 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-652e6180-c917-473f-8103-ebe5c86de0dc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Returning 404 to user: Instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 is not attached to volume 2afca312-f3b9-45d5-aaaf-d8b383607dd9 {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:27:34.804580 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-652e6180-c917-473f-8103-ebe5c86de0dc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "DELETE /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/os-volume_attachments/2afca312-f3b9-45d5-aaaf-d8b383607dd9" status: 404 len: 154 microversion: 2.1 time: 0.092196 Jul 14 16:27:34.804580 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1638/3171] 10.222.0.99 () {58 vars in 1415 bytes} [Thu Jul 14 16:27:34 2022] DELETE /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3/os-volume_attachments/2afca312-f3b9-45d5-aaaf-d8b383607dd9 => generated 154 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:27:35.942824 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-8f97dd6b-c150-4bf4-b989-ccd07dfd342c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:27:35.943349 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8f97dd6b-c150-4bf4-b989-ccd07dfd342c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:27:35.949845 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f97dd6b-c150-4bf4-b989-ccd07dfd342c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:35.950299 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f97dd6b-c150-4bf4-b989-ccd07dfd342c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:35.951789 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f97dd6b-c150-4bf4-b989-ccd07dfd342c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:35.952239 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-8f97dd6b-c150-4bf4-b989-ccd07dfd342c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:35.976671 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-8f97dd6b-c150-4bf4-b989-ccd07dfd342c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Going to try to terminate instance {{(pid=124502) delete /opt/stack/nova/nova/compute/api.py:2664}} Jul 14 16:27:36.059081 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-8f97dd6b-c150-4bf4-b989-ccd07dfd342c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "DELETE /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 204 len: 0 microversion: 2.1 time: 0.119796 Jul 14 16:27:36.059677 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1534/3172] 10.222.0.99 () {58 vars in 1238 bytes} [Thu Jul 14 16:27:35 2022] DELETE /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jul 14 16:27:36.068356 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2beacace-e939-4a4b-9532-db09d3a0248c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:27:36.069056 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2beacace-e939-4a4b-9532-db09d3a0248c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:27:36.077067 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2beacace-e939-4a4b-9532-db09d3a0248c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:36.077523 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2beacace-e939-4a4b-9532-db09d3a0248c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:36.078285 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2beacace-e939-4a4b-9532-db09d3a0248c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:36.078723 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2beacace-e939-4a4b-9532-db09d3a0248c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:36.208690 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-2beacace-e939-4a4b-9532-db09d3a0248c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:27:36.216381 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2beacace-e939-4a4b-9532-db09d3a0248c tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1553 microversion: 2.1 time: 0.151921 Jul 14 16:27:36.216942 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1639/3173] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:27:36 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1553 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jul 14 16:27:37.233353 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-e7adb6f4-773a-4891-b28b-8f86ef41ca27 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:27:37.234059 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.compute.api [None req-e7adb6f4-773a-4891-b28b-8f86ef41ca27 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124502) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:27:37.240560 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7adb6f4-773a-4891-b28b-8f86ef41ca27 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:37.241014 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7adb6f4-773a-4891-b28b-8f86ef41ca27 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:37.241775 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7adb6f4-773a-4891-b28b-8f86ef41ca27 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:37.242222 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [None req-e7adb6f4-773a-4891-b28b-8f86ef41ca27 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:37.377896 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.policy [None req-e7adb6f4-773a-4891-b28b-8f86ef41ca27 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124502) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:27:37.385436 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-e7adb6f4-773a-4891-b28b-8f86ef41ca27 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1553 microversion: 2.1 time: 0.156598 Jul 14 16:27:37.386014 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1535/3174] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:27:37 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:27:38.402288 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-aed9035f-b348-48d9-bdce-1710053ab250 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:27:38.402985 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-aed9035f-b348-48d9-bdce-1710053ab250 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:27:38.409945 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aed9035f-b348-48d9-bdce-1710053ab250 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:38.410393 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aed9035f-b348-48d9-bdce-1710053ab250 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:38.411160 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aed9035f-b348-48d9-bdce-1710053ab250 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:38.411619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-aed9035f-b348-48d9-bdce-1710053ab250 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:38.549508 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.policy [None req-aed9035f-b348-48d9-bdce-1710053ab250 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '755f5db986a24ac9a7bd5c77a257df60', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a4f95de73a8f4a0ba3d4fdaab174a1c2', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124503) authorize /opt/stack/nova/nova/policy.py:199}} Jul 14 16:27:38.557089 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-aed9035f-b348-48d9-bdce-1710053ab250 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 200 len: 1553 microversion: 2.1 time: 0.158707 Jul 14 16:27:38.557655 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1640/3175] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:27:38 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 1553 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jul 14 16:27:38.671212 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [req-ae45b880-fb04-4ab3-be82-0e24c1837ae7 req-051c083d-d959-4b5d-b7c4-09034fe8951d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bc3d6e63-c73a-43cf-bf88-455cb47417e3", "name": "network-vif-deleted", "tag": "b58a75ff-78a7-42c1-8631-f5ff2c068246"}]} {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jul 14 16:27:38.683287 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-ae45b880-fb04-4ab3-be82-0e24c1837ae7 req-051c083d-d959-4b5d-b7c4-09034fe8951d service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:38.683784 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG oslo_concurrency.lockutils [req-ae45b880-fb04-4ab3-be82-0e24c1837ae7 req-051c083d-d959-4b5d-b7c4-09034fe8951d service nova] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124502) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:38.697901 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.compute.server_external_events [req-ae45b880-fb04-4ab3-be82-0e24c1837ae7 req-051c083d-d959-4b5d-b7c4-09034fe8951d service nova] Creating event network-vif-deleted:b58a75ff-78a7-42c1-8631-f5ff2c068246 for instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 on hv-cinder-82651 Jul 14 16:27:38.704273 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [req-ae45b880-fb04-4ab3-be82-0e24c1837ae7 req-051c083d-d959-4b5d-b7c4-09034fe8951d service nova] 10.222.0.99 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037654 Jul 14 16:27:38.705669 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1536/3176] 10.222.0.99 () {64 vars in 1317 bytes} [Thu Jul 14 16:27:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jul 14 16:27:39.574619 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2295f27c-5369-462b-a0c0-4c65b7b3eca3 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '>' {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:27:39.575238 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.compute.api [None req-2295f27c-5369-462b-a0c0-4c65b7b3eca3 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] [instance: bc3d6e63-c73a-43cf-bf88-455cb47417e3] Fetching instance by UUID {{(pid=124503) get /opt/stack/nova/nova/compute/api.py:2920}} Jul 14 16:27:39.582103 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2295f27c-5369-462b-a0c0-4c65b7b3eca3 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:39.582561 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2295f27c-5369-462b-a0c0-4c65b7b3eca3 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:39.583333 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2295f27c-5369-462b-a0c0-4c65b7b3eca3 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jul 14 16:27:39.583812 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG oslo_concurrency.lockutils [None req-2295f27c-5369-462b-a0c0-4c65b7b3eca3 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Lock "0dff6f42-13db-4133-b104-1554a748d0a4" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124503) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jul 14 16:27:39.599013 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.wsgi [None req-2295f27c-5369-462b-a0c0-4c65b7b3eca3 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] HTTP exception thrown: Instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 could not be found. Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2295f27c-5369-462b-a0c0-4c65b7b3eca3 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Request method failure captured: Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: request: GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 HTTP/1.1 Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept: application/json Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Accept-Encoding: identity Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Connection: close Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Length: 0 Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Content-Type: application/json Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Host: 10.222.0.99 Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Openstack-System-Scope: None Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: User-Agent: python-urllib3/1.26.9 Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Auth-Token: gAAAAABi0EN4hATdcyU8ZRDZogty5PN077K435BbOK0E-8hcBoo4ym7Bduv0km7Wj0L6RDFqo92Wf11YF9p2ITxOyrbfqxOBcU6GTseAYn4jBzuYUho78iRMLs_-lW5BcUd0WvTrdSHktxFe3KJRJkTpmFPRjBH7RDF5tNvkjkujiaqOIV8ZL2k Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Id: None Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Domain-Name: None Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Identity-Status: Confirmed Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Is-Admin-Project: True Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Id: default Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Domain-Name: Default Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Id: a4f95de73a8f4a0ba3d4fdaab174a1c2 Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Project-Name: tempest-TestMinimumBasicScenario-1041156684 Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Role: reader,member Jul 14 16:27:39.600667 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Roles: reader,member Jul 14 16:27:39.602093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Service-Catalog: [{"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.99:8080", "publicURL": "http://10.222.0.99:8080/v1/AUTH_a4f95de73a8f4a0ba3d4fdaab174a1c2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99:9696/"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a4f95de73a8f4a0ba3d4fdaab174a1c2"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/image"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/volume/v3/a4f95de73a8f4a0ba3d4fdaab174a1c2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/identity"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2.1"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/compute/v2/a4f95de73a8f4a0ba3d4fdaab174a1c2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.99/placement"}]}] Jul 14 16:27:39.602093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant: tempest-TestMinimumBasicScenario-1041156684 Jul 14 16:27:39.602093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Id: a4f95de73a8f4a0ba3d4fdaab174a1c2 Jul 14 16:27:39.602093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1041156684 Jul 14 16:27:39.602093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User: tempest-TestMinimumBasicScenario-1041156684-project Jul 14 16:27:39.602093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Id: default Jul 14 16:27:39.602093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Domain-Name: Default Jul 14 16:27:39.602093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Id: 755f5db986a24ac9a7bd5c77a257df60 Jul 14 16:27:39.602093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: X-User-Name: tempest-TestMinimumBasicScenario-1041156684-project Jul 14 16:27:39.602093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: method: > Jul 14 16:27:39.602093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: exception: Instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 could not be found. Jul 14 16:27:39.602093 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: action_args: {'id': 'bc3d6e63-c73a-43cf-bf88-455cb47417e3'} Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: {{(pid=124503) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 could not be found. Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jul 14 16:27:39.605749 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 could not be found. Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 could not be found. Jul 14 16:27:39.607218 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: ERROR nova.api.openstack.wsgi Jul 14 16:27:39.608811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: DEBUG nova.api.openstack.wsgi [None req-2295f27c-5369-462b-a0c0-4c65b7b3eca3 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Returning 404 to user: Instance bc3d6e63-c73a-43cf-bf88-455cb47417e3 could not be found. {{(pid=124503) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jul 14 16:27:39.608811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO nova.api.openstack.requestlog [None req-2295f27c-5369-462b-a0c0-4c65b7b3eca3 tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3" status: 404 len: 111 microversion: 2.1 time: 0.031409 Jul 14 16:27:39.608811 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: [pid: 124503|app: 0|req: 1641/3177] 10.222.0.99 () {58 vars in 1235 bytes} [Thu Jul 14 16:27:39 2022] GET /compute/v2.1/servers/bc3d6e63-c73a-43cf-bf88-455cb47417e3 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jul 14 16:27:39.612107 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: DEBUG nova.api.openstack.wsgi [None req-67ea4323-1e2f-49ea-9cc7-88347b34a1cc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] Calling method '.version_select at 0x7f357fe6b940>' {{(pid=124502) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jul 14 16:27:39.632033 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO nova.api.openstack.requestlog [None req-67ea4323-1e2f-49ea-9cc7-88347b34a1cc tempest-TestMinimumBasicScenario-1041156684 tempest-TestMinimumBasicScenario-1041156684-project] 10.222.0.99 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1709355247" status: 202 len: 0 microversion: 2.1 time: 0.024754 Jul 14 16:27:39.632605 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: [pid: 124502|app: 0|req: 1537/3178] 10.222.0.99 () {58 vars in 1271 bytes} [Thu Jul 14 16:27:39 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1709355247 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jul 14 16:28:20.559301 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:28:20.559936 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:28:20 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:28:28.930793 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:28:28.931328 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:28:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:30:03.892599 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:30:03.893346 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:30:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:30:18.927178 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:30:18.927874 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:30:18 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:30:33.402873 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:30:33.403467 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:30:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:30:51.647357 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:30:51.648040 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:30:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:31:40.567836 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:31:40.568501 dv-cinder-826510-8-iscsi devstack@n-api.service[124503]: Thu Jul 14 16:31:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:31:48.939835 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:31:48.940429 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:31:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jul 14 16:33:23.901693 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jul 14 16:33:23.902297 dv-cinder-826510-8-iscsi devstack@n-api.service[124502]: Thu Jul 14 16:33:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!